Quote:
Originally Posted by chrisridd
I’d be interested in seeing what you come up with.
The pages I seem to download now are from Cloudflare and just contain lots of JavaScript which needs to be executed. Some of that seems to be to compute complex json requests to other URLs which then give some actual HTML.
Hence running it inside an actual browser, or maybe node.js (?) might be needed.
|
Hmmmm. Let me see if I can't see what I can grab with a couple cURL commands or nmap. This sounds like they're behind a WAF which will make it difficult to actually grab that data without some finagling which would be a bad idea. I'll try to see what actually gets returned from the cURL command.