Yet Another New Test-Test Version
Instead of the usual place:
https://www.mobileread.com/forums/sh...88#post4072388
2020-12-22
- Adding cloudscraper and dependencies
- Updates for many included dependencies
- Need to semi-manually raise HTTPError for error codes with cloudscraper/requests.
- Temp: dump ffnet page to debug when metadata parsing fails.
- Clean up cloudscraper import
- Use requests.util.extract_zipped_paths to get browsers.json instead of kludge.
- Don't use mobile User-Agents with cloudscraper--adapter_fanfictionnet doesn't handle mobile pages.
I figured out why it was giving 'other' HTML sometimes--randomly selected
mobile browser User-Agents.