|
Newer Test Version Posted
2021-01-31 Take 2
- Major refactoring/rewrite of network fetching and caching layer using requests library.
- Convert adapter_spikeluvercom to base_efiction after site changes.
- Remove 'extrasleep' feature--it was ugly--increase slow_down_sleep_time for the couple sites that used it. We can trust the users, right?
- Remove httplib._MAXHEADERS workaround for royalroad.com - not happening anymore.
- Bump Test Version 3.99.X
- Fixes for py2/py3 & a stray INI space.
Basic testing done on Win10Cal2.85.1 & Cal5, macos Cal5 and linux Cal5.
'extrasleep' was an internal thing that was added to hardcode extra sleep time into requests for certain sites. In practice, it was only ever used with base_xenforo (SB, SV, QQ, etc) and ffnet.
It complicated the 'fetcher' layer while--in theory--being redundant with just increasing slow_down_sleep_time. Its advantage was users couldn't easily turn it down or off.
ffnet download times are slower now both because of serializing BG downloads and increased slow_down_sleep_time for ffnet.
I plan to revisit parallel BG downloads, but with an eye to having parallel queues for different sites, so each site only has one download at a time, but different sites can run in parallel.
|