New Test Version Posted
2018-12-04
- Improve recursion-proofing of replace_metadata for performance and duplicate lines.
- Don't cache file: URLs. Option --save-cache can mask changes to _filelist files while debugging.
- Don't sleep when fetching file: URLs.
- Remove defunct site
www.artemis-fowl.com
- Remove defunct site asr3.slashzone.org
- Remove defunct site tolkienfanfiction.com
- Remove defunct site fanfiction.tenhawkpresents.com
- Remove defunct site unknowableroom.org
- Remove defunct site mujaji.net
- Update adapter_harrypotterfanfictioncom for site change.
@edeniz - This version finishes processing your insane replace_metadata in (only!) a few minutes (3-5) for me.
The lines you identified were duplicated, which lead me to improve recursion-proofing.
I'm not dead sure if that duplication was the problem, or if it's just the complexity explosion from having thousands of replace_metadata and hundreds of exclude lines. But this version seems to work.