New Test Version Posted (again)
2017-08-30
- Add sectionUrl metadata and mechanism for internally normalizing story URLs *and* [story URL] sections. For base_xenforo when including thread titles in storyUrl. Doesn't effect base_xenforo *post* URLs.
- base_xenforo: Move skip_threadmarks_categories to save a fetch if skipping anyway. Will also effect minimum_threadmarks.
- base_xenforo: Don't include thread title in *chapter* url, perfomance impact is smaller and keeps from marking a bunch of stuff (new).
- Add delays for base_xenforoforum_adapter.
- Use thread-title URL for storyUrl with base_xenforo to save redirect fetches.
- Comment out some debug output.
- Remove webnovel.com manual escaping of HTML entities, the website now seems to take care of it (#224)--thanks cryzed
Xon, the resident developer for
SpaceBattles and
SufficientVelocity has asked that we make some changes to reduce impact on their servers.
Apparently someone used an automated update polling script with FFF that was resulting in 30,000+ fetches a day. I agree that that is excessive. I would hope that people don't abuse any of the sites we support that way in future.
So downloading from base_xenforo will be slower from now on--deliberately.
And to save URL redirect hits, we will be storing the 'canonical' thread URLs with thread title--that can sometimes change. That will sometimes tripped the 'story URL changed' warnings, especially with stories already stored with title-less URLs.