Quote:
Originally Posted by JimmXinu
Evidence continues to mount that ffnet has instituted some sort of throttling system that significantly slows down some requests once they decide that you've made too many. We don't know what their criteria are, but it does seem to be slow downs rather than outright blocking.
The only advice I can give is don't do 'too many' downloads or update at once, or in a day. The value of 'too many' is unknown, but I'd guess it's lower than 100.
|
I am curious as to the criteria for that throttling system as there isn't any reasonable rhythm to the throttling. It appears to be on the number of requests but then why would it also prevent downloading new stories that only have 1 chapter each (just pondering out loud, not expecting anyone to be able to answer this).
As for the number of requests, I'm seeing it throttle when trying to update an existing story that I have that has had ~30 new chapters added (~300 words each) since the last time I've updated it. What is weird is that just after stopping this job, I tried updating a story that only had 1 new chapter added and had no problem with updating it.
The other weird thing is that I've tried 2 other different services for downloading stories, 1 is a web service and while it took a while was able to download (
https://www.fanfiction.net/s/8601250/1/A-Dead-World) without any problems. The other service was one that went by a similar name, Fanfictiondownloader (found at fanfictiondownloader.net), and was a stand-alone program that required to be installed on the PC. This 2nd one I tried it with 2 different stories, the aforementioned one and another bigger one that is over 500k words spread over 73 chapters, no problem with downloading them (for now I guess).
This is a little telling that it might have to be with how the FanFictionDownloader plugin is retrieving/requesting the stories off FFnet that is causing the problem.
On a side note is there a way to increase the timer between sending requests?