Quote:
Originally Posted by JimmXinu
How many stories you're downloading/updating and which sites they are on is usually the biggest factor.
The second biggest factor in my experience is the number of story URLs in your Reject List.
Both of those will be further slowed by large numbers of replace_metadata or in/exclude_metadata lines.
I have some new changes I'm currently testing that speed up the Reject List checking considerably as well as adding some new ini functionality. I plan to post a new version for others to test early this week.
|
Hm. Thank you for clearing that up for me.
Now I'm curious about this new test version.
But it's interesting. I have nothing in the Reject List, as it has been to date irrelevant to me. The archive in question is AO3. And I meant the long time thing actually for a single story only. For example, this fic
http://archiveofourown.org/works/4327644
took almost 10 minutes to finish the "download_metadata" part and I wasn't trying to download more than one fic at a time. (I try to avoid that for the sake of the servers' limits.) On the other hand, this fic
http://archiveofourown.org/works/1292134
has proved to be impossible to download for me with my ini, as it caused calibre to freeze up. (That is, I waited well over an hour to see if it would go past the "download metadata" stage, and when it didn't I gave up and forced calibre shut, because it really had frozen.)
Since a download without the replace/exclude metadata lines took only a few minutes, I could only assume it was either a bad line or simply too many lines. (This happens only with ao3 fics, since it's the archive where I have the single most replace/exclude lines. My ini is 123kb big--so yeah, a lot of lines.)