|
Any chance you could add a "Background Metadata" option to "Download from URLs" like it exists in "Update existing FanFiction Books"?
Also to pick up a previous discussion, "Download from URLs" is definitely not multi-threaded.
I wanted to download a bunch of stories (19) from novelfull.com, which is quite slow as I found that it doesn't work reliably without using flaresolverr.
I downloaded them all together in a single use of "Download from URLs" because I didn't want to sit around for 5 minutes each time waiting for "Downloading metadata for stories" before I can add the next one. (That's where a "Background Metadata" option would be great.)
That blocked calibre completely for almost an hour with "Downloading metadata for stories", followed by a job running for 49h which was clearly downloading one story, one chapter at a time linearly, despite calibre being configured for 18 background threads (I've got a 24core/48thread CPU).
A "Background Metadata" option to "Download from URLs" would at least have allowed me to add these manually as 19 different jobs without spending an hour waiting to add a new one every 5 minutes.
Then having "Download from URLs" either using multi-threading internally, or having a "create one job per book" option would have reduced that from 49h to maybe 3h.
(As I've said before, I would find a "create one job per book" option much more useful, as it means that I get access to the books as they are finished downloading, and don't have to wait for all of them to finish downloading.)
|