major problems with downloading metadata

[piosza]

Hi.
For the past few weeks I have been having some major problems with downloading metadata. I'm not sure what the reason is.
Is there anyone who could help?
I am using calibre 3.47 (64bit).
Here's the log:

Starting job: Download metadata for 40 books
Job: "Download metadata for 40 books" failed with error:
Traceback (most recent call last):
File "site-packages\calibre\gui2\threaded_jobs.py", line 83, in start_work
File "site-packages\calibre\gui2\metadata\bulk_download.py", line 251, in download
File "site-packages\calibre\utils\ipc\simple_worker.py", line 229, in fork_job
File "site-packages\calibre\utils\ipc\simple_worker.py", line 107, in communicate
WorkerError: Worker appears to have hung

Called with args: ([119669L, 119668L, 119667L, 119666L, 119665L, 119664L, 119663L, 119662L, 119661L, 119660L, 119659L, 119658L, 119657L, 119656L, 119655L, 119654L, 119653L, 119652L, 119651L, 119650L, 119649L, 119648L, 119647L, 119646L, 119645L, 119644L, 119643L, 119642L, 119641L, 119640L, 119639L, 119638L, 119637L, 119636L, 119635L, 119634L, 119633L, 119632L, 68039, 96592], u'C:\\Users\\Piotr\\AppData\\Local\\Temp\\calibre_ tmxlyz\\00jwmd_metadata_bulk.log', <calibre.db.legacy.LibraryDatabase object at 0x0000012A8DC85DA0>, True, False, None) {u'log': <calibre.utils.logging.GUILog object at 0x0000012AFCE5ABA8>, u'abort': <threading._Event object at 0x0000012AFCE5A9E8>, u'notifications': <Queue.Queue instance at 0x0000012A95059BC8>}

[Bookstooge]

Are you using Win10? If so, what version? What, if any, A/V, etc programs do you have running?

[BetterRed]

@piosza - did you try doing the MD download for 1 book - one or more of your MD sources maybe barfing on 40 books - remember they provide the data for free, but they still have to pay for their servers and comms lines.

BR

[kovidgoyal]

Your antivirus/firewall is probably blocking calibre

[piosza]

Originally Posted by Bookstooge

Are you using Win10? If so, what version? What, if any, A/V, etc programs do you have running?

Hi. I'm using Win10 with all the updates. I don't have any A/V software installed apart from Windows Defender. Deactivating it doesn't change anything. I succeed in downloading metadata only for a few books at the time. Any attempt to download metadata for more than about 5 books at the time usually results in an error.

calibre, version 3.47.0 (win32, embedded-python: True)
Failed to download metadata: Failed: Download metadata for 14 books

Starting job: Download metadata for 14 books
Job: "Download metadata for 14 books" failed with error:
Traceback (most recent call last):
File "site-packages\calibre\gui2\threaded_jobs.py", line 83, in start_work
File "site-packages\calibre\gui2\metadata\bulk_download.py", line 251, in download
File "site-packages\calibre\utils\ipc\simple_worker.py", line 229, in fork_job
File "site-packages\calibre\utils\ipc\simple_worker.py", line 107, in communicate
WorkerError: Worker appears to have hung

Called with args: ([119667L, 119666L, 119665L, 119664L, 119663L, 119662L, 119661L, 119660L, 119659L, 119658L, 119657L, 119656L, 119655L, 119654L], u'C:\\Users\\Piotr\\AppData\\Local\\Temp\\calibre_ tmxlyz\\doe5ct_metadata_bulk.log', <calibre.db.legacy.LibraryDatabase object at 0x0000012A8DC85DA0>, True, False, None) {u'log': <calibre.utils.logging.GUILog object at 0x0000012AF4A73B00>, u'abort': <threading._Event object at 0x0000012AF4A73908>, u'notifications': <Queue.Queue instance at 0x0000012A96C44E88>}

[kovidgoyal]

Definitely something on your computer is interfering. That error typically happens when something blocks the worker process calibre uses for downloading metadata from running. Try restarting in safe mode and see if it works.

[piosza]

Originally Posted by kovidgoyal

Definitely something on your computer is interfering. That error typically happens when something blocks the worker process calibre uses for downloading metadata from running. Try restarting in safe mode and see if it works.

So how can I identify what exactly is interfering with the worker?

[BetterRed]

Originally Posted by piosza

So how can I identify what exactly is interfering with the worker?

Did you try Safe Mode?

If the downloads work there then something you're running in Normal mode that Windows doesn't run in Safe mode is doing the 'interfering'

Windows Task Manager can provide information on what's running, you can disable Startup, Scheduled and Service tasks - I'd start with Startup tasks.

BR