Metadata Download Plugin - Bulk Downloads

Bradles · 03-13-2021, 09:01 PM

I'm working on a metadata download plugin for LibraryThing, which has been "educational" and somewhat successful. I based it on the Smashwords plugin, so it uses the goodreads-style Worker thread model.

My first question concerns the frequency at which the bulk downloads are initiated (i.e. select multiple books then Ctrl+D). Is this impacted by the "sleep" after worker.start()? The reason I ask is that after three or four isbn lookups librarything blocks me and everything returns a 404 error after that. (It returns to normal after a period of time.) I would like to "pace" the calls to see if it makes any difference.

The second question concerns the get_book_url() function, which is called whenever a book is selected. I think I read that this is used to generate the URL executed when the identifier is clicked. But how does this relate to "rules to convert identifiers into links" as specified in Prefs / Book Details? One supersedes the other I guess?

Cheers.

kovidgoyal · 03-13-2021, 09:14 PM

There is no fixed freq, IIRC when all metadata for one book is downloaded the next is started. As for the rules vs plugins, IIRC rules have higher precedence.

Bradles · 03-14-2021, 10:23 PM

Thanks Kovid.

To partially answer my own question, adding a 10 second sleep does pace the books out nicely, but doesn't help me with librarything, which still blocks me. I'll see if they can advise an acceptable pace.

03-13-2021, 09:01 PM	#1
Bradles Connoisseur Posts: 70 Karma: 21074 Join Date: Nov 2020 Location: Perth, Western Australia Device: Apple Books & Kobo Libra H20	Metadata Download Plugin - Bulk Downloads I'm working on a metadata download plugin for LibraryThing, which has been "educational" and somewhat successful. I based it on the Smashwords plugin, so it uses the goodreads-style Worker thread model. My first question concerns the frequency at which the bulk downloads are initiated (i.e. select multiple books then Ctrl+D). Is this impacted by the "sleep" after worker.start()? The reason I ask is that after three or four isbn lookups librarything blocks me and everything returns a 404 error after that. (It returns to normal after a period of time.) I would like to "pace" the calls to see if it makes any difference. The second question concerns the get_book_url() function, which is called whenever a book is selected. I think I read that this is used to generate the URL executed when the identifier is clicked. But how does this relate to "rules to convert identifiers into links" as specified in Prefs / Book Details? One supersedes the other I guess? Cheers.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Regarding using metadata objects in identify method of metadata download plugin api	aprekates	Development	1	07-06-2014 03:35 AM
Bulk metadata download	anthony.burton4	Library Management	2	02-07-2013 06:42 AM
Bulk Metadata Download Problem	sweetevilbunies	Library Management	6	07-04-2011 10:39 PM
Bulk metadata download incoherent	madeinlisboa	Calibre	6	06-24-2011 01:18 PM
Bulk Metadata Download	iain_benson	Calibre	1	09-29-2009 11:42 AM

03-13-2021, 09:14 PM	#2
kovidgoyal creator of calibre Posts: 43,860 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	There is no fixed freq, IIRC when all metadata for one book is downloaded the next is started. As for the rules vs plugins, IIRC rules have higher precedence.

03-14-2021, 10:23 PM	#3
Bradles Connoisseur Posts: 70 Karma: 21074 Join Date: Nov 2020 Location: Perth, Western Australia Device: Apple Books & Kobo Libra H20	Thanks Kovid. To partially answer my own question, adding a 10 second sleep does pace the books out nicely, but doesn't help me with librarything, which still blocks me. I'll see if they can advise an acceptable pace.