MobileRead Forums - View Single Post

ZioNemo · 02-06-2014, 06:42 AM

Hi,
my program to automatically transport metadata to Clibre seems to work ok (kudos to Calibre developers!).
Remaining issue (side from the, apparently harmless, exception seen yesterday) is a relative slowness of calibredb.
It takes several seconds to process an entry (I am already cumulating several field updates in a single "calibredb set_metadata").
I am less 1/8 through my large lib (24000+ books) after 12 solid hours.
If this is the pace I need more than four days for a full pass!
Is this "as expected" or am I doing something wrong?

I am currently using:

"calibredb catalog" to get the list of known books.
If book is known use "calibredb catalog -i <ID>" to get metadata
otherwise use "calibredb add -e" to create it and get ID
"calibredb set_metadata <ID> -f <field>:<val> -f <field>:<val> ..." to set missing metadata (only if some metadata changed, but now I'm importing, so all books are "unknown" and thus empty).

This means I do two calibredb calls per-book (the first call is out-of-the-loop).
Is there some way to speed up operations?

TiA

02-06-2014, 06:42 AM	#1
ZioNemo Enthusiast Posts: 48 Karma: 10 Join Date: Mar 2008 Device: HTC-p3000	calibredb slowness: is it expected? Hi, my program to automatically transport metadata to Clibre seems to work ok (kudos to Calibre developers!). Remaining issue (side from the, apparently harmless, exception seen yesterday) is a relative slowness of calibredb. It takes several seconds to process an entry (I am already cumulating several field updates in a single "calibredb set_metadata"). I am less 1/8 through my large lib (24000+ books) after 12 solid hours. If this is the pace I need more than four days for a full pass! Is this "as expected" or am I doing something wrong? I am currently using: "calibredb catalog" to get the list of known books. If book is known use "calibredb catalog -i <ID>" to get metadata otherwise use "calibredb add -e" to create it and get ID "calibredb set_metadata <ID> -f <field>:<val> -f <field>:<val> ..." to set missing metadata (only if some metadata changed, but now I'm importing, so all books are "unknown" and thus empty). This means I do two calibredb calls per-book (the first call is out-of-the-loop). Is there some way to speed up operations? TiA Last edited by ZioNemo; 02-06-2014 at 07:05 AM.