MobileRead Forums - View Single Post - 5 hours updating metadata after downloading meta data for 300 books on i-3770k

BetterRed · 06-07-2013, 06:58 PM

@N13L5 The new bulk metadata has 3 stages - gather, review and update - I'm assuming you're referring to the last one.

I've not done that many books in a batch. But I've recently been doing batches of 30-50 books on a friends 7 year old Tosh Portege (dual Core 1.2GHz Centrino, 2GB of RAM) running Vista and Calibre 0.9.3n 32bit. I've not noticed the sort of performance you seem to be getting on those batch sizes, the update phase typically takes < 5 minutes.

And I'm usually running Firefox, Open Office Writer and almost 30 tray applets. I don't know if its relevant but I run calibre jobs at Low Priority (Pref->Behave) and One at Time (Pref Miscellaneous). My perception is that those settings give me better performance.

At a glance I don't think calibre accesses the internet in the update phase, my up/down network indicators show minimal activity, never more than 2.00kb/s and most of the time at 0.00 - assuming there's no other activity (browsers, ftp etc).

Looks to me like some sort of resource contention, try shutting down other applications - what OS are you on?

BR

06-07-2013, 06:58 PM	#5
BetterRed null operator (he/him) Posts: 21,800 Karma: 30237628 Join Date: Mar 2012 Location: Sydney Australia Device: none	@N13L5 The new bulk metadata has 3 stages - gather, review and update - I'm assuming you're referring to the last one. I've not done that many books in a batch. But I've recently been doing batches of 30-50 books on a friends 7 year old Tosh Portege (dual Core 1.2GHz Centrino, 2GB of RAM) running Vista and Calibre 0.9.3n 32bit. I've not noticed the sort of performance you seem to be getting on those batch sizes, the update phase typically takes < 5 minutes. And I'm usually running Firefox, Open Office Writer and almost 30 tray applets. I don't know if its relevant but I run calibre jobs at Low Priority (Pref->Behave) and One at Time (Pref Miscellaneous). My perception is that those settings give me better performance. At a glance I don't think calibre accesses the internet in the update phase, my up/down network indicators show minimal activity, never more than 2.00kb/s and most of the time at 0.00 - assuming there's no other activity (browsers, ftp etc). Looks to me like some sort of resource contention, try shutting down other applications - what OS are you on? BR