Trying to add large library of books - add books seems to have hung

nicknefarious · 06-18-2012, 01:23 AM

Trying to add large library of books - add books seems to have hung
Hi all, hoping for a little help.

I have for a while been trying to add a large library of books ~140GB of books. Every time I try I get through to 99% and then the next message I get is a list of the already existing books in the library that have been automerged. When I close this message I get an error message saying that the adding process has hung. Does this mean that nothing was added to the library? If something was added, exactly what was it? How can I see what was and wasn't added to the Calibre Library?

I'd really like some advice or direction on the best steps to take to add this many books to the library eg. What sort of batch size to do it in (obviously I'd prefer not to do it in batches of 20 books at a time) but I also don't want to get to 99% after three hours of it chewing through a large batch to get an error message and have none of them added. Because of this continuing error I often spend lots of time going back and adding books that are probably already in the library, but I am not sure and don't know exactly how to check if they are or not.

Is it better to use the Add books feature and select folders as I go or set up the auto add folder and do it that way. I'd really like to be able to select a folder and have it delete each book from the folder as it is added to the library that way assuming there is no bug within Calibre I can be sure of what has been added and what hasn't.

Secondly same goes for downloading book covers and metadata. What sort of batch sizes do you recommend or suggest?

Any other suggestions to ensure that everything that is added and edited is accurate and organised as it can/should be? I obviously don't want to lose or accidentally delete any of my books or incorrectly edit their metadata but with such a huge library I sure don't have the time to check each one myself other than to check as I go through them or maybe check small batches as and when I have the time.

All of the books are in one large folder broken into smaller folders some books are in their own individual folders some are not.

Any suggestions, advice and thoughts are all much appreciated.

Big cheers,

NN

theducks · 06-18-2012, 09:32 AM

First: Move those (soon to be archived?) books to a different drive than your (new?) Calibre Library is on. Calibre makes a COPY for its regular use. That is 320G

of books that can exist at one time

Second: do no more that 50-100 books at a time.
a) Things get a chance to be posted to the DB (in case of a hang/crash)
b) you get to see the progress
c) You can 'spool off' the completed source books to free up space

06-18-2012, 01:23 AM	#1
nicknefarious Junior Member Posts: 3 Karma: 10 Join Date: Jun 2012 Device: Android Phone	Trying to add large library of books - add books seems to have hung Trying to add large library of books - add books seems to have hung Hi all, hoping for a little help. I have for a while been trying to add a large library of books ~140GB of books. Every time I try I get through to 99% and then the next message I get is a list of the already existing books in the library that have been automerged. When I close this message I get an error message saying that the adding process has hung. Does this mean that nothing was added to the library? If something was added, exactly what was it? How can I see what was and wasn't added to the Calibre Library? I'd really like some advice or direction on the best steps to take to add this many books to the library eg. What sort of batch size to do it in (obviously I'd prefer not to do it in batches of 20 books at a time) but I also don't want to get to 99% after three hours of it chewing through a large batch to get an error message and have none of them added. Because of this continuing error I often spend lots of time going back and adding books that are probably already in the library, but I am not sure and don't know exactly how to check if they are or not. Is it better to use the Add books feature and select folders as I go or set up the auto add folder and do it that way. I'd really like to be able to select a folder and have it delete each book from the folder as it is added to the library that way assuming there is no bug within Calibre I can be sure of what has been added and what hasn't. Secondly same goes for downloading book covers and metadata. What sort of batch sizes do you recommend or suggest? Any other suggestions to ensure that everything that is added and edited is accurate and organised as it can/should be? I obviously don't want to lose or accidentally delete any of my books or incorrectly edit their metadata but with such a huge library I sure don't have the time to check each one myself other than to check as I go through them or maybe check small batches as and when I have the time. All of the books are in one large folder broken into smaller folders some books are in their own individual folders some are not. Any suggestions, advice and thoughts are all much appreciated. Big cheers, NN

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Can't add books to calibre library on friends laptop	20LEgend	Library Management	0	06-16-2012 03:12 PM
"The add books process seems to have hung"	joleta	Calibre	6	06-16-2012 02:26 AM
How to add books to Library Through Calibre	Barzo	enTourage eDGe	3	05-24-2012 11:11 AM
Can I automatically add multiple books to my Caibre library?	BIGDAVE	Library Management	2	10-29-2011 06:21 PM
LACO Library to add 10,000 E-books	Blusaber	News	3	10-01-2011 12:27 PM

06-18-2012, 09:32 AM	#2
theducks Well trained by Cats Posts: 29,795 Karma: 54830978 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	First: Move those (soon to be archived?) books to a different drive than your (new?) Calibre Library is on. Calibre makes a COPY for its regular use. That is 320G of books that can exist at one time Second: do no more that 50-100 books at a time. a) Things get a chance to be posted to the DB (in case of a hang/crash) b) you get to see the progress c) You can 'spool off' the completed source books to free up space

Advert