updating library

Rellwood · 06-14-2020, 04:59 PM

I noticed that as my library has grown in size (the db file is 65mb) that when I try to import a list to update tags, etc. the process takes a loooong time, when I look at the library using Explorer I see that a db journal is being used to update each book. Is this normal? It seems that instead of updating the .db file it is updating each book's .opf file.

Regarding the large .db file, I am trying to get all the info right for the library before splitting it up to smaller libraries.

Is there anything short of deleting columns that can make it go faster? I cleared out the icon rules, but I have a lot of tag rules.

right now it's taking about 3 seconds per book to update. I am importing lists of 200 books. Calibre 4.17 x64 Windows 10

BTW....I just downloaded 4.18 and love the heirarchal tag browser features!

ownedbycats · 06-14-2020, 05:16 PM

Try going to Library > Library Maintenance > Check Library. The sqlite database can get a little bloated after a while and doing this will vacuum it out.

Rellwood · 06-14-2020, 05:51 PM

Yeah, I have done that. I do it all the time in attempts at clearing out the "dust", thanks though!

BetterRed · 06-14-2020, 07:35 PM

The metadata.opf files are used by the Restore database function. When you update metadata those files are written in a separate background thread. So, your performance issues are very unlikely to be due to the writing of those files.

What sort device are your libraries stored on? And, how many books in the library?

I have a library of about 180,000 'books'. Updating a book's metadata, via the book list, is done as fast as I can enter the data. And, when a book's metadata is updated via F2 in the book list, calibre writes a new metadata.opf for each column edited, i.e. even if the column is tabbed through.

BR

ownedbycats · 06-14-2020, 07:40 PM

Quote:

Originally Posted by BetterRed

What sort device are your libraries stored on? And, how many books in the library?

Also: Not to cause any panic, but if you've not already I'd check the health of the device. One of the early signs of a faulty hard drive was Calibre starting to chug while doing bulk operations.

06-14-2020, 04:59 PM	#1
Rellwood Library Breeder (She/Her) Posts: 1,156 Karma: 1900479 Join Date: Apr 2015 Location: Fullerton, California Device: Kobo Aura HD (1) PW3 (4) PW3 2019 new edition (1)	updating library I noticed that as my library has grown in size (the db file is 65mb) that when I try to import a list to update tags, etc. the process takes a loooong time, when I look at the library using Explorer I see that a db journal is being used to update each book. Is this normal? It seems that instead of updating the .db file it is updating each book's .opf file. Regarding the large .db file, I am trying to get all the info right for the library before splitting it up to smaller libraries. Is there anything short of deleting columns that can make it go faster? I cleared out the icon rules, but I have a lot of tag rules. right now it's taking about 3 seconds per book to update. I am importing lists of 200 books. Calibre 4.17 x64 Windows 10 BTW....I just downloaded 4.18 and love the heirarchal tag browser features! Last edited by Rellwood; 06-14-2020 at 05:02 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Cannot See Library After Updating Calibre to 2.8	eucalyptus	Calibre	5	11-08-2014 10:25 PM
library missing after updating	mr_peppe	Calibre	5	08-07-2014 04:17 AM
Force updating library?	rantoie	Kobo Reader	8	02-02-2014 04:31 PM
syncing library after updating calibre	moe101	Library Management	0	07-23-2012 02:30 PM
Library not updating	tjkolev	Calibre	2	07-15-2010 05:35 AM

06-14-2020, 05:16 PM	#2
ownedbycats Custom User Title Posts: 8,553 Karma: 61120499 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Try going to Library > Library Maintenance > Check Library. The sqlite database can get a little bloated after a while and doing this will vacuum it out.

06-14-2020, 05:51 PM	#3
Rellwood Library Breeder (She/Her) Posts: 1,156 Karma: 1900479 Join Date: Apr 2015 Location: Fullerton, California Device: Kobo Aura HD (1) PW3 (4) PW3 2019 new edition (1)	Yeah, I have done that. I do it all the time in attempts at clearing out the "dust", thanks though!

06-14-2020, 07:35 PM	#4
BetterRed null operator (he/him) Posts: 20,550 Karma: 26954694 Join Date: Mar 2012 Location: Sydney Australia Device: none	The metadata.opf files are used by the Restore database function. When you update metadata those files are written in a separate background thread. So, your performance issues are very unlikely to be due to the writing of those files. What sort device are your libraries stored on? And, how many books in the library? I have a library of about 180,000 'books'. Updating a book's metadata, via the book list, is done as fast as I can enter the data. And, when a book's metadata is updated via F2 in the book list, calibre writes a new metadata.opf for each column edited, i.e. even if the column is tabbed through. BR

Advert

Advert