Is Library Rebuild Necessary?

phossler · 09-08-2016, 11:11 AM

Under [Library Maintenance] you can [Check the Library] which finds errors, but I was wondering if it's ever necessary to 're-build' (not sure what the correct term is) the database to reclaim space from deleted records, balance trees, make records contiguous, etc.?

IIRC databases tend to become less efficient over time with lots of modifying

theducks · 09-08-2016, 11:22 AM

Quote:

Originally Posted by phossler

Under [Library Maintenance] you can [Check the Library] which finds errors, but I was wondering if it's ever necessary to 're-build' (not sure what the correct term is) the database to reclaim space from deleted records, balance trees, make records contiguous, etc.?

IIRC databases tend to become less efficient over time with lots of modifying

That is there for when the DB gets damaged beyond a simple corrective action in the check

kovidgoyal · 09-08-2016, 11:53 AM

Check library automatically vacuums the database, which should be all that is needed to keep it operating well.

phossler · 09-08-2016, 12:43 PM

Quote:

Originally Posted by kovidgoyal

Check library automatically vacuums the database, which should be all that is needed to keep it operating well.

Thanks

Any thoughts on how often or when to run Check Library? (once a week, once a month, when there's a problem, ...?)

My library is very small (400+ books) and I've never had any issues that it couldn't easily fix (like extra files).

Never had any structure problems, but I did upgrade a number of books with a more enhanced release, and add a bunch more, so that got me wondering.

Maybe a reminder: "Library last checked 7/1/2015, 456 days ago"?

BetterRed · 09-08-2016, 06:35 PM

@phossler - I run it once a week, before I do my weekly backup.

My libraries are larger (biggest is ~90,000 'books') and probably busier than yours.

I occasionally get errors (rarely more than one or two) in the third stage, but because it must have happened since last week I can always attribute to something outside of calibre - e.g. the video adapter failing, me unzipping a cbz to a subfolder and forgetting to delete the subfolder, the UPS not kicking in on a power fail.

BR

eschwartz · 09-08-2016, 08:23 PM

For fun, I tried the calibredb check_library command -- it didn't say anything about vacuuming the database though. (The GUI does mention it.)
Is it still happening, and if so should there be feedback about that?

kovidgoyal · 09-08-2016, 09:34 PM

Personally, I never run Check Library. I have noticed no significant performance degradation on my main library of a few thousand books over nearly a decade of continuous use.

(My test library which I use to develop calibre is of course a different matter)

@eschwartz, IIRC the CLI check_library does not run vacuum, though I'd have to check the source to be sure.

09-08-2016, 11:11 AM	#1
phossler Wizard Posts: 1,085 Karma: 412718 Join Date: Jan 2009 Location: Valley Forge, PA, USA Device: Kindle Paperwhite	Is Library Rebuild Necessary? Under [Library Maintenance] you can [Check the Library] which finds errors, but I was wondering if it's ever necessary to 're-build' (not sure what the correct term is) the database to reclaim space from deleted records, balance trees, make records contiguous, etc.? IIRC databases tend to become less efficient over time with lots of modifying

09-08-2016, 08:23 PM	#6
eschwartz Ex-Helpdesk Junkie Posts: 19,421 Karma: 85397180 Join Date: Nov 2012 Location: The Beaten Path, USA, Roundworld, This Side of Infinity Device: Kindle Touch fw5.3.7 (Wifi only)	For fun, I tried the calibredb check_library command -- it didn't say anything about vacuuming the database though. (The GUI does mention it.) Is it still happening, and if so should there be feedback about that? Last edited by eschwartz; 09-08-2016 at 08:25 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Empty/reset of FBReader library database, and constraining the rebuild?	AlanRoberts	Devices	5	09-24-2015 07:08 PM
Library crash - unable to rebuild	Ellachanted	Calibre	60	08-25-2015 07:43 AM
Rebuild library on PC from device?	CrankYanker	Library Management	2	04-22-2013 12:27 AM
Any way to rebuild meta data for library?	JeremyR	Library Management	2	07-08-2011 05:35 AM
Thumbnails, how to rebuild Library and get PDF thumbs for old uploads?	rakista	enTourage Archive	2	12-21-2010 10:29 AM

09-08-2016, 11:53 AM	#3
kovidgoyal creator of calibre Posts: 44,337 Karma: 23661992 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Check library automatically vacuums the database, which should be all that is needed to keep it operating well.

09-08-2016, 06:35 PM	#5
BetterRed null operator (he/him) Posts: 20,934 Karma: 27620688 Join Date: Mar 2012 Location: Sydney Australia Device: none	@phossler - I run it once a week, before I do my weekly backup. My libraries are larger (biggest is ~90,000 'books') and probably busier than yours. I occasionally get errors (rarely more than one or two) in the third stage, but because it must have happened since last week I can always attribute to something outside of calibre - e.g. the video adapter failing, me unzipping a cbz to a subfolder and forgetting to delete the subfolder, the UPS not kicking in on a power fail. BR

09-08-2016, 09:34 PM	#7
kovidgoyal creator of calibre Posts: 44,337 Karma: 23661992 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Personally, I never run Check Library. I have noticed no significant performance degradation on my main library of a few thousand books over nearly a decade of continuous use. (My test library which I use to develop calibre is of course a different matter) @eschwartz, IIRC the CLI check_library does not run vacuum, though I'd have to check the source to be sure.

Advert

Advert