Size limit on Calibre libraries?

chookie2 · 07-26-2015, 02:48 AM

Can anyone tell me what the size limit is on Calibre Libraries please. I have 12,500 books in my library and it is telling me it is out of space and has become slow at conversions too.Do I need to set up a second library at 10,000 books to get the best from Calibre do you think?

I keep a backup book set on an external drive and have no problems with that one.
Thanks for sharing.:

Ethanaul · 07-26-2015, 04:37 AM

I've more than 30k books and Calibre works well. My metadata.db weight is 55MB. I think the trouble comes from your computer itself.

You may use the database utilities (Library maintenance) to check it

BetterRed · 07-26-2015, 05:56 AM

@chookie2 - what tells you its out of space, can you post the details of the message, and when do you get the message. And what Operating system and calibre version

My Main library is 69,000 books, database is 25MB, disk space used 50GB.
My Media library is 8,000 books, database is 7MB, disk space used is 670GB

BR

theducks · 07-26-2015, 11:04 AM

Quote:

Originally Posted by chookie2

Can anyone tell me what the size limit is on Calibre Libraries please. I have 12,500 books in my library and it is telling me it is out of space and has become slow at conversions too.Do I need to set up a second library at 10,000 books to get the best from Calibre do you think?

I keep a backup book set on an external drive and have no problems with that one.
Thanks for sharing.:

The other 2 answers are

Installed Calibre version?

Tell us about your computer.
OS
Processor
RAM
Hard drive (and Partitions if split)

Don't say (against the advice in the FAQ) that you are using a NAS/Share on another system

chookie2 · 07-27-2015, 01:45 AM

Thanks to you all.OS is Windows 7Pro. 3 TB harddrive. Calibre 2.33.0 installed & it is using 81.5 gig on drive E.
I think I have narrowed it down to a glitch in the way my computer drives are partitioned. Windows seems to be taking up most of C drive. I am just deleting all MS Windows updates over 3 years old and it seems to be allowing me more space as I do it. (not sure how far it is safe to go back in deleting updates though???) I am not a techie at all at all.
My C drive has only 3 gig spare of 55 gig on it despite me moving most files to E drive which has 1TB left of 2TB on it. My external drive is a 1Tb drive and has plenty of space for book backup files so I am guessing it is not Calibre as you all seem to be saying. I have added more books to Calibre today since I deleted some old 2011 MS updates and no problems....so there ya go. Will keep deleting updates into 2013 and see how I go.Thanks for sharing everyone.

BetterRed · 07-27-2015, 03:11 AM

@Chookie2 - the best and safest way to clean up your C drive is to use the Disk Cleanup tool that comes with Windows see ==>> Delete files using Disk Cleanup - Windows Help

You need to click the arrow next to "To clean up all files on the computer" to get the full story

BR

cybmole · 07-27-2015, 04:58 AM

Nvidia also leaves copies of every driver update behind. Consult google if you use nvidia graphics for cleaning advice. Maybe several Gb wasted. Check page file and hibernation settings also.

http://forums.evga.com/Safe-to-delet...-m1677230.aspx

if you need more help, ask quickly before the off-topic police move in on us

PeterT · 07-27-2015, 06:09 AM

You might want to change where calibre creates temporary files during conversion. See Customizing calibre | Environment variables and look at CALIBRE_TEMP_DIR. By default calibre uses the %TEMP% / %TMP% settings and this will be pointing to C: Try overriding this to point to a location on your E: drive.

theducks · 07-27-2015, 10:08 AM

And there is More (tips)!

Get a GPARTED or Linux Live CD and adjust the (LIVE) partitions size

Backups are strongly advised. Defrag prior to the run.

chookie2 · 07-27-2015, 07:47 PM

Thank you to all,Great help and tips in there.Not sure I am up to altering things at such an advanced level but will check what I can find. Thanks again.

IanD · 07-30-2015, 04:15 AM

A couple of tools that I turn to when looking to free space: TreeSizeFree, SpaceMonger

Other things to consider:
- Clear out your temp folder(s). Type %TMP% into a documents window and delete everything you can.
- Clean out your internet browsing history. A temporary fix, but it might help.
- If you use Firefox / Thunderbird, consider moving their profile folders.
- Consider moving your Windows "Documents" folder to another drive. I tend to move my Firefox profile into the Documents folder as well. That way my backups contain everything.
- The note above about removing NVIDIA junk is a good one.
- Do you have several people using your PC? If so you might have several user profiles, all with their own desktops and documents folders. You could remove the profiles, or move their documents folders as well.
- As well as the Windows tool there are several 3rd party disk cleanup tools you might have a play with. CCleaner has a good reputation. It can automate several of the above steps for you. Make sure you do a good backup first though!

LadyKate · 07-31-2015, 09:25 PM

If I was having a space problem I would change the drive I was using. I find it unadvisable to use the system boot drive for anything that is going to grow to a large size (one of my calibre libraries has almost 150,000 items).

Removing the backup files etc from windows or your drivers will not result in that much space. A few more books will soon fill it.

Calibre works perfectly fine when the library is on a usb removable hard drive. That may be your best solution.

07-26-2015, 02:48 AM	#1
chookie2 Connoisseur Posts: 91 Karma: 648694 Join Date: Sep 2014 Device: ipad mc7 16gig	Size limit on Calibre libraries? Can anyone tell me what the size limit is on Calibre Libraries please. I have 12,500 books in my library and it is telling me it is out of space and has become slow at conversions too.Do I need to set up a second library at 10,000 books to get the best from Calibre do you think? I keep a backup book set on an external drive and have no problems with that one. Thanks for sharing.:

07-27-2015, 04:58 AM	#7
cybmole Wizard Posts: 3,720 Karma: 1759970 Join Date: Sep 2010 Device: none	Nvidia also leaves copies of every driver update behind. Consult google if you use nvidia graphics for cleaning advice. Maybe several Gb wasted. Check page file and hibernation settings also. http://forums.evga.com/Safe-to-delet...-m1677230.aspx if you need more help, ask quickly before the off-topic police move in on us Last edited by cybmole; 07-27-2015 at 05:01 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Limit to font size?	dandelioncottage	Marvin	0	11-08-2014 12:03 PM
Limit on post size ?	unboggling	Feedback	18	10-19-2012 05:55 PM
SD Card-Size Limit?	hilaryfrompa	enTourage eDGe	8	01-15-2012 01:46 PM
Size limit on PDFs?	tench	Sony Reader	4	06-24-2009 06:48 PM
PDF size limit	sic	Sony Reader	14	07-15-2007 04:50 AM

07-26-2015, 04:37 AM	#2
Ethanaul Member Posts: 21 Karma: 13118 Join Date: Feb 2013 Device: Kobo Glo	I've more than 30k books and Calibre works well. My metadata.db weight is 55MB. I think the trouble comes from your computer itself. You may use the database utilities (Library maintenance) to check it

07-26-2015, 05:56 AM	#3
BetterRed null operator (he/him) Posts: 21,718 Karma: 29711016 Join Date: Mar 2012 Location: Sydney Australia Device: none	@chookie2 - what tells you its out of space, can you post the details of the message, and when do you get the message. And what Operating system and calibre version My Main library is 69,000 books, database is 25MB, disk space used 50GB. My Media library is 8,000 books, database is 7MB, disk space used is 670GB BR

07-27-2015, 01:45 AM	#5
chookie2 Connoisseur Posts: 91 Karma: 648694 Join Date: Sep 2014 Device: ipad mc7 16gig	Thanks to you all.OS is Windows 7Pro. 3 TB harddrive. Calibre 2.33.0 installed & it is using 81.5 gig on drive E. I think I have narrowed it down to a glitch in the way my computer drives are partitioned. Windows seems to be taking up most of C drive. I am just deleting all MS Windows updates over 3 years old and it seems to be allowing me more space as I do it. (not sure how far it is safe to go back in deleting updates though???) I am not a techie at all at all. My C drive has only 3 gig spare of 55 gig on it despite me moving most files to E drive which has 1TB left of 2TB on it. My external drive is a 1Tb drive and has plenty of space for book backup files so I am guessing it is not Calibre as you all seem to be saying. I have added more books to Calibre today since I deleted some old 2011 MS updates and no problems....so there ya go. Will keep deleting updates into 2013 and see how I go.Thanks for sharing everyone.

07-27-2015, 03:11 AM	#6
BetterRed null operator (he/him) Posts: 21,718 Karma: 29711016 Join Date: Mar 2012 Location: Sydney Australia Device: none	@Chookie2 - the best and safest way to clean up your C drive is to use the Disk Cleanup tool that comes with Windows see ==>> Delete files using Disk Cleanup - Windows Help You need to click the arrow next to "To clean up all files on the computer" to get the full story BR

07-27-2015, 06:09 AM	#8
PeterT Grand Sorcerer Posts: 13,507 Karma: 78910112 Join Date: Nov 2007 Location: Toronto Device: Libra H2O, Libra Colour	You might want to change where calibre creates temporary files during conversion. See Customizing calibre \| Environment variables and look at CALIBRE_TEMP_DIR. By default calibre uses the %TEMP% / %TMP% settings and this will be pointing to C: Try overriding this to point to a location on your E: drive.

07-27-2015, 10:08 AM	#9
theducks Well trained by Cats Posts: 31,047 Karma: 60358908 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	And there is More (tips)! Get a GPARTED or Linux Live CD and adjust the (LIVE) partitions size Backups are strongly advised. Defrag prior to the run.

07-27-2015, 07:47 PM	#10
chookie2 Connoisseur Posts: 91 Karma: 648694 Join Date: Sep 2014 Device: ipad mc7 16gig	Thank you to all,Great help and tips in there.Not sure I am up to altering things at such an advanced level but will check what I can find. Thanks again.

07-30-2015, 04:15 AM	#11
IanD Enthusiast Posts: 48 Karma: 275602 Join Date: Jul 2015 Location: York, UK Device: Glo HD, PW2	A couple of tools that I turn to when looking to free space: TreeSizeFree, SpaceMonger Other things to consider: - Clear out your temp folder(s). Type %TMP% into a documents window and delete everything you can. - Clean out your internet browsing history. A temporary fix, but it might help. - If you use Firefox / Thunderbird, consider moving their profile folders. - Consider moving your Windows "Documents" folder to another drive. I tend to move my Firefox profile into the Documents folder as well. That way my backups contain everything. - The note above about removing NVIDIA junk is a good one. - Do you have several people using your PC? If so you might have several user profiles, all with their own desktops and documents folders. You could remove the profiles, or move their documents folders as well. - As well as the Windows tool there are several 3rd party disk cleanup tools you might have a play with. CCleaner has a good reputation. It can automate several of the above steps for you. Make sure you do a good backup first though!

07-31-2015, 09:25 PM	#12
LadyKate Fanatic Posts: 515 Karma: 1470724 Join Date: Jul 2013 Location: Quebec CA Device: android 4 (samsung tablet and asus tablet)	If I was having a space problem I would change the drive I was using. I find it unadvisable to use the system boot drive for anything that is going to grow to a large size (one of my calibre libraries has almost 150,000 items). Removing the backup files etc from windows or your drivers will not result in that much space. A few more books will soon fill it. Calibre works perfectly fine when the library is on a usb removable hard drive. That may be your best solution.

Advert

Advert