Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 04-22-2010, 12:47 PM   #1
mdibella
Groupie
mdibella can extract oil from cheesemdibella can extract oil from cheesemdibella can extract oil from cheesemdibella can extract oil from cheesemdibella can extract oil from cheesemdibella can extract oil from cheesemdibella can extract oil from cheesemdibella can extract oil from cheesemdibella can extract oil from cheese
 
Posts: 193
Karma: 1107
Join Date: Oct 2007
Device: Infinite Kindles, Occasional Sony's
Maximum number of books?

I had thought this would be in the FAQ but I don't see it...apologies if it is there and I just missed it.

My question: Is there a limit as to how many books can be in the Calibre library? Is there a file size limit that applies to the library?

It's awfully easy to get a large library if you have several versions of the books, so I just wondered if I'd eventually hit some size limit.
mdibella is offline   Reply With Quote
Old 04-22-2010, 01:07 PM   #2
itimpi
Wizard
itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.
 
Posts: 4,266
Karma: 901265
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
As far as I kbnow there is no built in limit. The largest library I have heard of people already having is around 30K books which is quite a large library. I personally currently have about 9K books in a wide variety of formats (averaging around 4 formats per book) - total size is around 14GB.
itimpi is offline   Reply With Quote
Old 04-22-2010, 01:20 PM   #3
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 29,369
Karma: 7472601
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
There are no limits. All that will happen as your library size grows is performance for searching/sort will decrease.
kovidgoyal is offline   Reply With Quote
Old 04-22-2010, 01:49 PM   #4
al35
Enthusiast
al35 began at the beginning.
 
Posts: 38
Karma: 10
Join Date: Aug 2008
Device: PRS505
The only limit I run into is the size of individual book. I got a memory error message when trying to add a very large audio book (~2Gb).
al35 is offline   Reply With Quote
Old 04-24-2010, 07:32 AM   #5
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,523
Karma: 6276769
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura One
Quote:
Originally Posted by itimpi View Post
As far as I kbnow there is no built in limit. The largest library I have heard of people already having is around 30K books which is quite a large library. I personally currently have about 9K books in a wide variety of formats (averaging around 4 formats per book) - total size is around 14GB.
Yep. Just imported 31222 books, total size 11GB. That took a day (literally; it took almost 24 hours), but version 0.6.49 now starts up in 1,5 minutes and searches take < 2 sec.

The older versions were completely unusable on this machine (1.5GB RAM, 1,66GHz Core2Duo T5500) with only ~20K books in them (last time I tried). Startup took more than 20 minutes and searches took minutes. This with a DB created with a humongous batchfile of 'calibredb add'-commands, as importing through the GUI...welll

Great job, Kovid!
mbovenka is online now   Reply With Quote
Old 04-26-2010, 02:15 AM   #6
osirisomeomi
Junior Member
osirisomeomi began at the beginning.
 
Posts: 6
Karma: 10
Join Date: Apr 2010
Device: Sony Reader PRS-600
Agreed, it's snappier.
osirisomeomi is offline   Reply With Quote
Old 01-24-2011, 06:56 PM   #7
relder
Junior Member
relder began at the beginning.
 
Posts: 2
Karma: 10
Join Date: Jan 2011
Device: none
I'm running into an issue where my library is 11354 ebooks, and I receive a notification that the application has stopped responding while importing. Is there a trick to the import process?
relder is offline   Reply With Quote
Old 01-24-2011, 09:26 PM   #8
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 19,393
Karma: 18898264
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: Astak Pocket Pro, K4NT,Galaxy Tab 2
Quote:
Originally Posted by relder View Post
I'm running into an issue where my library is 11354 ebooks, and I receive a notification that the application has stopped responding while importing. Is there a trick to the import process?
That may mean the child (of the import) process took longer that Windows thinks it should , Wait it out (at least a equal amount of time to that befor the message) and see if it recovers (usually does).
theducks is offline   Reply With Quote
Old 03-25-2016, 01:53 AM   #9
ninofarino
M
ninofarino began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Mar 2016
Location: London
Device: PC
Calibre 2.50 on a PC with the necessary space has been tested with over 180,000 book entries in a single library (of about 1.5 TB) , with on average 2 books per entry, with performance degrading linearly with size (when searching) as expected, but with no functionality problems when performing general library management. It is stable when moving files from one super-library to another. (a super-library, is one having over 100,000 entries. No issues have been found due to size of library, and the current version could easily exceed 200K entries. (I'll keep you posted).

Prior to 2.50 (can't remember the version exactly) the Calibre application would terminate abruptly due to out of memory issues when copying a set of randomly selected books (about 20) for a second time from a library with over 170K entries to another. This problem no longer occurs, even with the 32 bit version of calibre.

Kovid, I must congratulate you. Calibre is a 6 star application in my 5 star grading system. No one else has managed to attain 5 stars. I am happy to assist in any way, and if things go as expected, you may have yourself a benefactor.
ninofarino is offline   Reply With Quote
Old 03-25-2016, 02:28 AM   #10
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 29,369
Karma: 7472601
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Thanks Always good to hear from someone that has successfully pushed calibre's boundaries.
kovidgoyal is offline   Reply With Quote
Old 03-25-2016, 07:01 AM   #11
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,523
Karma: 6276769
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura One
Quote:
Originally Posted by kovidgoyal View Post
Thanks Always good to hear from someone that has successfully pushed calibre's boundaries.
Another data point: my library is about as large (some 185K boooks), although it's 'only' 250GB because I don't keep multiple formats. No issues, either with the portable version I keep in the library to have a self-contained backup or the 64bit version that's my main install.

The Find Duplicates plugin has reached some limit, though. If I do a Soundex Author + Soundex Title search, calibre starts eating memory until it either blows up (32bit process memory limit reached) or starts swapping my PC to death (64bit version). Using 'Fuzzy' instead of 'Soundex' works without a problem.

But that's not something you can do anything about. Calibre is the best (and best supported) program I have ever used, and I've been playing with this stuff since the early 80's (Sinclair ZX-81 FTW! )
mbovenka is online now   Reply With Quote
Old 03-25-2016, 07:17 AM   #12
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 29,369
Karma: 7472601
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
My first computer was a ZX Spectrum as well, on which I wrote my first program -- which was to generate multiplication tables, so that I had an excuse not to have to memorize them, it output the tables in color and everything
kovidgoyal is offline   Reply With Quote
Old 06-02-2016, 08:35 PM   #13
gridluck
Junior Member
gridluck began at the beginning.
 
Posts: 4
Karma: 10
Join Date: Jun 2016
Device: PC
330K books, so far already 3+ days of indexing, and still counting.. 32GB RAM, only 1.6 of is it used by calibre with 2.4% cpu, on win8.1
What is this program doing there so slow.. ? could definitely optimized for parallelism.. pleASE
gridluck is offline   Reply With Quote
Old 06-03-2016, 01:30 AM   #14
eschwartz
Ex-Helpdesk Junkie
eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.
 
eschwartz's Avatar
 
Posts: 19,119
Karma: 82937363
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
Don't add so many books at a time. calibre needs to remember them all during the adding books stage... it is much more intensive than simply holding open the database.
eschwartz is offline   Reply With Quote
Old 06-05-2016, 08:33 PM   #15
gridluck
Junior Member
gridluck began at the beginning.
 
Posts: 4
Karma: 10
Join Date: Jun 2016
Device: PC
Quote:
Originally Posted by eschwartz View Post
Don't add so many books at a time. calibre needs to remember them all during the adding books stage... it is much more intensive than simply holding open the database.
calibre is stuck at 100%, with 9% of constant CPU usage, using 2.5GB ram, and little disk activity, what is it doing now?
gridluck is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Maximum number of ebooks in Calibre? Bullwinkle Calibre 5 09-20-2010 03:13 PM
The greatest number of books on a liseuse AprilHare General Discussions 62 09-16-2010 10:27 AM
Total Number of Books in Series Coleccionista Calibre 2 08-31-2010 04:22 PM
Maximum number of books on KOBO? usern Kobo Reader 19 05-19-2010 11:08 PM
Limit to number of books in Calibre? ficbot Calibre 1 02-26-2010 08:46 AM


All times are GMT -4. The time now is 04:32 AM.


MobileRead.com is a privately owned, operated and funded community.