Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 01-25-2013, 08:14 AM   #1
crazyfrank
Member
crazyfrank began at the beginning.
 
Posts: 12
Karma: 10
Join Date: Jan 2013
Device: ipad
Smile libraries multiple vs single?

hi there...new to board and cant find the answer to the following question.
ill use 50,000 books as a example.
is the any + or - to having 1 large library of 50,000 books or 10 libraries of 5000 books sorted by format??
thx for your help. love calibre.
crazyfrank is offline   Reply With Quote
Old 01-25-2013, 09:26 AM   #2
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,164
Karma: 1619681
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura HD
Quote:
Originally Posted by crazyfrank View Post
hi there...new to board and cant find the answer to the following question.
ill use 50,000 books as a example.
is the any + or - to having 1 large library of 50,000 books or 10 libraries of 5000 books sorted by format??
thx for your help. love calibre.
The performance will drop as the number of books goes up. But that comes into play only when the number of books runs in the tens of thousands. Calibre will handle a 50K library fine on a modern(ish) PC.
mbovenka is offline   Reply With Quote
Old 01-25-2013, 09:39 AM   #3
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 14,523
Karma: 5567087
Join Date: Aug 2009
Location: The (original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
Quote:
Originally Posted by crazyfrank View Post
hi there...new to board and cant find the answer to the following question.
ill use 50,000 books as a example.
is the any + or - to having 1 large library of 50,000 books or 10 libraries of 5000 books sorted by format??
thx for your help. love calibre.
Splitting by Format make poor sense in most cases. What if you have 2 formats of a SINGLE title? They are now separated and the metadata is also.

If you must split, Pick something that clearly is separate and will not be needed at the same time (usually things, like a Dictionary): Fiction vs Non-Fiction. Cookbooks?
theducks is offline   Reply With Quote
Old 01-25-2013, 09:52 AM   #4
Adoby
Handy Elephant
Adoby ought to be getting tired of karma fortunes by now.Adoby ought to be getting tired of karma fortunes by now.Adoby ought to be getting tired of karma fortunes by now.Adoby ought to be getting tired of karma fortunes by now.Adoby ought to be getting tired of karma fortunes by now.Adoby ought to be getting tired of karma fortunes by now.Adoby ought to be getting tired of karma fortunes by now.Adoby ought to be getting tired of karma fortunes by now.Adoby ought to be getting tired of karma fortunes by now.Adoby ought to be getting tired of karma fortunes by now.Adoby ought to be getting tired of karma fortunes by now.
 
Adoby's Avatar
 
Posts: 1,046
Karma: 3824376
Join Date: Dec 2009
Location: Southern Sweden, far out in the quiet woods
Device: Ubuntu Linux, Cybook Opus, Motorola Xoom with Mantano Premium
It is a bit unclear if you intend to split the libraries so each library only contain one format, or if you intend to split using some other criteria, and sort on formats in the separate libraries. Here I assume the latter.

To have books sorted by format is quite expensive. It typically means that when opening or switching library, Calibre starts checking every book in every book folder to see what formats there are for each book. This can be VERY time consuming. I don't think it matters much if the library is split or not. It will be faster to open a smaller library, but most likely you will switch often, so you still end up just as annoyed.

A better approach might be to convert books so you don't need to keep track of the formats. The main problem is PDFs. Typically it is hard to automatically convert a PDF to any other format. I have ended up converting everything to ePub, or keeping it as PDF. Since my main ereader, Mantano, handles both ePubs and PDFs, this works out great.

Another way to speed up sorting of books by format is to change how the sorting is done. The slow default way is to sort using a custom column that holds a value that is created by checking each book. This is slow but safe.

A faster way is to change the sort to use information already stored in the database, about the formats that are available. This is much faster, but not as safe. There is no check to see if every book actually still is there. If there was some problem with the actual books stored in the library, you may not discover that until it is too late to do anything about it.

You can read more about this here:

http://www.mobileread.com/forums/sho...45#post2244745

Last edited by Adoby; 01-25-2013 at 10:05 AM.
Adoby is offline   Reply With Quote
Old 01-25-2013, 10:06 AM   #5
Sabardeyn
Guru
Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.
 
Sabardeyn's Avatar
 
Posts: 629
Karma: 1242364
Join Date: May 2009
Location: The Right Coast
Device: PC (Calibre), Nexus 7 2013 (Moon+ Pro), HTC HD2/Leo (Freda)
There are several comments in these forums that displaying Format leads to a noticeable performance decrease. This is somewhat compounded by having a large number of ebook records.

If you don't want to have a single large Library with all of your books, then splitting the Library by genre would be best. You're used to going into a bookstore or public library and having books separated in this manner.
Sabardeyn is offline   Reply With Quote
Old 01-25-2013, 04:04 PM   #6
Zetmolm
Evangelist
Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.
 
Posts: 476
Karma: 950180
Join Date: Jan 2010
Device: Onyx Boox 60, PocketBook Touch
Just to put things in perspective: I have a 4-year-old PC (closer to low-end than high-end), I have a library of 35,000 books, and I display formats. Performance of Calibre may not be fast as lightning, but it is acceptable by all means. Calibre starts up in about half a minute.
Zetmolm is offline   Reply With Quote
Old 01-26-2013, 08:25 AM   #7
crazyfrank
Member
crazyfrank began at the beginning.
 
Posts: 12
Karma: 10
Join Date: Jan 2013
Device: ipad
Smile

thanks for the quick reply. i have the answers im looking for.
crazyfrank is offline   Reply With Quote
Old 01-26-2013, 07:16 PM   #8
Giuseppe Chillem
Zealot
Giuseppe Chillem doesn't litterGiuseppe Chillem doesn't litter
 
Giuseppe Chillem's Avatar
 
Posts: 135
Karma: 134
Join Date: May 2010
Device: IREX DR1000
Quote:
Originally Posted by crazyfrank View Post
hi there...new to board and cant find the answer to the following question.
ill use 50,000 books as a example.
is the any + or - to having 1 large library of 50,000 books or 10 libraries of 5000 books sorted by format??
thx for your help. love calibre.
I have a dual processor, dual core each and 16GB of RAM.

My collection has rised to 70.000 books.

Calibre is a bit slow in this situation. Searching takes long time. But you will find it really slow when you modify fields like name or author. You could wait up to 10 second before the fields become editable after you click on it.

Personally I suggest to split the library by big topics: "Fiction", "Religion/history/arts", "Programming/Informatics", science "Mathematics/Phisics".

This would led to smaller and more manegeable libraries.

Also don't forget the "corruption factor". If the application crashes while modifying the library, a power loss happen, or if a phisical hard drive sectors failure accurs and the library is damaged as result you should rebuild the calibre library. It has happened to me and it took over 24 hours to rebuild it.

All I have written comes from real usage scenario and experience.

Last edited by Giuseppe Chillem; 01-26-2013 at 07:18 PM.
Giuseppe Chillem is offline   Reply With Quote
Old 01-26-2013, 07:55 PM   #9
Sydney's Mom
I Bleed Cubby Blue
Sydney's Mom ought to be getting tired of karma fortunes by now.Sydney's Mom ought to be getting tired of karma fortunes by now.Sydney's Mom ought to be getting tired of karma fortunes by now.Sydney's Mom ought to be getting tired of karma fortunes by now.Sydney's Mom ought to be getting tired of karma fortunes by now.Sydney's Mom ought to be getting tired of karma fortunes by now.Sydney's Mom ought to be getting tired of karma fortunes by now.Sydney's Mom ought to be getting tired of karma fortunes by now.Sydney's Mom ought to be getting tired of karma fortunes by now.Sydney's Mom ought to be getting tired of karma fortunes by now.Sydney's Mom ought to be getting tired of karma fortunes by now.
 
Sydney's Mom's Avatar
 
Posts: 2,462
Karma: 5258569
Join Date: Dec 2008
Location: Chicago
Device: Kindle PW2, Fire HDX and Samsung Tab 2 and Note 8
I have about 6k books in my library. Calibre handled them just fine, but I ran out of space on Dropbox. So I copied all 2010 books into a library called 2010 Books, not linked to Dropbox but backed up, and then removed the formats, but not the listing, in my main Calibre library. That way I only have to look one place to see if I have or have read the book, although I may have to go to 2008, 2009 or 2010 to get the book.
Sydney's Mom is offline   Reply With Quote
Old 01-27-2013, 01:07 AM   #10
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 8,811
Karma: 12535517
Join Date: Feb 2009
Location: North Carolina
Device: Nexus 7
Quote:
Originally Posted by Giuseppe Chillem View Post
My collection has rised to 70.000 books.

Calibre is a bit slow in this situation. Searching takes long time. But you will find it really slow when you modify fields like name or author. You could wait up to 10 second before the fields become editable after you click on it.

Personally I suggest to split the library by big topics: "Fiction", "Religion/history/arts", "Programming/Informatics", science "Mathematics/Phisics".
Does using the Restrict to feature to restrict the library to one Genre have a positive effect on speed?
DoctorOhh is online now   Reply With Quote
Old 01-27-2013, 09:54 AM   #11
Giuseppe Chillem
Zealot
Giuseppe Chillem doesn't litterGiuseppe Chillem doesn't litter
 
Giuseppe Chillem's Avatar
 
Posts: 135
Karma: 134
Join Date: May 2010
Device: IREX DR1000
Quote:
Originally Posted by DoctorOhh View Post
Does using the Restrict to feature to restrict the library to one Genre have a positive effect on speed?
Where do I find this option ?
Giuseppe Chillem is offline   Reply With Quote
Old 01-27-2013, 11:14 AM   #12
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 14,523
Karma: 5567087
Join Date: Aug 2009
Location: The (original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
Quote:
Originally Posted by Giuseppe Chillem View Post
Where do I find this option ?
Upper right corner.
It makes use of a Saved Search (created in upper Left corner)
theducks is offline   Reply With Quote
Old 01-27-2013, 02:49 PM   #13
Sabardeyn
Guru
Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.Sabardeyn ought to be getting tired of karma fortunes by now.
 
Sabardeyn's Avatar
 
Posts: 629
Karma: 1242364
Join Date: May 2009
Location: The Right Coast
Device: PC (Calibre), Nexus 7 2013 (Moon+ Pro), HTC HD2/Leo (Freda)
Correction: The Restrict To button, usually grayed-out, is on the far left, on the same line as the Search field. It appears underneath the Add Books icon and above the Tag Browser's Find Tag field. At least this is the case on my visually non-modified system.

Perhaps theducks' window is different due to a theme or some kind of visual customization?

Restrict To works with saved searches. I had to ask about this myself and did so in the following topic: Way to Hide Search Bar, from message #6 onward. (The original topic itself is about something completely different; the part about Restrict To only occurs from my question and onward.)

Last edited by Sabardeyn; 01-27-2013 at 02:52 PM.
Sabardeyn is offline   Reply With Quote
Old 01-27-2013, 03:55 PM   #14
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 14,523
Karma: 5567087
Join Date: Aug 2009
Location: The (original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
Quote:
Originally Posted by Sabardeyn View Post
Correction: The Restrict To button, usually grayed-out, is on the far left, on the same line as the Search field. It appears underneath the Add Books icon and above the Tag Browser's Find Tag field. At least this is the case on my visually non-modified system.

Perhaps theducks' window is different due to a theme or some kind of visual customization?

Restrict To works with saved searches. I had to ask about this myself and did so in the following topic: Way to Hide Search Bar, from message #6 onward. (The original topic itself is about something completely different; the part about Restrict To only occurs from my question and onward.)
Just my head on backwards
theducks is offline   Reply With Quote
Old 01-27-2013, 07:10 PM   #15
Giuseppe Chillem
Zealot
Giuseppe Chillem doesn't litterGiuseppe Chillem doesn't litter
 
Giuseppe Chillem's Avatar
 
Posts: 135
Karma: 134
Join Date: May 2010
Device: IREX DR1000
Hi, I have tried and the result is weird: pressing F2 to modify a field and then moving up or down takes more than 10 second. The same speed of a full library search. :-(
Giuseppe Chillem is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Multiple libraries Multiple Devices Marianne527 Library Management 2 12-03-2012 04:04 PM
How do I add a single book but from multiple directories? GoldThreader Calibre 17 12-17-2011 03:04 AM
Displaying Multiple RSS Feeds in a Single Section? commandercup Recipes 5 03-01-2011 05:34 PM
Converting multiple HTML files into a single hyperlinked PDF? Jürgen Hubert Reading and Management 6 01-11-2010 07:44 AM
How do you handle multiple stories in a single book? Sabardeyn Calibre 1 06-24-2009 02:42 PM


All times are GMT -4. The time now is 03:01 AM.


MobileRead.com is a privately owned, operated and funded community.