[Old Thread] Large collection problem

oventura · 05-06-2012, 12:17 PM

I have a problem with a large collection. It has 20.000 books and it takes about 6 minutes to open Calibre.
Any idea of how to speed it up?

HarryT · 05-06-2012, 12:24 PM

You could split your books into several smaller libraries - perhaps by genre?

PeterT · 05-06-2012, 12:48 PM

Any custom columns defined that might need a scan of all books in the library?

theducks · 05-06-2012, 12:56 PM

Quote:

Originally Posted by PeterT

Any custom columns defined that might need a scan of all books in the library?

Calculated columns and/or colored fields have to be processed.

I don't think a custom (static value) columns adds (much) to the start time

JohnnyBook · 05-07-2012, 10:42 AM

I also have a large collection.... Mine does not take 6 minutes to load... but is does take a minute or two. Its annoying seeing the white screen with "Calibre (NOT RESPONDING) at the top of the page while all the books are loaded (or indexed or whatever)

Any chance of getting a progress bar or counter of some kind displayed instead?

GoSharks · 05-07-2012, 11:42 AM

Quote:

Originally Posted by oventura

I have a problem with a large collection. It has 20.000 books and it takes about 6 minutes to open Calibre.
Any idea of how to speed it up?

WOW...the San Francisco library doesn't have 20,000 e-books!!! You definitely win the "mine's bigger" competition. Taking on The Library of Congress next?!

cybmole · 05-08-2012, 01:22 AM

I'm suprised that someone who can afford 20,000 ebooks doesn't just buy a faster PC, with SSD

PeterT · 05-08-2012, 01:38 AM

See this thread --> https://www.mobileread.com/forums/showthread.php?t=81077

Quote:

Yep. Just imported 31222 books, total size 11GB. That took a day (literally; it took almost 24 hours), but version 0.6.49 now starts up in 1,5 minutes and searches take < 2 sec.

Zetmolm · 05-08-2012, 06:52 AM

Quote:

Originally Posted by cybmole

I'm suprised that someone who can afford 20,000 ebooks doesn't just buy a faster PC, with SSD

Everyone can affors 20,000 books, and lots more. There is enough free stuff available that is worth reading.

cybmole · 05-08-2012, 09:44 AM

Quote:

Originally Posted by Zetmolm

Everyone can affors 20,000 books, and lots more. There is enough free stuff available that is worth reading.

ah - well let's hear it for kleptomania

- if you read one whole e-book every day then to read 20,000 will take... er....close on 60 years

but hey if you need to brag about the size of your

collection

then go for it :-)

mbovenka · 05-08-2012, 09:59 AM

Quote:

Originally Posted by cybmole

ah - well let's hear it for kleptomania

If they're free, it's not kleptomania, as you're not stealing anything. It might be a form of bibliomania, though.

jbcohen · 05-08-2012, 10:03 AM

I will take a stab at this however, I would like to invite other members to correct me in any way if I am not correct. I believe that the way Calibre does its cataloging is via Random Access Memory or ROM for short. If you were to add aditional memory to the computer that you are working with that would no doubt speed things up quite a bit.

theducks · 05-08-2012, 10:53 AM

Quote:

Originally Posted by cybmole

I'm suprised that someone who can afford 20,000 ebooks doesn't just buy a faster PC, with SSD

Project Gutengerg has lots of books.

The (now, really old) Science fiction disk has thousands for the price of a download and CD blank.

I only extracted the ones I wanted to have to my Calibre Library... But different strokes.

DuskyRose · 05-08-2012, 12:18 PM

Quote:

Originally Posted by theducks

Project Gutengerg has lots of books.

The (now, really old) Science fiction disk has thousands for the price of a download and CD blank.

I only extracted the ones I wanted to have to my Calibre Library... But different strokes.

Freebies from Gutenberg, Freebies from Baen, various freebies from various publishers, about 300 free ebooks a day posted at Amazon, every day since about three week before Christmas (some duplicates, mostly new) and fan fiction sites with thousands and thousands of fanfic titles on just about anything out there (made a lot easier with the fanfic plugin)....

Then the ones I buy...

So, yeah, 20,000 or more are easy to build up. I've got almost 27,000 files. And while I plan on working my way through the stuff I buy, the rest are just mind candy even if they're just sitting there right now. Some stories may be crap, some may be interesting, some may be the best things I ever read. But since they're free, and very, very small, I'll take the chance on finding out sometime in the future. I've found that you never know where that next jewel will come from.

And if I don't get to all of them? So what? They're very, very small, and free.

Don't like something? Delete it. Plenty more to test out.

cybmole · 05-08-2012, 02:22 PM

when you launch calibre - what % CPU Is being used? I wonder if the limiting factor is CPU or disc I/O speed.
if the latter, then having all book on a solid state disc could make quite a difference ?...
if the former then a quad processor or better would be needed to speed things up. If anyone out here has both a large library and an i7 processor, maybe they could comment...

also, defrag the drive with all the books on & see what difference that makes.

launch with task manager running & you'll see both RAM & CPU usage as the library loads ( since an earlier post suggested RAM as a factor)

05-06-2012, 12:17 PM	#1
oventura Junior Member Posts: 6 Karma: 10 Join Date: Feb 2012 Device: Sony PRS-T1	[Old Thread] Large collection problem I have a problem with a large collection. It has 20.000 books and it takes about 6 minutes to open Calibre. Any idea of how to speed it up?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Tips for managing a large collection?	ficbot	Reading and Management	23	03-13-2010 02:11 AM
6.11 problem with adding large book collection	acekyoto	Calibre	25	10-01-2009 12:25 PM
Large free ebook collection	tech_au	Deals and Resources (No Self-Promotion or Affiliate Links)	1	12-05-2008 08:47 AM
Have large collection of LIT files, Which reader to choose?	palex481	Which one should I buy?	8	05-08-2008 07:22 PM

05-06-2012, 12:24 PM	#2
HarryT eBook Enthusiast Posts: 85,544 Karma: 93383099 Join Date: Nov 2006 Location: UK Device: Kindle Oasis 2, iPad Pro 10.5", iPhone 6	You could split your books into several smaller libraries - perhaps by genre?

05-06-2012, 12:48 PM	#3
PeterT Grand Sorcerer Posts: 13,511 Karma: 78910202 Join Date: Nov 2007 Location: Toronto Device: Libra H2O, Libra Colour	Any custom columns defined that might need a scan of all books in the library?

05-07-2012, 10:42 AM	#5
JohnnyBook Groupie Posts: 196 Karma: 126824 Join Date: Dec 2008 Location: Out There Device: K3 W/3G (Fixed screen!) & Paperwhite Wifi	I also have a large collection.... Mine does not take 6 minutes to load... but is does take a minute or two. Its annoying seeing the white screen with "Calibre (NOT RESPONDING) at the top of the page while all the books are loaded (or indexed or whatever) Any chance of getting a progress bar or counter of some kind displayed instead?

05-08-2012, 01:22 AM	#7
cybmole Wizard Posts: 3,720 Karma: 1759970 Join Date: Sep 2010 Device: none	I'm suprised that someone who can afford 20,000 ebooks doesn't just buy a faster PC, with SSD

05-08-2012, 10:03 AM	#12
jbcohen Wizard Posts: 3,032 Karma: 11196738 Join Date: Oct 2010 Location: Where am I? Device: Kindle Paperwhite Signature edition and a Samsung S24 Ultra	I will take a stab at this however, I would like to invite other members to correct me in any way if I am not correct. I believe that the way Calibre does its cataloging is via Random Access Memory or ROM for short. If you were to add aditional memory to the computer that you are working with that would no doubt speed things up quite a bit.

05-08-2012, 02:22 PM	#15
cybmole Wizard Posts: 3,720 Karma: 1759970 Join Date: Sep 2010 Device: none	when you launch calibre - what % CPU Is being used? I wonder if the limiting factor is CPU or disc I/O speed. if the latter, then having all book on a solid state disc could make quite a difference ?... if the former then a quad processor or better would be needed to speed things up. If anyone out here has both a large library and an i7 processor, maybe they could comment... also, defrag the drive with all the books on & see what difference that makes. launch with task manager running & you'll see both RAM & CPU usage as the library loads ( since an earlier post suggested RAM as a factor)

Advert

Advert