Calibre startup on Pogoplug with large library problems

Moktarino · 05-11-2012, 05:25 PM

Howdy folks,

I got a Pogoplug on a deal site (basically a 1.2ghz/256mb linux device) and got Calibre running nicely with a very small (5-book) library behind an Apache reverse proxy (for SSL).

I then proceeded to attach my library (15k/~40gb), but I can't get it to start the content server properly, something I believe is due to the initial cover caching.

I think this because I ran it with --max-cover=1x1 and it only took ~2hrs to start and successfully served books at that point, albeit with no covers.

At first it would crash reporting "out of memory", so I added a 512mb swapfile and that went away. Now it uses 50%+ CPU for 2-3 hours then lays quiet, but I still can't get the page to come up. I am presented with the HTTP login, but after entering my credentials it waits until it times out.

Barring eliminating covers or using a different content server, how can I get this running?

Thanks!

kovidgoyal · 05-11-2012, 11:30 PM

covers are not cached in the server. Every request causes them to be re-read. You will have a tough time getting that alrge a library served with 256MB of RAM, since the calibre content server loads all metadata into RAM.

Moktarino · 05-12-2012, 12:16 AM

Hmm, Ok. I'll see what I can do.

05-11-2012, 05:25 PM	#1
Moktarino Junior Member Posts: 3 Karma: 10 Join Date: Dec 2010 Device: PRS-350SC	Calibre startup on Pogoplug with large library problems Howdy folks, I got a Pogoplug on a deal site (basically a 1.2ghz/256mb linux device) and got Calibre running nicely with a very small (5-book) library behind an Apache reverse proxy (for SSL). I then proceeded to attach my library (15k/~40gb), but I can't get it to start the content server properly, something I believe is due to the initial cover caching. I think this because I ran it with --max-cover=1x1 and it only took ~2hrs to start and successfully served books at that point, albeit with no covers. At first it would crash reporting "out of memory", so I added a 512mb swapfile and that went away. Now it uses 50%+ CPU for 2-3 hours then lays quiet, but I still can't get the page to come up. I am presented with the HTTP login, but after entering my credentials it waits until it times out. Barring eliminating covers or using a different content server, how can I get this running? Thanks!

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Problems with Calibre Startup	vaksam	Calibre	8	01-30-2011 04:13 PM
Kindle and Calibre user with problem importing large library into Calibre	pleabargain	Calibre	1	12-07-2010 10:19 AM
Kindle 3 + Calibre + PogoPlug = Works!!!	daffy4u	Amazon Kindle	33	11-02-2010 02:14 AM
Large library/calibre interface	StanByk	Calibre	12	10-19-2009 10:20 AM
How large is your Calibre library?	radius	Calibre	28	10-12-2009 01:14 AM

05-11-2012, 11:30 PM	#2
kovidgoyal creator of calibre Posts: 43,910 Karma: 22669818 Join Date: Oct 2006 Location: Mumbai, India Device: Various	covers are not cached in the server. Every request causes them to be re-read. You will have a tough time getting that alrge a library served with 256MB of RAM, since the calibre content server loads all metadata into RAM.

05-12-2012, 12:16 AM	#3
Moktarino Junior Member Posts: 3 Karma: 10 Join Date: Dec 2010 Device: PRS-350SC	Hmm, Ok. I'll see what I can do.

Advert