[Old Thread] Memory leak, Worker procees closeing

theducks · 01-06-2011, 02:43 PM

XP SP3
I left Calibre running overnight after converting a bunch of books. When I tried to set a Filter in the morning. Calibre stopped refreshing my screen.
My HD LED was on steady for 30 sec+.
Process explorer said Calibre was now using 600+Meg Virt size.
Process explorer Screen shots Before and After reboot with same Calibre filter in place.

I note that every time a worker process closes, the number in the main process does not return all the way to its prior value (eg. fetch news).

Is this just Me?

kovidgoyal · 01-06-2011, 02:55 PM

the number on the main process will not return to its original, after all you have typically added anew book to the library by a fetch news, the metadata for that book is stored in the memory.

ALso make sure you are running the latest calibre as I fixed a few mem leaks in various bits of code a few versions ago.

theducks · 01-06-2011, 03:48 PM

Quote:

Originally Posted by kovidgoyal

the number on the main process will not return to its original, after all you have typically added anew book to the library by a fetch news, the metadata for that book is stored in the memory.

ALso make sure you are running the latest calibre as I fixed a few mem leaks in various bits of code a few versions ago.

At 37
And I DID convert a lot

So frequent restarts (ctrl-r) are in order after a big bunch of conversions

I can deal with that.

kovidgoyal · 01-06-2011, 03:52 PM

No you shouldn't need to restart after conversions, the memory usage will climb a little, but it should not climb a lot. Certainly memory usage shouldn't be reaching 600MB.

How much increase in memory usage are you seeing after a conversion?

theducks · 01-06-2011, 04:17 PM

Quote:

Originally Posted by kovidgoyal

No you shouldn't need to restart after conversions, the memory usage will climb a little, but it should not climb a lot. Certainly memory usage shouldn't be reaching 600MB.

How much increase in memory usage are you seeing after a conversion?

I was not watching

I did about 50 yesterday and A LOT of Meta-data fetches (I have been using Add from ISBN: Paste from clipboard (15-40 books at a whack) to document my dead tree collection

. Calibre made it simpler) . I did notice Calibre gettong boggy last evening

I am done for this batch, but I will put Process Explorer up on a spare screen and watch (I still need to find the missing crate of books) the next batch.

theducks · 01-07-2011, 11:27 AM

This morning a recently enabled news download fired off. It grabbed 100M (yes Meg

) and never released it.
CNET News has now been un-scheduled

kovidgoyal · 01-07-2011, 11:40 AM

That's just wrong, open a ticket and I'll look into it next week.

theducks · 01-07-2011, 12:25 PM

Cancel. I could not repeat it for the ticket. I thought news was the reason, but a manual download works as you expect: a bare blip in usage.

Still puzzled why it is jumping from 300 to 400Meg.
Would leaving Debug mode running, capture the right activity to track this?

kovidgoyal · 01-07-2011, 12:42 PM

I doubt it, the debug mode doesn't have any memory leak specific debugging. Still it can't hurt to try.

Can you repeat a mem leak with a scheduled news download?

JustinD · 03-28-2011, 05:54 AM

I am also encountering significant memory usage with Calibre. I have it running 24/7 on my Win 7 server. It fetches about 3-4 papers on average a day. Calibre was using about 575 meg of memory in task manager. Now that I have rebooted its down to 175meg. Should I be trying to work out how setup some sort of schedule to restart Calibre? I am running 0.7.52

phiznlil · 03-30-2011, 04:45 PM

You could set a scheduled task to start calibre shortly before the download and another after to stop it using taskkill: Taskkill /im calibre.exe

JustinD · 03-30-2011, 06:41 PM

thanks phizlil. I have done exactly that. I have taskkill shutting down Calibre 3 times a day (with scheduled restart). I wasn't able to work out why, at times, Calibre wasn't seeming able to let go of memory in my system so I have gone with plan B. This seems to work.

DoctorOhh · 03-30-2011, 07:04 PM

Quote:

Originally Posted by JustinD

thanks phizlil. I have done exactly that. I have taskkill shutting down Calibre 3 times a day (with scheduled restart). I wasn't able to work out why, at times, Calibre wasn't seeming able to let go of memory in my system so I have gone with plan B. This seems to work.

Did you bother submitting a bug report as Kovid suggested so this can be fixed?

JustinD · 03-30-2011, 08:49 PM

yes, but he couldn't replicate it so there is not much else I can do.

DoctorOhh · 03-30-2011, 09:06 PM

Quote:

Originally Posted by JustinD

yes, but he couldn't replicate it so there is not much else I can do.

Thanks for trying. I'm glad you were able to work around it.

01-06-2011, 02:43 PM	#1
theducks Well trained by Cats Posts: 31,020 Karma: 60358908 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	[Old Thread] Memory leak, Worker procees closeing XP SP3 I left Calibre running overnight after converting a bunch of books. When I tried to set a Filter in the morning. Calibre stopped refreshing my screen. My HD LED was on steady for 30 sec+. Process explorer said Calibre was now using 600+Meg Virt size. Process explorer Screen shots Before and After reboot with same Calibre filter in place. I note that every time a worker process closes, the number in the main process does not return all the way to its prior value (eg. fetch news). Is this just Me? Last edited by theducks; 08-16-2012 at 08:30 PM.

03-28-2011, 05:54 AM	#10
JustinD Member Posts: 16 Karma: 10 Join Date: Mar 2011 Device: iPad mini, iPhone, Kindle	I am also encountering significant memory usage with Calibre. I have it running 24/7 on my Win 7 server. It fetches about 3-4 papers on average a day. Calibre was using about 575 meg of memory in task manager. Now that I have rebooted its down to 175meg. Should I be trying to work out how setup some sort of schedule to restart Calibre? I am running 0.7.52 Last edited by JustinD; 03-28-2011 at 05:57 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Kindle 3 Screen Leak??	LuBiB	Amazon Kindle	59	06-04-2011 03:48 PM
jetBook MINI Real LEAK?!	LuBiB	Ectaco jetBook	35	10-22-2010 12:25 AM
New details leak on Samsung’s first Android tablet	Dopedangel	News	2	06-15-2010 03:14 AM
Calibre worker processes	nickredding	Calibre	1	04-24-2010 01:01 PM

01-06-2011, 02:55 PM	#2
kovidgoyal creator of calibre Posts: 45,318 Karma: 27111242 Join Date: Oct 2006 Location: Mumbai, India Device: Various	the number on the main process will not return to its original, after all you have typically added anew book to the library by a fetch news, the metadata for that book is stored in the memory. ALso make sure you are running the latest calibre as I fixed a few mem leaks in various bits of code a few versions ago.

01-06-2011, 03:52 PM	#4
kovidgoyal creator of calibre Posts: 45,318 Karma: 27111242 Join Date: Oct 2006 Location: Mumbai, India Device: Various	No you shouldn't need to restart after conversions, the memory usage will climb a little, but it should not climb a lot. Certainly memory usage shouldn't be reaching 600MB. How much increase in memory usage are you seeing after a conversion?

01-07-2011, 11:27 AM	#6
theducks Well trained by Cats Posts: 31,020 Karma: 60358908 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	This morning a recently enabled news download fired off. It grabbed 100M (yes Meg ) and never released it. CNET News has now been un-scheduled

01-07-2011, 11:40 AM	#7
kovidgoyal creator of calibre Posts: 45,318 Karma: 27111242 Join Date: Oct 2006 Location: Mumbai, India Device: Various	That's just wrong, open a ticket and I'll look into it next week.

01-07-2011, 12:25 PM	#8
theducks Well trained by Cats Posts: 31,020 Karma: 60358908 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	Cancel. I could not repeat it for the ticket. I thought news was the reason, but a manual download works as you expect: a bare blip in usage. Still puzzled why it is jumping from 300 to 400Meg. Would leaving Debug mode running, capture the right activity to track this?

01-07-2011, 12:42 PM	#9
kovidgoyal creator of calibre Posts: 45,318 Karma: 27111242 Join Date: Oct 2006 Location: Mumbai, India Device: Various	I doubt it, the debug mode doesn't have any memory leak specific debugging. Still it can't hurt to try. Can you repeat a mem leak with a scheduled news download?

03-30-2011, 04:45 PM	#11
phiznlil Member Posts: 16 Karma: 12 Join Date: Mar 2011 Device: kindle 3	You could set a scheduled task to start calibre shortly before the download and another after to stop it using taskkill: Taskkill /im calibre.exe

03-30-2011, 06:41 PM	#12
JustinD Member Posts: 16 Karma: 10 Join Date: Mar 2011 Device: iPad mini, iPhone, Kindle	thanks phizlil. I have done exactly that. I have taskkill shutting down Calibre 3 times a day (with scheduled restart). I wasn't able to work out why, at times, Calibre wasn't seeming able to let go of memory in my system so I have gone with plan B. This seems to work.

03-30-2011, 08:49 PM	#14
JustinD Member Posts: 16 Karma: 10 Join Date: Mar 2011 Device: iPad mini, iPhone, Kindle	yes, but he couldn't replicate it so there is not much else I can do.

Advert

Advert