Memory leak? - Page 2

cybmole · 10-03-2011, 01:19 PM

we'll I'm now at 142MB after leaving pc idle for last 2 hours. that's another 10% increase since I last posted.

I think others now need to join in the measuring/monitoring process. it is not normal for an app to slowly but continually expand its memory footprint when it is idling, surely.

but likely the issue is limited to certain O/S, and to having calibre configured to go to system tray rather than to completely close.

PeterT · 10-03-2011, 04:46 PM

As an experiment I have started (on Windows 7 / 64 bit) a Perf Mon session configured to capture system wide memory stats and Calibre process stats. I'll leave it going and see what gets captured.

jhay777 · 10-04-2011, 11:00 AM

Thanks cybmole, makes me feel better knowing I'm not alone!

Although 160MB may be normal for calibre when maximised and in use, it shouldn't be 300MB - 600MB (as mentioned in my initial post). Eagerly awaiting PeterT's observations...

Kovid, what do you mean when you say calibre is written in a memory managed language?

kovidgoyal · 10-04-2011, 11:49 AM

That means that calibre contains no code to manage memory explicitly (well almost no code). That is done automatically by the runtime environment.

cybmole · 10-04-2011, 12:23 PM

just rechecked mine,
after doing nothing in calibre for several hours, its currently at 190Mb !

Serpentine · 10-04-2011, 02:06 PM

Do you have any news sources or other periodic tasks that run? Doesn't really seem to be a memory leak, likely just something keeping objects in mem for a reason(even if unintended). I have quite a large library and it generally sits at around 240mb - I seldom close it, maybe weekly if there's an interesting update.

cybmole · 10-04-2011, 02:34 PM

as said before I do NOT use news, or periodic tasks.

idle should mean idle, not growing in footprint - lets see where it's at now - ... 198mb. I've not touched calibre since posting that it was at 190mb, & remember I started with it at circa 106mb yesterday morning.

i call this a (small) memory leak!

not enough to cause me problems but sufficient to demonstate that something somewhere needs fixing. ( but could be an issue with python as implemented in windows, not with calibre per se)

actually, the reason it's not caused me problems ever is that once a week the program gets closed & updated, which sets it back to circa 100Mb. if not for that it , & with an always-on PC, it could well go on climbing until it gobbles up huge amounts of RAM.

PS calibre surely does not hold the entire library in RAM - there are folks on here with 10,000+ books allegedly - & their loading times would be extreme if 10,000 files had to be opened & read.

so the reason I'm at 195 but you are at 240 is that your program has been active for longer, not 'cos you have more books ?

cybmole · 10-04-2011, 03:17 PM

I'm through the 200Mb milestone now - 300MB here I come.

haven't touched the calibre program for 2 hours, was busy fixing email issues.

if i sort processes on CPU usage within task manager, calibre.exe keeps re-entering the top 20, with 1% Cpu then reverts to 0% , drops down a few places, makes a comeback...., and with each comeback it has consumed a bit more RAM.... 201Mb & climbing...

kovidgoyal · 10-04-2011, 03:44 PM

This is definitely caused by something specific to your systems. Just leaving calibre sitting in the tray causes 0 CPU activity and no memory usage fluctuations beyond a 5MB for me on XP.

As I said before, without being able to reproduce it, there is no way I can fix it. You will just have to remember to restart calibre periodically.

cybmole · 10-05-2011, 02:21 AM

Quote:

Originally Posted by kovidgoyal

This is definitely caused by something specific to your systems. Just leaving calibre sitting in the tray causes 0 CPU activity and no memory usage fluctuations beyond a 5MB for me on XP.

As I said before, without being able to reproduce it, there is no way I can fix it. You will just have to remember to restart calibre periodically.

i guess the only way forward then is some sort of group user test/poll.

I don't use XP, I use win 7 ( 64 bit)

so far we have a sample of just 3 - you & the OP in XP , me on Win 7 - with 2 of 3 seeing some sort of leak. not enough or a diagnosis.

both vista & win 7 OS try to use all available RAM by caching data for future use. XP does not do that. - but I doubt that is the explanation here.

PeterT · 10-05-2011, 07:43 AM

When you talk of memory usage; which memory stat ARE you looking at?

cybmole · 10-05-2011, 08:09 AM

i am looking at windows task manager - processes tab - column headed memory. currently showing 217,692k for calibre.exe.
more than any other running process.

DoctorOhh · 10-05-2011, 08:19 AM

Quote:

Originally Posted by cybmole

i am looking at windows task manager - processes tab - column headed memory. currently showing 217,692k for calibre.exe.
more than any other running process.

I'm easily at that level within 10 minutes of starting calibre. I start at 165,000k edit the metadata for a couple books, convert a couple of books and I am right in the 224,000k range.

cybmole · 10-05-2011, 08:44 AM

Quote:

Originally Posted by dwanthny

I'm easily at that level within 10 minutes of starting calibre. I start at 165,000k edit the metadata for a couple books, convert a couple of books and I am right in the 224,000k range.

on a 1Gb windows XP install that's 25% of total memory.- greedy.
If it were at that level only when working it would be less of an issue, but the fact that it never returns un-needed RAM when it reverts to idling is suspicious.

especially as a complete exit & restart will take me down from 217MB to...let's see... 100MB... now if I download some metadata --- up to 124MB.

it maybe loads metadata.db into RAM but that's only 2.5mb on my PC

DoctorOhh · 10-05-2011, 08:53 AM

Quote:

Originally Posted by cybmole

If it were at that level only when working it would be less of an issue, but the fact that it never returns un-needed RAM when it reverts to idling is suspicious.

Your right in that once calibre does something it doesn't always release the memory, it seems to cache some data for later use. I'm fine with this.

Quote:

Originally Posted by cybmole

it maybe loads metadata.db into RAM but that's only 2.5mb on my PC

My metadata.db is 43meg on a library of 9300 books on my finished library and 45megs on my working library. It's not uncommon for calibre to be operating in the 325meg range, but somehow Firefox always seems to use just a little more ram.

10-04-2011, 02:34 PM	#22
cybmole Wizard Posts: 3,720 Karma: 1759970 Join Date: Sep 2010 Device: none	as said before I do NOT use news, or periodic tasks. idle should mean idle, not growing in footprint - lets see where it's at now - ... 198mb. I've not touched calibre since posting that it was at 190mb, & remember I started with it at circa 106mb yesterday morning. i call this a (small) memory leak! not enough to cause me problems but sufficient to demonstate that something somewhere needs fixing. ( but could be an issue with python as implemented in windows, not with calibre per se) actually, the reason it's not caused me problems ever is that once a week the program gets closed & updated, which sets it back to circa 100Mb. if not for that it , & with an always-on PC, it could well go on climbing until it gobbles up huge amounts of RAM. PS calibre surely does not hold the entire library in RAM - there are folks on here with 10,000+ books allegedly - & their loading times would be extreme if 10,000 files had to be opened & read. so the reason I'm at 195 but you are at 240 is that your program has been active for longer, not 'cos you have more books ? Last edited by cybmole; 10-04-2011 at 02:43 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Kindle 3 Screen Leak??	LuBiB	Amazon Kindle	59	06-04-2011 03:48 PM
[Old Thread] Memory leak, Worker procees closeing	theducks	Calibre	14	03-30-2011 09:06 PM
jetBook MINI Real LEAK?!	LuBiB	Ectaco jetBook	35	10-22-2010 12:25 AM
New details leak on Samsung’s first Android tablet	Dopedangel	News	2	06-15-2010 03:14 AM

10-03-2011, 01:19 PM	#16
cybmole Wizard Posts: 3,720 Karma: 1759970 Join Date: Sep 2010 Device: none	we'll I'm now at 142MB after leaving pc idle for last 2 hours. that's another 10% increase since I last posted. I think others now need to join in the measuring/monitoring process. it is not normal for an app to slowly but continually expand its memory footprint when it is idling, surely. but likely the issue is limited to certain O/S, and to having calibre configured to go to system tray rather than to completely close.

10-03-2011, 04:46 PM	#17
PeterT Grand Sorcerer Posts: 12,168 Karma: 73448616 Join Date: Nov 2007 Location: Toronto Device: Nexus 7, Clara, Touch, Tolino EPOS	As an experiment I have started (on Windows 7 / 64 bit) a Perf Mon session configured to capture system wide memory stats and Calibre process stats. I'll leave it going and see what gets captured.

10-04-2011, 11:00 AM	#18
jhay777 Junior Member Posts: 7 Karma: 10 Join Date: Sep 2011 Device: Kindle 3	Thanks cybmole, makes me feel better knowing I'm not alone! Although 160MB may be normal for calibre when maximised and in use, it shouldn't be 300MB - 600MB (as mentioned in my initial post). Eagerly awaiting PeterT's observations... Kovid, what do you mean when you say calibre is written in a memory managed language?

10-04-2011, 11:49 AM	#19
kovidgoyal creator of calibre Posts: 43,860 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	That means that calibre contains no code to manage memory explicitly (well almost no code). That is done automatically by the runtime environment.

10-04-2011, 12:23 PM	#20
cybmole Wizard Posts: 3,720 Karma: 1759970 Join Date: Sep 2010 Device: none	just rechecked mine, after doing nothing in calibre for several hours, its currently at 190Mb !

10-04-2011, 02:06 PM	#21
Serpentine Evangelist Posts: 416 Karma: 1045911 Join Date: Sep 2011 Location: Cape Town, South Africa Device: Kindle 3	Do you have any news sources or other periodic tasks that run? Doesn't really seem to be a memory leak, likely just something keeping objects in mem for a reason(even if unintended). I have quite a large library and it generally sits at around 240mb - I seldom close it, maybe weekly if there's an interesting update.

10-04-2011, 03:17 PM	#23
cybmole Wizard Posts: 3,720 Karma: 1759970 Join Date: Sep 2010 Device: none	I'm through the 200Mb milestone now - 300MB here I come. haven't touched the calibre program for 2 hours, was busy fixing email issues. if i sort processes on CPU usage within task manager, calibre.exe keeps re-entering the top 20, with 1% Cpu then reverts to 0% , drops down a few places, makes a comeback...., and with each comeback it has consumed a bit more RAM.... 201Mb & climbing...

10-04-2011, 03:44 PM	#24
kovidgoyal creator of calibre Posts: 43,860 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	This is definitely caused by something specific to your systems. Just leaving calibre sitting in the tray causes 0 CPU activity and no memory usage fluctuations beyond a 5MB for me on XP. As I said before, without being able to reproduce it, there is no way I can fix it. You will just have to remember to restart calibre periodically.

10-05-2011, 07:43 AM	#26
PeterT Grand Sorcerer Posts: 12,168 Karma: 73448616 Join Date: Nov 2007 Location: Toronto Device: Nexus 7, Clara, Touch, Tolino EPOS	When you talk of memory usage; which memory stat ARE you looking at?

10-05-2011, 08:09 AM	#27
cybmole Wizard Posts: 3,720 Karma: 1759970 Join Date: Sep 2010 Device: none	i am looking at windows task manager - processes tab - column headed memory. currently showing 217,692k for calibre.exe. more than any other running process.

Advert

Advert