09-07-2012, 03:21 AM | #1 |
Junior Member
Posts: 5
Karma: 501912
Join Date: Sep 2012
Device: none
|
Memory Usage - 650 MB and Constantly Growing!
There appears to be quite a bad memory management problem with Calibre (windows version).
I downloaded 0.8.64, set it up and left it running on my server. When I came back from holiday about two weeks later the memory usage had grown to over 650MB from an initial 70MB. This is with 50 books and doing nothing active. On my return I installed 0.8.67. Again, initial memory usage is about 70MB and about every five seconds it grabs another 4K. Is this a known issue? Last edited by TomTanderson; 09-07-2012 at 03:28 AM. Reason: Specify OS |
09-07-2012, 01:26 PM | #2 |
Guru
Posts: 776
Karma: 2751519
Join Date: Jul 2010
Location: UK
Device: PW2, Nexus7
|
This has been discussed in another thread: https://www.mobileread.com/forums/sho...d.php?t=151187.
|
09-07-2012, 05:07 PM | #3 | |
Junior Member
Posts: 5
Karma: 501912
Join Date: Sep 2012
Device: none
|
Quote:
I did do a search before I posted but didn't find that thread. I will follow up there. |
|
09-07-2012, 07:56 PM | #4 |
Wizard
Posts: 3,720
Karma: 1759970
Join Date: Sep 2010
Device: none
|
that other thread is a year old & not updating. the issue remains unsolved.
I can (still, with latest release) turn on task manager, with calibre idling, & watch calibre.exe memory allocation continuously creep upwards |
09-08-2012, 07:56 AM | #5 |
Guru
Posts: 776
Karma: 2751519
Join Date: Jul 2010
Location: UK
Device: PW2, Nexus7
|
Are there any tools available which might help to get this issue laid to rest, perhaps something that could identify where in calibre.exe it happens? I know that it's fairly trivial but it would be nice to get it tidied up.
|
09-08-2012, 11:24 AM | #6 |
Well trained by Cats
Posts: 29,659
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
My guess: (I have never succeeded getting the development environment working so I have not looked at most of the code)
1) there is a polling process that gets fired off after a time (it does not (just) start at startup with no device attached. There are times it does start very close to startup. 2a) I suspect that private variable declaration is being done inside the loop and until the poll process ends, does not (never) goes to garbage cleanup 2b) There is a log, string (array) variable that gets appended rather than overwritten, continuing to grow each loop |
09-08-2012, 12:51 PM | #7 |
Wizard
Posts: 3,720
Karma: 1759970
Join Date: Sep 2010
Device: none
|
kovid is in denial on this issue & so ( see previous threads ) leads to abuse, not resolution.
there is a bug - he will not accept it |
09-08-2012, 01:02 PM | #8 |
Well trained by Cats
Posts: 29,659
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
|
09-08-2012, 01:24 PM | #9 |
calibre/Sigil Developer
Posts: 4,587
Karma: 2089838
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
@cybmole - you will get abuse if you make silly statements like that. Kovid can't replicate it, you can't fix what you can't replicate. It only happens on a minority of users systems, it certainly doesn't happen on mine.
If you *really* want the problem fixed, then just make the effort yourself to figure out what causes it. Its not rocket science, but it can be time consuming - and why should Kovid waste his previous time trying to guess if users aren't prepared to help themselves? You don't have to be a software developer to do it. For instance try the following:
Last edited by kiwidude; 09-08-2012 at 01:45 PM. |
09-08-2012, 01:57 PM | #10 |
Captain Penguin
Posts: 2,944
Karma: 2077653593
Join Date: May 2009
Location: Vancouver, BC
Device: Kobo Libra 2, Nook Glowlight
|
Last time I checked the source code was freely available for download. You are more than welcome to give it a crack and fix it yourself.
|
09-08-2012, 02:09 PM | #11 | |
Guru
Posts: 776
Karma: 2751519
Join Date: Jul 2010
Location: UK
Device: PW2, Nexus7
|
Quote:
I will try out some of your suggestions but on re-reading the original thread I think this may be something of a needle-in-a-haystack exercise and consume more time than it's worth investing. |
|
09-08-2012, 02:26 PM | #12 |
calibre/Sigil Developer
Posts: 4,587
Karma: 2089838
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
@Agama - Over 6 million calibre users, probably 85%+ on Windows, and I see a grand total of 4 people reporting having a problem. Yes a lot of people won't notice if they do have it, but there are enough regular users visiting these forums you can be darn sure will have checked to see whether it also happens to them when it was first reported. I have Windows 7 x64 too with no issues - and if neither I, Kovid or any of the other "calibre regulars" are seeing the issue, then I call it a minority .
And yes it can be a needle in a haystack exercise - which is precisely why only people like yourself experiencing the problem can provide the input necessary to resolve it. I'm not saying that there isn't a problem "somewhere" btw - but speaking as a software developer this sort of issue is almost impossible to resolve without *quality* input from the users. It could literally be almost anything as the cause - some misbehaving plugin, some feature of calibre that only a subset of users are using, some conflict with other software on your machine causing calibre code to go awry, issues within third party libraries that calibre uses and so on. Last edited by kiwidude; 09-08-2012 at 02:30 PM. |
09-08-2012, 02:29 PM | #13 |
Wizard
Posts: 4,552
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
I have been testing, and I cannot replicate this behaviour on my Windows systems. I tried it on both 2-bit and 64-bit (AMD) versions of Windows. This means there must be some other factor at work.
Last edited by itimpi; 09-09-2012 at 03:43 AM. |
09-08-2012, 02:41 PM | #14 |
Guru
Posts: 776
Karma: 2751519
Join Date: Jul 2010
Location: UK
Device: PW2, Nexus7
|
@kiwidude: Yes, you're probably right here. Interesting that some Win 7 x64 show the issue and others don't. This seems to point to something other than calibre.
With 4GB of memory on my machine, (and only 1.35GB in use), a 4K per 5 sec increase in memory is less than 3MB an hour. At this rate my machine will grind to a halt in ... Ah! It won't grind to a halt: it gets switched off regularly. I won't be trying to track down the problem after all - it's not worth the effort. Last edited by Agama; 09-08-2012 at 03:13 PM. |
09-08-2012, 03:23 PM | #15 |
creator of calibre
Posts: 43,744
Karma: 22446736
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
To summarize from the original thread:
1) This is not a problem that I personally can reproduce. That does not mean I disbelieve it exists for some people, just that I cannot fix it, since for this kind of thing the ability to reproduce is critical. 2) One developer, chaley, was able to reproduce it, but he could find no issues in calibre code, and both firefox and thunderbird showed the same behavior on his system, and he found that interacting with parts of his system unrelated to calibre caused the leak to stop, so he gave up. |
Thread Tools | Search this Thread |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Memory usage | jessie102 | Calibre | 4 | 01-29-2015 12:44 PM |
Problems with Sony PRS-650, SD memory card. Is this the norm? | BetaPanther | Sony Reader | 9 | 10-20-2011 02:09 AM |
Sony PRS-650: Memory Cards are not recognized | IchBinIch | Calibre | 17 | 10-15-2010 01:53 PM |
Extreme memory usage | MJBoa | Calibre | 1 | 02-12-2010 11:37 AM |
Memory Usage | BCCISProf | Sony Reader | 15 | 05-16-2007 08:11 PM |