Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 09-07-2012, 03:21 AM   #1
TomTanderson
Junior Member
TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.
 
Posts: 5
Karma: 501912
Join Date: Sep 2012
Device: none
Memory Usage - 650 MB and Constantly Growing!

There appears to be quite a bad memory management problem with Calibre (windows version).

I downloaded 0.8.64, set it up and left it running on my server. When I came back from holiday about two weeks later the memory usage had grown to over 650MB from an initial 70MB. This is with 50 books and doing nothing active.

On my return I installed 0.8.67. Again, initial memory usage is about 70MB and about every five seconds it grabs another 4K.

Is this a known issue?

Last edited by TomTanderson; 09-07-2012 at 03:28 AM. Reason: Specify OS
TomTanderson is offline   Reply With Quote
Old 09-07-2012, 01:26 PM   #2
Agama
Guru
Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.
 
Agama's Avatar
 
Posts: 776
Karma: 2751519
Join Date: Jul 2010
Location: UK
Device: PW2, Nexus7
This has been discussed in another thread: https://www.mobileread.com/forums/sho...d.php?t=151187.
Agama is offline   Reply With Quote
Old 09-07-2012, 05:07 PM   #3
TomTanderson
Junior Member
TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.TomTanderson ought to be getting tired of karma fortunes by now.
 
Posts: 5
Karma: 501912
Join Date: Sep 2012
Device: none
Quote:
Originally Posted by Agama View Post
This has been discussed in another thread: https://www.mobileread.com/forums/sho...d.php?t=151187.
Thanks for linking to that.

I did do a search before I posted but didn't find that thread. I will follow up there.
TomTanderson is offline   Reply With Quote
Old 09-07-2012, 07:56 PM   #4
cybmole
Wizard
cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.
 
Posts: 3,720
Karma: 1759970
Join Date: Sep 2010
Device: none
that other thread is a year old & not updating. the issue remains unsolved.

I can (still, with latest release) turn on task manager, with calibre idling, & watch calibre.exe memory allocation continuously creep upwards
cybmole is offline   Reply With Quote
Old 09-08-2012, 07:56 AM   #5
Agama
Guru
Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.
 
Agama's Avatar
 
Posts: 776
Karma: 2751519
Join Date: Jul 2010
Location: UK
Device: PW2, Nexus7
Are there any tools available which might help to get this issue laid to rest, perhaps something that could identify where in calibre.exe it happens? I know that it's fairly trivial but it would be nice to get it tidied up.
Agama is offline   Reply With Quote
Old 09-08-2012, 11:24 AM   #6
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 29,659
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
My guess: (I have never succeeded getting the development environment working so I have not looked at most of the code)
1) there is a polling process that gets fired off after a time (it does not (just) start at startup with no device attached. There are times it does start very close to startup.

2a) I suspect that private variable declaration is being done inside the loop and until the poll process ends, does not (never) goes to garbage cleanup

2b) There is a log, string (array) variable that gets appended rather than overwritten, continuing to grow each loop
theducks is offline   Reply With Quote
Old 09-08-2012, 12:51 PM   #7
cybmole
Wizard
cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.
 
Posts: 3,720
Karma: 1759970
Join Date: Sep 2010
Device: none
kovid is in denial on this issue & so ( see previous threads ) leads to abuse, not resolution.
there is a bug - he will not accept it
cybmole is offline   Reply With Quote
Old 09-08-2012, 01:02 PM   #8
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 29,659
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by cybmole View Post
kovid is in denial on this issue & so ( see previous threads ) leads to abuse, not resolution.
there is a bug - he will not accept it
I don't think he is 'denial'. He just does not have enough info to find and debug what only happens on some Windows systems.
theducks is offline   Reply With Quote
Old 09-08-2012, 01:24 PM   #9
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,588
Karma: 2089838
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
@cybmole - you will get abuse if you make silly statements like that. Kovid can't replicate it, you can't fix what you can't replicate. It only happens on a minority of users systems, it certainly doesn't happen on mine.

If you *really* want the problem fixed, then just make the effort yourself to figure out what causes it. Its not rocket science, but it can be time consuming - and why should Kovid waste his previous time trying to guess if users aren't prepared to help themselves?

You don't have to be a software developer to do it. For instance try the following:
  • Put a clean install of calibre on a completely clean alternative machine - change no settings from defaults, and start with a simple library. Verify that it does or does not happen.
  • Start Windows in safe mode. And/or disable various other services on your machine/at startup
  • If you don't have a spare machine, install a virtual machine with a fresh Windows install
  • Make a backup of your calibre configuration directory, then delete it so calibre is forced back to system defaults
  • Incrementally step by step turn on features or other software services until you start seeing the problem again. Then go back a step to verify that is indeed the cause.

Last edited by kiwidude; 09-08-2012 at 01:45 PM.
kiwidude is offline   Reply With Quote
Old 09-08-2012, 01:57 PM   #10
afv011
Captain Penguin
afv011 ought to be getting tired of karma fortunes by now.afv011 ought to be getting tired of karma fortunes by now.afv011 ought to be getting tired of karma fortunes by now.afv011 ought to be getting tired of karma fortunes by now.afv011 ought to be getting tired of karma fortunes by now.afv011 ought to be getting tired of karma fortunes by now.afv011 ought to be getting tired of karma fortunes by now.afv011 ought to be getting tired of karma fortunes by now.afv011 ought to be getting tired of karma fortunes by now.afv011 ought to be getting tired of karma fortunes by now.afv011 ought to be getting tired of karma fortunes by now.
 
afv011's Avatar
 
Posts: 2,944
Karma: 2077653593
Join Date: May 2009
Location: Vancouver, BC
Device: Kobo Libra 2, Nook Glowlight
Quote:
Originally Posted by cybmole View Post
kovid is in denial on this issue & so ( see previous threads ) leads to abuse, not resolution.
there is a bug - he will not accept it
Last time I checked the source code was freely available for download. You are more than welcome to give it a crack and fix it yourself.
afv011 is offline   Reply With Quote
Old 09-08-2012, 02:09 PM   #11
Agama
Guru
Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.
 
Agama's Avatar
 
Posts: 776
Karma: 2751519
Join Date: Jul 2010
Location: UK
Device: PW2, Nexus7
Quote:
Originally Posted by kiwidude View Post
It only happens on a minority of users systems, it certainly doesn't happen on mine.
I'm not sure whether the threads on this topic actually give enough information to be sure that it's only a minority of systems. I guess that since it's such a minor issue that most users haven't checked. It certainly happens on my Windows 7 x64 installation.

I will try out some of your suggestions but on re-reading the original thread I think this may be something of a needle-in-a-haystack exercise and consume more time than it's worth investing.
Agama is offline   Reply With Quote
Old 09-08-2012, 02:26 PM   #12
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,588
Karma: 2089838
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
@Agama - Over 6 million calibre users, probably 85%+ on Windows, and I see a grand total of 4 people reporting having a problem. Yes a lot of people won't notice if they do have it, but there are enough regular users visiting these forums you can be darn sure will have checked to see whether it also happens to them when it was first reported. I have Windows 7 x64 too with no issues - and if neither I, Kovid or any of the other "calibre regulars" are seeing the issue, then I call it a minority .

And yes it can be a needle in a haystack exercise - which is precisely why only people like yourself experiencing the problem can provide the input necessary to resolve it.

I'm not saying that there isn't a problem "somewhere" btw - but speaking as a software developer this sort of issue is almost impossible to resolve without *quality* input from the users. It could literally be almost anything as the cause - some misbehaving plugin, some feature of calibre that only a subset of users are using, some conflict with other software on your machine causing calibre code to go awry, issues within third party libraries that calibre uses and so on.

Last edited by kiwidude; 09-08-2012 at 02:30 PM.
kiwidude is offline   Reply With Quote
Old 09-08-2012, 02:29 PM   #13
itimpi
Wizard
itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.
 
Posts: 4,552
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
I have been testing, and I cannot replicate this behaviour on my Windows systems. I tried it on both 2-bit and 64-bit (AMD) versions of Windows. This means there must be some other factor at work.

Last edited by itimpi; 09-09-2012 at 03:43 AM.
itimpi is offline   Reply With Quote
Old 09-08-2012, 02:41 PM   #14
Agama
Guru
Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.
 
Agama's Avatar
 
Posts: 776
Karma: 2751519
Join Date: Jul 2010
Location: UK
Device: PW2, Nexus7
@kiwidude: Yes, you're probably right here. Interesting that some Win 7 x64 show the issue and others don't. This seems to point to something other than calibre.

With 4GB of memory on my machine, (and only 1.35GB in use), a 4K per 5 sec increase in memory is less than 3MB an hour. At this rate my machine will grind to a halt in ... Ah! It won't grind to a halt: it gets switched off regularly.

I won't be trying to track down the problem after all - it's not worth the effort.

Last edited by Agama; 09-08-2012 at 03:13 PM.
Agama is offline   Reply With Quote
Old 09-08-2012, 03:23 PM   #15
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,744
Karma: 22446736
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
To summarize from the original thread:

1) This is not a problem that I personally can reproduce. That does not mean I disbelieve it exists for some people, just that I cannot fix it, since for this kind of thing the ability to reproduce is critical.

2) One developer, chaley, was able to reproduce it, but he could find no issues in calibre code, and both firefox and thunderbird showed the same behavior on his system, and he found that interacting with parts of his system unrelated to calibre caused the leak to stop, so he gave up.
kovidgoyal is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Memory usage jessie102 Calibre 4 01-29-2015 12:44 PM
Problems with Sony PRS-650, SD memory card. Is this the norm? BetaPanther Sony Reader 9 10-20-2011 02:09 AM
Sony PRS-650: Memory Cards are not recognized IchBinIch Calibre 17 10-15-2010 01:53 PM
Extreme memory usage MJBoa Calibre 1 02-12-2010 11:37 AM
Memory Usage BCCISProf Sony Reader 15 05-16-2007 08:11 PM


All times are GMT -4. The time now is 05:26 AM.


MobileRead.com is a privately owned, operated and funded community.