Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 09-08-2012, 08:27 PM   #16
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 9,864
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
FYI

Quote:
Originally Posted by kiwidude View Post
I have Windows 7 x64 too with no issues - and if neither I, Kovid or any of the other "calibre regulars" are seeing the issue, then I call it a minority .
I see this behavior on my Windows 7 x64 machine at home, but running the exact same copy of calibre portable (via Dropbox) on my Windows 7 x32 machine at work doesn't show this behavior.

I never mentioned it during these discussions because Kovid can't recreate it and I don't give a hoot about 4k every 5-8 seconds. If it ever became an issue I would simply program a reboot periodically to manage it. My linux router reboots on its own about every 10 days. This is very unusual for a linux based router, I just scheduled a reboot once a week on my schedule and life goes on.
DoctorOhh is offline   Reply With Quote
Old 09-09-2012, 02:56 AM   #17
cybmole
Wizard
cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.
 
Posts: 3,720
Karma: 1759970
Join Date: Sep 2010
Device: none
Quote:
Originally Posted by kiwidude View Post
@cybmole - you will get abuse if you make silly statements like that. Kovid can't replicate it, you can't fix what you can't replicate. It only happens on a minority of users systems, it certainly doesn't happen on mine.

If you *really* want the problem fixed, then just make the effort yourself to figure out what causes it...
well in the old thread I suggested a poll , to narrow down what O/S etc. this occurs on - that idea was shot down....

if someone with Win 7 64 bit can honestly claim it does NOT happen to them than we may have diagnostic progress... if not then maybe it's a Windows thing.

but the "it doesn't happen on my machine so the software is not broken" attitude seems narrow-minded - it's not like I have some obscure no-one-else-uses-it O/S...

PS for me, the memory leak is no big deal - I have plenty of RAM & it causes me no grief - but if ever APP I have running leaked like this then it would become a problem.
cybmole is offline   Reply With Quote
Old 09-09-2012, 03:50 PM   #18
ShellShock
Wizard
ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.
 
ShellShock's Avatar
 
Posts: 1,176
Karma: 2431850
Join Date: Sep 2008
Device: IPad Mini 2 Retina
As a C++/C# developer, for this type of bug, I would get the user to capture some process dumps, e.g. using DebugDiag, and then I would do some post mortem debugging of the dumps using WinDbg. Is that not an option here? I appreciate Calibre is running within python, but a some level it will be allocating memory from the O/S; WinDbg should give some clues as to what the allocated memory contains.
ShellShock is offline   Reply With Quote
Old 09-10-2012, 12:03 AM   #19
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,749
Karma: 22446736
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Actually, thanks to a Eureka moment, and a bit of help from people that could reproduce the problem, I found and fixed the probable source of the leak. See the commit logs if you're interested in what the leak was.

@ShellShock: Funnily enough the leak was in C code, not python code
kovidgoyal is online now   Reply With Quote
Old 09-10-2012, 01:17 AM   #20
cybmole
Wizard
cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.
 
Posts: 3,720
Karma: 1759970
Join Date: Sep 2010
Device: none
Quote:
Originally Posted by kovidgoyal View Post
... See the commit logs if you're interested in what the leak was.

@ShellShock: Funnily enough the leak was in C code, not python code
where do I find the commit logs please .

I probably won't fully understand the explanation but I'd like to try :-)
cybmole is offline   Reply With Quote
Old 09-10-2012, 07:02 AM   #21
Man Eating Duck
Addict
Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.
 
Posts: 254
Karma: 69786
Join Date: May 2006
Location: Oslo, Norway
Device: Kobo Aura, Sony PRS-650
Quote:
Originally Posted by cybmole View Post
where do I find the commit logs please .

I probably won't fully understand the explanation but I'd like to try :-)
I believe it's this one, but you'll have to read the diff to figure out what's going on

It seems that the leak was in the code that checks for newly connected devices.
Man Eating Duck is offline   Reply With Quote
Old 09-10-2012, 07:19 AM   #22
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,749
Karma: 22446736
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
It's that one and this one: http://bazaar.launchpad.net/~kovid/c...revision/13212
kovidgoyal is online now   Reply With Quote
Old 09-14-2012, 02:56 PM   #23
Agama
Guru
Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.
 
Agama's Avatar
 
Posts: 776
Karma: 2751519
Join Date: Jul 2010
Location: UK
Device: PW2, Nexus7
Thanks Kovid, you've nailed it with 0.8.69
Agama is offline   Reply With Quote
Old 09-14-2012, 03:15 PM   #24
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 29,662
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Hmm!
I am watching Virtual size in Process explorer:
Tags, Details, Covers not showing

Changing the selected book, changes the usage (up or down). Any idea why?

Btw, I did see one 'Grow' from ~306K to ~307K. Have not figured the trigger
theducks is online now   Reply With Quote
Old 09-14-2012, 03:30 PM   #25
Agama
Guru
Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.Agama ought to be getting tired of karma fortunes by now.
 
Agama's Avatar
 
Posts: 776
Karma: 2751519
Join Date: Jul 2010
Location: UK
Device: PW2, Nexus7
It seems quite normal for memory usage to change up and down in many applications, but the 4K per 5sec constant increase, (even when not touching calibre), has certainly now stopped.
Agama is offline   Reply With Quote
Old 09-14-2012, 10:53 PM   #26
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,749
Karma: 22446736
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quote:
Originally Posted by Agama View Post
Thanks Kovid, you've nailed it with 0.8.69
Glad to hear it

@theducks: When you do things in calibre memory will climb and fall, that is normal in any complex application.
kovidgoyal is online now   Reply With Quote
Old 09-15-2012, 10:40 AM   #27
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 29,662
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by kovidgoyal View Post
Glad to hear it

@theducks: When you do things in calibre memory will climb and fall, that is normal in any complex application.
I understand the Up and down is normal.

Something made it go up a Bit and it never came back down (until I restarted Calibre). This is a very tiny leak compared to the one(s) that used to suck memory. IMHO Very livable
theducks is online now   Reply With Quote
Old 09-15-2012, 11:32 AM   #28
chaley
Grand Sorcerer
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 11,693
Karma: 6240117
Join Date: Jan 2010
Location: Notts, England
Device: Kobo Libra 2
@theducks: there are several things that will "permanently" consume memory. Some are the tag browser data structures (the item tree), caches in devices, and the cover cache. There are a lot of others. These aren't "leaks" because the memory is kept on purpose and reused if/when the keeper chooses.
chaley is offline   Reply With Quote
Old 09-15-2012, 12:00 PM   #29
Man Eating Duck
Addict
Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.Man Eating Duck juggles neatly with hedgehogs.
 
Posts: 254
Karma: 69786
Join Date: May 2006
Location: Oslo, Norway
Device: Kobo Aura, Sony PRS-650
And, at the end of the day this was a really trivial problem. It could be fixed at any time, in a few seconds, by simply hitting Ctrl+R. It's nice that this memory leak is fixed, but I hope the devs focus their time and energy on adding or improving functionality rather than hunting down these kinds of bugs.

Or, to put it this way: a great many people might be affected by some random issue that stops their workflow in some manner (like a new device which yet has no calibre plugin). There are very few people who have the competence and inclination to hack calibre effectively. What would you prefer them to do: help those people or add some nifty conversion feature, or hunt down very minor annoyances with trivial workarounds?

Of course each developer chooses what they'd like to improve, but I know what I'd like them to focus on.
Man Eating Duck is offline   Reply With Quote
Old 09-15-2012, 12:09 PM   #30
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 29,662
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by chaley View Post
@theducks: there are several things that will "permanently" consume memory. Some are the tag browser data structures (the item tree), caches in devices, and the cover cache. There are a lot of others. These aren't "leaks" because the memory is kept on purpose and reused if/when the keeper chooses.
This makes sense. So, until I use the Tag Browser, memmory is not allocated... But, once used (in the session), it will be retained. Understanding
theducks is online now   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Memory usage jessie102 Calibre 4 01-29-2015 12:44 PM
Problems with Sony PRS-650, SD memory card. Is this the norm? BetaPanther Sony Reader 9 10-20-2011 02:09 AM
Sony PRS-650: Memory Cards are not recognized IchBinIch Calibre 17 10-15-2010 01:53 PM
Extreme memory usage MJBoa Calibre 1 02-12-2010 11:37 AM
Memory Usage BCCISProf Sony Reader 15 05-16-2007 08:11 PM


All times are GMT -4. The time now is 07:47 AM.


MobileRead.com is a privately owned, operated and funded community.