Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 06-23-2011, 04:17 AM   #91
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Your comments are far too brief to be able to help you - three times now you have posted 10 words or less to describe your problem. We are not mind readers and cannot see your screen. I have given you screenshots above of examples of what you need to setup. If your screen does not look like the above then post a screenshot of what it does look like. If you mean that the count words dropdown only has one thing in it, then yes that is by design but the section at the top is for counting pages.
kiwidude is offline   Reply With Quote
Old 06-23-2011, 07:43 AM   #92
bigbird1227
Enthusiast
bigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavens
 
Posts: 42
Karma: 13798
Join Date: Feb 2011
Device: kindle 3
my screenshot looks exactly like the one you have shown. in the box marked Algorithm i have the same wording that you "Total word count" I am looking for the option that says "Total page count" does your plugin have it. Mine doesn't
bigbird1227 is offline   Reply With Quote
Old 06-23-2011, 07:59 AM   #93
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Right, thanks, now I understand. If you look at the screen, you will see that is within the box "Word count options", hence why there is nothing to do with page count in it.

Above it is the box for "Page count options". Any of the algorithms in the page count options box will give you the equivalent of a total page count, they just have differing ways of doing it. I suggest leaving it at the default of "Paragraphs (APNX Accurate)". Contrary to your apparent confusion, this algorithm does give you a page count, but it does so by trying to identifying paragraphs within the book as part of a way of estimating how many pages there are. That is why it says "Paragraphs". The other option in there of "Calibre Viewer" gives you the same count that opening the book in Calibre's ebook viewer, which is based on dividing the number of characters in the book into 1024 per page, supposedly some Adobe standard.
kiwidude is offline   Reply With Quote
Old 06-23-2011, 10:21 AM   #94
bigbird1227
Enthusiast
bigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavensbigbird1227 is a rising star in the heavens
 
Posts: 42
Karma: 13798
Join Date: Feb 2011
Device: kindle 3
finally got it to work

thanks
bigbird1227 is offline   Reply With Quote
Old 06-24-2011, 04:24 PM   #95
capnm
Groupie
capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'
 
Posts: 150
Karma: 10001
Join Date: Feb 2011
Device: sony
Re: Calibre memory leak & slowdown when updating metadata

I finally had chance to try this on another machine running Win7 x64 (4Gb)
(first machine was Win7 32bit SP1, 2.5Gb)
DEP for essential windows programs & services only
Antivirus disabled

Ran it against 800 books.

Same behavior - time to update metadata was roughly the same as the count phase (> 10 min)

Calibre memory usage climbed to almost 400Mb.

Ran ExtractISBN.
Extract phase about the same (>10 min), metadata update phase about 45 sec.

So there's something different about the metadata update procedure this plugin is using.

Of course after a few more tests I won't have any reason to count big batches again, so with a little patience and remembering to restart Calibre to clear the memory leak I'm good to go
capnm is offline   Reply With Quote
Old 06-24-2011, 04:28 PM   #96
chaley
"chaley", not "charley"
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 5,450
Karma: 831552
Join Date: Jan 2010
Location: France
Device: Many android devices
It appears that in some cases, the tag browser eats memory. I was never able to reproduce it, but Kovid got close. The latest release (0.8.7) radically changes how the tag browser works initializes, eliminating (as far as we can tell) the problem.

If you run with the tag browser open, then try the new release. It might help.
chaley is offline   Reply With Quote
Old 06-24-2011, 07:06 PM   #97
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 14,645
Karma: 5629001
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
Just a heads up.

I just had Count Pages crash Calibre upon updating a previous count.
8.7 on XP SP3

Repeated 3 times.

counted pages on a title, clicked OK to update . Crash.
Started Calibre Noted it did change the first time.
Tried again: Crash

I tried another title and it worked,

Tried title 1 and it crashed

Opened title1 Metadata editor and saved.

counted again: Joy

Gremlins?
theducks is offline   Reply With Quote
Old 06-24-2011, 07:28 PM   #98
capnm
Groupie
capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'
 
Posts: 150
Karma: 10001
Join Date: Feb 2011
Device: sony
Quote:
Originally Posted by chaley View Post
It appears that in some cases, the tag browser eats memory. I was never able to reproduce it, but Kovid got close. The latest release (0.8.7) radically changes how the tag browser works initializes, eliminating (as far as we can tell) the problem.

If you run with the tag browser open, then try the new release. It might help.
Well that surprised me, because 0.8.7 partly (but only partly) solved it.

The memory leak was reduced about 75%.
The metadata update went about 30-40% faster (but still at least 15x slower than Extract ISBN's).

It never occurred to me to run without the tag browser. I'll try that next. (Though I don't see why that should affect this and not Extract ISBN).

After that, I'll have counted most all my libraries, so unless you should happen to want me to test something, I'll probably forget about the issue

Many thanks!
capnm is offline   Reply With Quote
Old 06-24-2011, 08:46 PM   #99
capnm
Groupie
capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'
 
Posts: 150
Karma: 10001
Join Date: Feb 2011
Device: sony
Quote:
Originally Posted by chaley View Post
If you run with the tag browser open
CLOSE IT!!!!
Just say "No!" to the tag browser.



rel 0.8.7

Update metadata for 1500 books.

Tag browser closed.
<2 minutes, no memory leak.

Tag browser open.
> 1 hr, >200Mb memory leak
(And it was much worse before 0.8.7)

Who'd a thunk it?
capnm is offline   Reply With Quote
Old 06-25-2011, 05:54 AM   #100
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Quote:
Originally Posted by capnm View Post
(Though I don't see why that should affect this and not Extract ISBN).
Perhaps this may give a hint to chaley/Kovid where the problem lies. Extract ISBN is affecting identifiers, whereas this plugin is affecting custom columns. Incidentially neither of these plugins has any interaction with the tag browser directly, not even a call to refresh. Extract ISBN probably should have a refresh call added to it (since there is a count of identifiers which may be affected) but the pages/word count columns are not visible so there is no need for this plugin.

So quite why the tag browser is having memory issues when the plugin is doing nothing with it is a mystery best left for chaley - perhaps it is listening to some events or something. As was mentioned previously both these plugins are deferring all database updates to the Calibre code that exists in edit_metadata.py which is called when the user finishes downloading metadata.
kiwidude is offline   Reply With Quote
Old 06-25-2011, 06:18 AM   #101
chaley
"chaley", not "charley"
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 5,450
Karma: 831552
Join Date: Jan 2010
Location: France
Device: Many android devices
The only way I can account for this is if apply_metadata_changes (I assume that is what you call) is being called in a loop instead of once with a list of all the books. After it processes the given list, it calls finalize_apply which refreshes the tag browser. A series of 1-long lists will cause a series of refreshes to the tag browser as well as other things.
chaley is offline   Reply With Quote
Old 06-25-2011, 06:24 AM   #102
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Nope, definitely only called once. And yes it is apply_metadata_changes I am calling.
kiwidude is offline   Reply With Quote
Old 06-25-2011, 07:02 AM   #103
chaley
"chaley", not "charley"
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 5,450
Karma: 831552
Join Date: Jan 2010
Location: France
Device: Many android devices
Finally bit the bullet, intrumented calibre, and ran the plugin. The problem was with database notifications. set_metadata was not telling set_custom not to emit the notification, so the TB updated on each change.

Fixed.
chaley is offline   Reply With Quote
Old 07-03-2011, 05:39 AM   #104
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
v1.1.3 Released

Changes in this release:
  • Preparation for deprecation for db.format_abspath() function in future Calibre for network backends

Internal change requried for future Calibre compatibility as discussed in this thread
kiwidude is offline   Reply With Quote
Old 07-07-2011, 10:09 AM   #105
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,194
Karma: 1619681
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura HD
Quote:
Originally Posted by kiwidude View Post
Changes in this release:
  • Preparation for deprecation for db.format_abspath() function in future Calibre for network backends

Internal change requried for future Calibre compatibility as discussed in this thread
Small idea for the next version: recognize that PRC files are Mobis (in the ebook world anyway).
mbovenka is online now   Reply With Quote
Reply

Tags
page count

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Quick Preferences kiwidude Plugins 32 09-13-2014 10:34 PM
[GUI Plugin] Quality Check kiwidude Plugins 780 09-12-2014 10:04 PM
[GUI Plugin] Kindle Collections (old) meme Plugins 2070 08-11-2014 12:02 AM
[GUI Plugin] Open With kiwidude Plugins 228 07-31-2014 01:06 AM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 08:35 AM.


MobileRead.com is a privately owned, operated and funded community.