[GUI Plugin] Count Pages - Page 25

Boekenworm · 07-13-2012, 07:07 AM

@Kiwidude

,
Thank you for upgrading the plugin and so quickly.

As far as I can tell it works perfectly, exactly what I was looking for!

I found a tiny documentation-bug. The link in the configuration screen to Flesch-Kincaid points to a wrong wikipedia page instead of here.

Just as theducks I noticed that the first time I opened the configuration screen it was too short and I had te resize it to be able to read it.

Thank you very much!

Boekenworm.

kiwidude · 07-13-2012, 10:19 AM

@Boekenworm,

I will make sure the URL link is corrected. The url I had was correct in its raw form in the code but it got "double encoded" to become incorrect.

I think I will just put a minimum width on the dialog (rather than a mnimum height) and that should stop the resizing/word-wrap issue on that Readability statistics line.

Glad to hear it is doing what you asked for. I'll officially release it tonight or tomorrow.

JimmXinu · 07-14-2012, 11:41 AM

FYI, the tooltip on 'Always overwrite an existing word/page count' needs some line wrapping. It's wider than my whole screen.

Is there supposed to be more than one Word count algorithm available? I'm only seeing one.

kiwidude · 07-14-2012, 11:48 AM

Tooltip works fine on my triple monitor setup.

The dropdown has gone from the code for the official release but well spotted...

kiwidude · 07-14-2012, 12:56 PM

Changes in this release:

Add three new statistics for calculating readability - Flesch Reading Ease, Flesch-Kincaid Grade Level and Gunning Fog.
Remove the redundant Words algorithm combo since only one algorithm offered.
Make page algorithm a per library setting rather than a plugin level setting
For CBR and CBZ book formats, calculate the number of pages as being the number of image files rather than converting to ePub
For CBR and CBZ book formats, only allow the Count Pages statistic and ignore all other statistics
Fix tooltip missing line breaks in configuration dialog

snarkophilus · 07-15-2012, 09:00 PM

Hi Kiwi,

One of the books in my library gives the following error:

Spoiler:

This is for an old eReader PRC that Calibre converted to ePub, and it looks like the conversion has gone horribly wrong. The <title> is approx 350kb and the body is:

Code:

<body class="calibre"/>

Should the plugin fail a bit more graciously here - perhaps catch the 0 word count and not update the databse?

Cheers,
Simon.

PeterT · 07-15-2012, 09:43 PM

@snarkophilus: Not sure why you bother with word and page count on this book; you KNOW it's 42 for either one.

odinokij · 07-16-2012, 03:08 AM

Thanks a lot, kiwidude, for your prompt support for cbr/cbz files. It works great. Thanks again.

kiwidude · 07-16-2012, 07:49 AM

@snarkophilus - I've made a change for the next version which will do as you suggest of aborting calculating statistics for that particular book and printing why in the log. In that situation you displayed it would still store a page count, but it would leave any other word count or readability statistics untouched. So if you haven't yet set a value, they will stay blank, and if it already has a value, that will stay as it is.

I'll hold off on releasing the change for a few days to see if anything else comes up.

lbolton · 07-16-2012, 02:20 PM

Hi.

Like many, I've scoured the intermess to find, assemble and manage a large collection. Though I don't use it often, My wife is temporarily homebound and has found this a significant comfort.

Your plugin is one of the most useful tools I've found, and I've quickly come to rely on it heavily.

I've recently noted some behaviors that may not have been mentioned here.
I've included some representative log entries.

My system is:
Opensuse 12.12
KDE 4.7.2
Calibre 0.8.60

First, starting with the plugin versions available on 0.8.59,
And, using any of the three algorithms available,
scanning an entry with ONLY a pdf file, will give a valid page count, but a word count of 0 (zero). I haven't diagnosed this extensively. If I could relearn python, I'd have just helped rather then begged.

Second, unfortunately, the new word count WILL overwrite an older. no matter what settings are used.

Third, I'm sure its been noticed, but there seems to be a number of unicode characters
that throw a fatal error that will abort a job.

Most especially, I seem to have a large number of files originally encoded to include:
a particular rendition of single quotes with codes of \u2018 and \u2019. Though there are many others.

I would like to join other voices in encouraging a few enhancements to overcome these.

I wonder if there are not python libraries that more gracefully or completely handle
some of these problematic characters.
Or, include a user accessible enumerated list of potentially incorrect characters with
an appropriate mapping.
Or, mayhap, Both? I'd like to imagine that a list of exceptions or replacement rules could be called from calibre's existing conversion tools.

I wonder if it's possible to simply log such errors without aborting the job.

I wonder if it may be possible to allow an option to simply keep the epub conversion
created to enable the count of PDFs.

log follows.
----------------------------------------cut---------------------------------------

--------------------------------------------cut---------------------------------------
shire:~ # calibre-debug --gui
Starting up...
Started up in 6.74 seconds with 10029 books
Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
DeviceJob: 1 Get device information callback returned
Job: 2 Get list of books on device started
DEBUG: 0.0 USBMS: Fetching list of books from device. Device= FOLDER_DEVICE oncard= None
DEBUG: 0.0 USBMS: dirs are: /local/staging/
DEBUG: 0.0 USBMS: scan from root False /local/staging/
DEBUG: 0.0 USBMS: count found in cache: 43, count of files in metadata: 43, need_sync: False
DEBUG: 0.0 USBMS: Finished fetching list of books from device. oncard= None
DEBUG: 0.1 USBMS: Fetching list of books from device. Device= FOLDER_DEVICE oncard= carda
DEBUG: 0.1 USBMS: Fetching list of books from device. Device= FOLDER_DEVICE oncard= cardb
DeviceJob: 2 Get list of books on device done, calling callback
Job: 1 Get device information finished
No details available.
Job: 2 Get list of books on device finished
No details available.
DeviceJob: 2 Get list of books on device callback returned
Job: 2 Get list of books on device finished
No details available.
Worker Launch took: 0.23487496376
InputFormatPlugin: EPUB Input running
on /local/books/James Patrick Kelly/10 16 to 1 (4098)/10 16 to 1 - James Patrick Kelly.epub
Found HTML cover titlepage.xhtml
QPainter::begin: Paint device returned engine == 0, type: 2
QPainter::setCompositionMode: Painter not active
QPainter::begin: Paint device returned engine == 0, type: 2
QPainter::begin: Paint device returned engine == 0, type: 2
QPainter::setCompositionMode: Painter not active
QPainter::begin: Paint device returned engine == 0, type: 2
/usr/bin/xdg-open: line 322: test: KDE Development Platform: 4.7.2 (4.7.2) "release 5": integer expression expected
/usr/bin/xdg-open: line 323: test: KDE Development Platform: 4.7.2 (4.7.2) "release 5": integer expression expected
/usr/bin/xdg-open: line 324: test: KDE Development Platform: 4.7.2 (4.7.2) "release 5": integer expression expected

(process:11870): GLib-CRITICAL **: g_main_context_pop_thread_default: assertion `g_queue_peek_head (stack) == context' failed
Worker Launch took: 0.245404005051
Job: 4 Convert book 1 of 1 (10 16 to 1) finished
Convert book 1 of 1 (10 16 to 1)
Resolved conversion options
calibre version: 0.8.60
{'asciiize': False,

.................deleted----------------

No TOC, MOBI index not generated
MOBI output written to /tmp/calibre_0.8.60_tmp_bbWOxU/QZ_OuQ.mobi

(process:11848): GLib-CRITICAL **: g_main_context_pop_thread_default: assertion `g_queue_peek_head (stack) == context' failed

(process:11848): GLib-CRITICAL **: g_main_context_pop_thread_default: assertion `g_queue_peek_head (stack) == context' failed
shire:~ #
-------------------------------------------------cut-------------------------------------

TIA

kiwidude · 07-16-2012, 02:42 PM

@lbolton

1. You will get a word count of zero for PDFs that contain image pages (that haven't been OCR'd).

2. With the change I have mentioned in post right before yours the next release of the plugin will treat a zero word count as an "error" situation in that it will just write a message to the log and not write zero into the custom column.

3. Any issues to do with PDF conversions are *nothing* to do with this plugin. They are calibre/PDF library issues. If you have a specific pdf that causes a fault with this plugin, you will almost certainly get the same fault when you use calibre to do a PDF-> EPUB conversion. As such follow the official calibre support routes - you can raise a ticket, attach the PDF in question and it is possible someone will take a look at it. If calibre can convert the PDF without crashing, so should this plugin.

4. Keeping the temporary PDF to count pages is not going to happen. If you want an EPUB version, convert before you count pages, and this plugin will then work with that EPUB. As has been well documented PDF-> EPUB versions generally suck and require much editing and tuning to look anything like the original - what this plugin produces is designed only for the purposes of estimating a word count, not human readability.

5. As per my answers in 3, I'm afraid the log isn't something I can do anything about.

kiwidude · 07-17-2012, 02:33 PM

Changes in this release:

If a book has zero words, just display an error in log rather than storing zero in the column

bauerhjb · 07-19-2012, 02:05 AM

Hi
I just installed v1.6.1 and it shows all books as having zero words. Counts the pages ok. Any idea why it might do this? The version before worked great for pdfs. I even re-did some counts as a check between this version and the one before. Books that had word counts previously now show zero words. Don't mean to complain. Is there a chance of getting the previous version to use instead?
Using calibre 8.60, windows vista (no cracks please..)

Thanks for all the great work you do on these plugins.

kiwidude · 07-19-2012, 05:47 AM

Changes in this release:

Make the html tag removal for body tag data case insensitive to fix issue with PDF conversions from 1.6.0

@bauerhjb - thx for bringing this to my attention, it would have been broken with the changes in 1.6.0. I don't store PDFs in my main library so I hadn't noticed it.

Josieb1 · 07-20-2012, 04:35 PM

Hi I have just downloaded the new update to this plug in and I now get page counts not word counts, for mobi files, even though my settings appear to be on word count.

Can anyone help please? I really need word counts back

07-13-2012, 07:07 AM	#361
Boekenworm Junior Member Posts: 4 Karma: 50 Join Date: Jun 2012 Device: iPad	Thanks, exactly what I asked for! @Kiwidude , Thank you for upgrading the plugin and so quickly. As far as I can tell it works perfectly, exactly what I was looking for! I found a tiny documentation-bug. The link in the configuration screen to Flesch-Kincaid points to a wrong wikipedia page instead of here. Just as theducks I noticed that the first time I opened the configuration screen it was too short and I had te resize it to be able to read it. Thank you very much! Boekenworm.

07-14-2012, 12:56 PM	#365
kiwidude Calibre Plugins Developer Posts: 4,636 Karma: 2162064 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	v1.6.0 Released Changes in this release: Add three new statistics for calculating readability - Flesch Reading Ease, Flesch-Kincaid Grade Level and Gunning Fog. Remove the redundant Words algorithm combo since only one algorithm offered. Make page algorithm a per library setting rather than a plugin level setting For CBR and CBZ book formats, calculate the number of pages as being the number of image files rather than converting to ePub For CBR and CBZ book formats, only allow the Count Pages statistic and ignore all other statistics Fix tooltip missing line breaks in configuration dialog

07-17-2012, 02:33 PM	#372
kiwidude Calibre Plugins Developer Posts: 4,636 Karma: 2162064 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	v1.6.1 Released Changes in this release: If a book has zero words, just display an error in log rather than storing zero in the column

07-19-2012, 02:05 AM	#373
bauerhjb Connoisseur Posts: 52 Karma: 19 Join Date: Apr 2010 Location: northern Idaho, USA Device: laptop, netbook, LG & Nextus tablets - Window 10, 8.1, 7,	Hi I just installed v1.6.1 and it shows all books as having zero words. Counts the pages ok. Any idea why it might do this? The version before worked great for pdfs. I even re-did some counts as a check between this version and the one before. Books that had word counts previously now show zero words. Don't mean to complain. Is there a chance of getting the previous version to use instead? Using calibre 8.60, windows vista (no cracks please..) Thanks for all the great work you do on these plugins. Last edited by bauerhjb; 07-19-2012 at 02:11 AM. Reason: added system & calibre version

07-19-2012, 05:47 AM	#374
kiwidude Calibre Plugins Developer Posts: 4,636 Karma: 2162064 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	v1.6.2 Released Changes in this release: Make the html tag removal for body tag data case insensitive to fix issue with PDF conversions from 1.6.0 @bauerhjb - thx for bringing this to my attention, it would have been broken with the changes in 1.6.0. I don't store PDFs in my main library so I hadn't noticed it.

07-13-2012, 10:19 AM	#362
kiwidude Calibre Plugins Developer Posts: 4,636 Karma: 2162064 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	@Boekenworm, I will make sure the URL link is corrected. The url I had was correct in its raw form in the code but it got "double encoded" to become incorrect. I think I will just put a minimum width on the dialog (rather than a mnimum height) and that should stop the resizing/word-wrap issue on that Readability statistics line. Glad to hear it is doing what you asked for. I'll officially release it tonight or tomorrow.

07-14-2012, 11:41 AM	#363
JimmXinu Plugin Developer Posts: 6,312 Karma: 3966249 Join Date: Dec 2011 Location: Midwest USA Device: Kindle Paperwhite(10th)	FYI, the tooltip on 'Always overwrite an existing word/page count' needs some line wrapping. It's wider than my whole screen. Is there supposed to be more than one Word count algorithm available? I'm only seeing one.

07-14-2012, 11:48 AM	#364
kiwidude Calibre Plugins Developer Posts: 4,636 Karma: 2162064 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	Tooltip works fine on my triple monitor setup. The dropdown has gone from the code for the official release but well spotted...

07-15-2012, 09:43 PM	#367
PeterT Grand Sorcerer Posts: 12,162 Karma: 73448616 Join Date: Nov 2007 Location: Toronto Device: Nexus 7, Clara, Touch, Tolino EPOS	@snarkophilus: Not sure why you bother with word and page count on this book; you KNOW it's 42 for either one.

07-16-2012, 03:08 AM	#368
odinokij Enthusiast Posts: 29 Karma: 10 Join Date: Jul 2012 Device: Kindle 3	Thanks a lot, kiwidude, for your prompt support for cbr/cbz files. It works great. Thanks again.

07-16-2012, 07:49 AM	#369
kiwidude Calibre Plugins Developer Posts: 4,636 Karma: 2162064 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	@snarkophilus - I've made a change for the next version which will do as you suggest of aborting calculating statistics for that particular book and printing why in the log. In that situation you displayed it would still store a page count, but it would leave any other word count or readability statistics untouched. So if you haven't yet set a value, they will stay blank, and if it already has a value, that will stay as it is. I'll hold off on releasing the change for a few days to see if anything else comes up.

07-16-2012, 02:20 PM	#370
lbolton Junior Member Posts: 5 Karma: 10 Join Date: Dec 2010 Device: android	Hi. Like many, I've scoured the intermess to find, assemble and manage a large collection. Though I don't use it often, My wife is temporarily homebound and has found this a significant comfort. Your plugin is one of the most useful tools I've found, and I've quickly come to rely on it heavily. I've recently noted some behaviors that may not have been mentioned here. I've included some representative log entries. My system is: Opensuse 12.12 KDE 4.7.2 Calibre 0.8.60 First, starting with the plugin versions available on 0.8.59, And, using any of the three algorithms available, scanning an entry with ONLY a pdf file, will give a valid page count, but a word count of 0 (zero). I haven't diagnosed this extensively. If I could relearn python, I'd have just helped rather then begged. Second, unfortunately, the new word count WILL overwrite an older. no matter what settings are used. Third, I'm sure its been noticed, but there seems to be a number of unicode characters that throw a fatal error that will abort a job. Most especially, I seem to have a large number of files originally encoded to include: a particular rendition of single quotes with codes of \u2018 and \u2019. Though there are many others. I would like to join other voices in encouraging a few enhancements to overcome these. I wonder if there are not python libraries that more gracefully or completely handle some of these problematic characters. Or, include a user accessible enumerated list of potentially incorrect characters with an appropriate mapping. Or, mayhap, Both? I'd like to imagine that a list of exceptions or replacement rules could be called from calibre's existing conversion tools. I wonder if it's possible to simply log such errors without aborting the job. I wonder if it may be possible to allow an option to simply keep the epub conversion created to enable the count of PDFs. log follows. ----------------------------------------cut--------------------------------------- --------------------------------------------cut--------------------------------------- shire:~ # calibre-debug --gui Starting up... Started up in 6.74 seconds with 10029 books Job: 1 Get device information started DeviceJob: 1 Get device information done, calling callback DeviceJob: 1 Get device information callback returned Job: 2 Get list of books on device started DEBUG: 0.0 USBMS: Fetching list of books from device. Device= FOLDER_DEVICE oncard= None DEBUG: 0.0 USBMS: dirs are: /local/staging/ DEBUG: 0.0 USBMS: scan from root False /local/staging/ DEBUG: 0.0 USBMS: count found in cache: 43, count of files in metadata: 43, need_sync: False DEBUG: 0.0 USBMS: Finished fetching list of books from device. oncard= None DEBUG: 0.1 USBMS: Fetching list of books from device. Device= FOLDER_DEVICE oncard= carda DEBUG: 0.1 USBMS: Fetching list of books from device. Device= FOLDER_DEVICE oncard= cardb DeviceJob: 2 Get list of books on device done, calling callback Job: 1 Get device information finished No details available. Job: 2 Get list of books on device finished No details available. DeviceJob: 2 Get list of books on device callback returned Job: 2 Get list of books on device finished No details available. Worker Launch took: 0.23487496376 InputFormatPlugin: EPUB Input running on /local/books/James Patrick Kelly/10 16 to 1 (4098)/10 16 to 1 - James Patrick Kelly.epub Found HTML cover titlepage.xhtml QPainter::begin: Paint device returned engine == 0, type: 2 QPainter::setCompositionMode: Painter not active QPainter::begin: Paint device returned engine == 0, type: 2 QPainter::begin: Paint device returned engine == 0, type: 2 QPainter::setCompositionMode: Painter not active QPainter::begin: Paint device returned engine == 0, type: 2 /usr/bin/xdg-open: line 322: test: KDE Development Platform: 4.7.2 (4.7.2) "release 5": integer expression expected /usr/bin/xdg-open: line 323: test: KDE Development Platform: 4.7.2 (4.7.2) "release 5": integer expression expected /usr/bin/xdg-open: line 324: test: KDE Development Platform: 4.7.2 (4.7.2) "release 5": integer expression expected (process:11870): GLib-CRITICAL : g_main_context_pop_thread_default: assertion `g_queue_peek_head (stack) == context' failed Worker Launch took: 0.245404005051 Job: 4 Convert book 1 of 1 (10 16 to 1) finished Convert book 1 of 1 (10 16 to 1) Resolved conversion options calibre version: 0.8.60 {'asciiize': False, .................deleted---------------- No TOC, MOBI index not generated MOBI output written to /tmp/calibre_0.8.60_tmp_bbWOxU/QZ_OuQ.mobi (process:11848): GLib-CRITICAL : g_main_context_pop_thread_default: assertion `g_queue_peek_head (stack) == context' failed (process:11848): GLib-CRITICAL **: g_main_context_pop_thread_default: assertion `g_queue_peek_head (stack) == context' failed shire:~ # -------------------------------------------------cut------------------------------------- TIA

07-16-2012, 02:42 PM	#371
kiwidude Calibre Plugins Developer Posts: 4,636 Karma: 2162064 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	@lbolton 1. You will get a word count of zero for PDFs that contain image pages (that haven't been OCR'd). 2. With the change I have mentioned in post right before yours the next release of the plugin will treat a zero word count as an "error" situation in that it will just write a message to the log and not write zero into the custom column. 3. Any issues to do with PDF conversions are nothing to do with this plugin. They are calibre/PDF library issues. If you have a specific pdf that causes a fault with this plugin, you will almost certainly get the same fault when you use calibre to do a PDF-> EPUB conversion. As such follow the official calibre support routes - you can raise a ticket, attach the PDF in question and it is possible someone will take a look at it. If calibre can convert the PDF without crashing, so should this plugin. 4. Keeping the temporary PDF to count pages is not going to happen. If you want an EPUB version, convert before you count pages, and this plugin will then work with that EPUB. As has been well documented PDF-> EPUB versions generally suck and require much editing and tuning to look anything like the original - what this plugin produces is designed only for the purposes of estimating a word count, not human readability. 5. As per my answers in 3, I'm afraid the log isn't something I can do anything about.

07-20-2012, 04:35 PM	#375
Josieb1 Grand Sorcerer Posts: 5,009 Karma: 18018738 Join Date: Nov 2009 Location: UK Device: Kobo Forma, Libra2, Clara 2e, Kindle PW SE & Kindle 2022	Hi I have just downloaded the new update to this plug in and I now get page counts not word counts, for mobi files, even though my settings appear to be on word count. Can anyone help please? I really need word counts back

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] Quality Check	kiwidude	Plugins	1184	04-17-2024 06:17 PM
[GUI Plugin] Open With	kiwidude	Plugins	403	04-01-2024 08:39 AM
[GUI Plugin] Quick Preferences	kiwidude	Plugins	62	03-16-2024 11:47 PM
[GUI Plugin] Kindle Collections (old)	meme	Plugins	2070	08-11-2014 12:02 AM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 12:27 PM

Advert

Advert