[GUI Plugin] Count Pages - Page 87

theducks · 10-11-2019, 10:12 AM

I use the LACK of a page count as a FLAG that I have not done cleanup on that books code (really sloppy code does seem to affect the count).
I must say: "How hard is it to select a group of books, and click the Count Pages Icon?" Seriously , There are a lot more time consuming tasks that I do for every book. Note: I do cherry-pick and massage every books metadata

giddie · 10-11-2019, 11:06 AM

Thanks for the answers guys. I was wondering if the ADE algorithm might be doing something clever, but it looks like it's not particularly smart. I'm getting more consistent results from the character count method, presumably because it's stripping tags around content.

Yeah, I'm pretty happy with things as they stand. Davidfor: thanks for maintaining the plugin. I'm a software engineer myself, though I'm a Ruby dev and as such have so far managed to avoid Python

Having said that, I'll dive in to this plugin if I find some time!

chinax · 10-12-2019, 07:41 PM

Quote:

Originally Posted by giddie

[*] Would it be possible to have the plugin queue separate jobs for each book, so that it's easier to see progress?
[/LIST]

I just set up a keyboard shortcut to more quickly queue

Penny_Dreadful · 10-31-2019, 05:24 AM

Is there any way to set this up so if it's grabbing the page number data from GoodReads with a GoodReads ID, that it doesn't need a file? I put every book I read in Calibre eBooks, Kindle Unlimited, paperbacks etc. and I'd like to have page numbers for the "empty" books as well, but if there isn't a file it throws this error.

calibre, version 4.2.0
WARNING: Page/word/statistics warnings: Could not analyse some statistics in 1 of 1 books, for reasons shown in details below.
The Magestaff (No convertible format found)

Thanks!

theducks · 10-31-2019, 10:19 AM

Quote:

Originally Posted by Penny_Dreadful

Is there any way to set this up so if it's grabbing the page number data from GoodReads with a GoodReads ID, that it doesn't need a file? I put every book I read in Calibre eBooks, Kindle Unlimited, paperbacks etc. and I'd like to have page numbers for the "empty" books as well, but if there isn't a file it throws this error.

calibre, version 4.2.0
WARNING: Page/word/statistics warnings: Could not analyse some statistics in 1 of 1 books, for reasons shown in details below.
The Magestaff (No convertible format found)

Thanks!

Penny
By any chance, are you ALSO using one or more of the 'Readability" options?
Those use/need the book file.

davidfor · 10-31-2019, 10:30 AM

Quote:

Originally Posted by theducks

Penny
By any chance, are you ALSO using one or more of the 'Readability" options?
Those use/need the book file.

The word count does as well.

But, this is something I've been meaning to look at. It probably should do the stats it can based on the options and files available. Downloading the page count when there isn't a file should work.

But, no promises as to when it is done.

Penny_Dreadful · 11-01-2019, 04:32 AM

Quote:

Originally Posted by davidfor

The word count does as well.

But, this is something I've been meaning to look at. It probably should do the stats it can based on the options and files available. Downloading the page count when there isn't a file should work.

But, no promises as to when it is done.

Ah I'm not using any Readability options but I'd forgotten that I use the word count to figure out the time to read.

Still if eventually I could get page count for empty books that would be brilliant, thanks for even looking at it Davidfor.

JimmXinu · 11-10-2019, 02:04 PM

FYI,

I don't know what's causing it, but from the Get Plugins dialog, right-click Version History fails for this plugin. It works for all the other plugins I tried.

I suspect the plugin forum page parser is unhappy about something minor in the Version History section of the first post. November vs Nov maybe?

theducks · 11-10-2019, 04:42 PM

Quote:

Originally Posted by JimmXinu

FYI,

I don't know what's causing it, but from the Get Plugins dialog, right-click Version History fails for this plugin. It works for all the other plugins I tried.

I suspect the plugin forum page parser is unhappy about something minor in the Version History section of the first post. November vs Nov maybe?

I edited it for you

davidfor · 11-10-2019, 09:38 PM

For those who haven't noticed, I released an update to this plugin yesterday. The changes in it are:

New: Add download page count from Skoob - thanks to @thiago.eec.
New: Allow a regex for extracting the page count when downloading from a web site.
Fix: Ignore error for books that have been removed since count job was started.
Update: Changes to download page count for lubimyczytac.pl - thanks to BeckyEbook.
Change: Don't error if downloading page count and calculation is set to ADE algorithm.
Fix: Warning when formats missing was repeating.

The first three are in the last beta I posted. The latter are changes since then.

Calibre should already have announced the update by now. If anyone sees any problems, please report them here.

keturn · 12-03-2019, 02:05 PM

I've got an epub file here that took 115 minutes to count 1.84 million words.

With "ICU" un-checked, it takes about five seconds. (and the result is about 9% different.)

Is that expected behavior, or should we do some debugging?

davidfor · 12-04-2019, 08:13 PM

Quote:

Originally Posted by keturn

I've got an epub file here that took 115 minutes to count 1.84 million words.

With "ICU" un-checked, it takes about five seconds. (and the result is about 9% different.)

Is that expected behavior, or should we do some debugging?

I have to go with "wow". I happened to have a 1.4 million word book and it took 57 minutes on my work machine with ICU selected and 9 seconds without. I would expect the ICU method to be slower, but, I wasn't expecting that. I think it is something new as I did run the count on a 6 million word book a month or so ago, and I'm sure I was using the ICU count. Both the counts are done using methods built into calibre. I'll have to check an older version to see if it is different.

As to the difference in the result, that is to do with how the two algorithms define a word. This has been "discussed" in this thread a few times. No one won.

Bookstooge · 12-04-2019, 10:47 PM

Quote:

Originally Posted by davidfor

As to the difference in the result, that is to do with how the two algorithms define a word. This has been "discussed" in this thread a few times. No one won.

I would go so far as to say that we all lost in that bit of forum'ness

DNSB · 12-04-2019, 11:28 PM

Quote:

Originally Posted by Bookstooge

I would go so far as to say that we all lost in that bit of forum'ness

Save for those of us who relaxed and used the flames to make S'mores.

davidfor · 12-05-2019, 09:54 AM

Quote:

Originally Posted by davidfor

I have to go with "wow". I happened to have a 1.4 million word book and it took 57 minutes on my work machine with ICU selected and 9 seconds without. I would expect the ICU method to be slower, but, I wasn't expecting that. I think it is something new as I did run the count on a 6 million word book a month or so ago, and I'm sure I was using the ICU count. Both the counts are done using methods built into calibre. I'll have to check an older version to see if it is different.

As to the difference in the result, that is to do with how the two algorithms define a word. This has been "discussed" in this thread a few times. No one won.

I tried this at home tonight, and the results were completely different. For the same book, it took less than 20 seconds. And was a little faster than the non-ICU word count.

I don't think it is the hardware. Home is Windows 10 laptop, with an I7 and 16GB of memory. At work it was a desktop running Ubuntu, which I think has 16GB of memory, I don't know the CPU, but, it isn't slow otherwise.

11-10-2019, 09:38 PM	#1300
davidfor Grand Sorcerer Posts: 23,231 Karma: 41975128 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	Update to version 1.9.0 For those who haven't noticed, I released an update to this plugin yesterday. The changes in it are: New: Add download page count from Skoob - thanks to @thiago.eec. New: Allow a regex for extracting the page count when downloading from a web site. Fix: Ignore error for books that have been removed since count job was started. Update: Changes to download page count for lubimyczytac.pl - thanks to BeckyEbook. Change: Don't error if downloading page count and calculation is set to ADE algorithm. Fix: Warning when formats missing was repeating. The first three are in the last beta I posted. The latter are changes since then. Calibre should already have announced the update by now. If anyone sees any problems, please report them here.

12-03-2019, 02:05 PM	#1301
keturn Junior Member Posts: 1 Karma: 10 Join Date: Dec 2019 Device: Kobo Aura	ICU is real slow I've got an epub file here that took 115 minutes to count 1.84 million words. With "ICU" un-checked, it takes about five seconds. (and the result is about 9% different.) Is that expected behavior, or should we do some debugging?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] Open With	kiwidude	Plugins	386	11-24-2021 01:38 AM
[GUI Plugin] Quality Check	kiwidude	Plugins	1093	09-27-2021 12:19 PM
[GUI Plugin] Quick Preferences	kiwidude	Plugins	49	04-05-2021 05:30 AM
[GUI Plugin] Kindle Collections (old)	meme	Plugins	2070	08-11-2014 01:02 AM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 01:27 PM

10-11-2019, 10:12 AM	#1291
theducks Well trained by Cats Posts: 26,905 Karma: 41870062 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Aura2, K4NT(Fixed: New Bat.), Galaxy Tab A	I use the LACK of a page count as a FLAG that I have not done cleanup on that books code (really sloppy code does seem to affect the count). I must say: "How hard is it to select a group of books, and click the Count Pages Icon?" Seriously , There are a lot more time consuming tasks that I do for every book. Note: I do cherry-pick and massage every books metadata

10-11-2019, 11:06 AM	#1292
giddie Member Posts: 16 Karma: 10 Join Date: Jan 2017 Location: Birmingham, UK Device: Kobo Aura H2O	Thanks for the answers guys. I was wondering if the ADE algorithm might be doing something clever, but it looks like it's not particularly smart. I'm getting more consistent results from the character count method, presumably because it's stripping tags around content. Yeah, I'm pretty happy with things as they stand. Davidfor: thanks for maintaining the plugin. I'm a software engineer myself, though I'm a Ruby dev and as such have so far managed to avoid Python Having said that, I'll dive in to this plugin if I find some time!

10-31-2019, 05:24 AM	#1294
Penny_Dreadful Connoisseur Posts: 67 Karma: 27856 Join Date: Aug 2009 Location: Perth, Australia Device: Kindle PW5 (G001PX)	Is there any way to set this up so if it's grabbing the page number data from GoodReads with a GoodReads ID, that it doesn't need a file? I put every book I read in Calibre eBooks, Kindle Unlimited, paperbacks etc. and I'd like to have page numbers for the "empty" books as well, but if there isn't a file it throws this error. calibre, version 4.2.0 WARNING: Page/word/statistics warnings: Could not analyse some statistics in 1 of 1 books, for reasons shown in details below. The Magestaff (No convertible format found) Thanks!

11-10-2019, 02:04 PM	#1298
JimmXinu Plugin Developer Posts: 5,097 Karma: 876216 Join Date: Dec 2011 Location: Midwest USA Device: Kindle Voyage	FYI, I don't know what's causing it, but from the Get Plugins dialog, right-click Version History fails for this plugin. It works for all the other plugins I tried. I suspect the plugin forum page parser is unhappy about something minor in the Version History section of the first post. November vs Nov maybe?