Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 10-11-2019, 09:12 AM   #1291
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,115
Karma: 60406498
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
I use the LACK of a page count as a FLAG that I have not done cleanup on that books code (really sloppy code does seem to affect the count).
I must say: "How hard is it to select a group of books, and click the Count Pages Icon?" Seriously , There are a lot more time consuming tasks that I do for every book. Note: I do cherry-pick and massage every books metadata
theducks is offline   Reply With Quote
Old 10-11-2019, 10:06 AM   #1292
giddie
Member
giddie began at the beginning.
 
giddie's Avatar
 
Posts: 19
Karma: 10
Join Date: Jan 2017
Location: Birmingham, UK
Device: Kobo Aura H2O
Thanks for the answers guys. I was wondering if the ADE algorithm might be doing something clever, but it looks like it's not particularly smart. I'm getting more consistent results from the character count method, presumably because it's stripping tags around content.

Yeah, I'm pretty happy with things as they stand. Davidfor: thanks for maintaining the plugin. I'm a software engineer myself, though I'm a Ruby dev and as such have so far managed to avoid Python Having said that, I'll dive in to this plugin if I find some time!
giddie is offline   Reply With Quote
Old 10-12-2019, 06:41 PM   #1293
chinax
Member
chinax composes epic poetry in binary.chinax composes epic poetry in binary.chinax composes epic poetry in binary.chinax composes epic poetry in binary.chinax composes epic poetry in binary.chinax composes epic poetry in binary.chinax composes epic poetry in binary.chinax composes epic poetry in binary.chinax composes epic poetry in binary.chinax composes epic poetry in binary.chinax composes epic poetry in binary.
 
Posts: 24
Karma: 90156
Join Date: Jul 2017
Device: Nook Glowlight, Sony DPT-CP1
Quote:
Originally Posted by giddie View Post
[*] Would it be possible to have the plugin queue separate jobs for each book, so that it's easier to see progress?
[/LIST]
I just set up a keyboard shortcut to more quickly queue
chinax is offline   Reply With Quote
Old 10-31-2019, 04:24 AM   #1294
Penny_Dreadful
She/Her
Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.
 
Penny_Dreadful's Avatar
 
Posts: 87
Karma: 142774
Join Date: Aug 2009
Location: Perth, Australia
Device: Kindle PW5 (G001PX) PW3 PW1
Is there any way to set this up so if it's grabbing the page number data from GoodReads with a GoodReads ID, that it doesn't need a file? I put every book I read in Calibre eBooks, Kindle Unlimited, paperbacks etc. and I'd like to have page numbers for the "empty" books as well, but if there isn't a file it throws this error.

calibre, version 4.2.0
WARNING: Page/word/statistics warnings: Could not analyse some statistics in 1 of 1 books, for reasons shown in details below.
The Magestaff (No convertible format found)

Thanks!
Penny_Dreadful is offline   Reply With Quote
Old 10-31-2019, 09:19 AM   #1295
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,115
Karma: 60406498
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by Penny_Dreadful View Post
Is there any way to set this up so if it's grabbing the page number data from GoodReads with a GoodReads ID, that it doesn't need a file? I put every book I read in Calibre eBooks, Kindle Unlimited, paperbacks etc. and I'd like to have page numbers for the "empty" books as well, but if there isn't a file it throws this error.

calibre, version 4.2.0
WARNING: Page/word/statistics warnings: Could not analyse some statistics in 1 of 1 books, for reasons shown in details below.
The Magestaff (No convertible format found)

Thanks!
Penny
By any chance, are you ALSO using one or more of the 'Readability" options?
Those use/need the book file.
theducks is offline   Reply With Quote
Old 10-31-2019, 09:30 AM   #1296
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 24,905
Karma: 47303824
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
Quote:
Originally Posted by theducks View Post
Penny
By any chance, are you ALSO using one or more of the 'Readability" options?
Those use/need the book file.
The word count does as well.

But, this is something I've been meaning to look at. It probably should do the stats it can based on the options and files available. Downloading the page count when there isn't a file should work.

But, no promises as to when it is done.
davidfor is offline   Reply With Quote
Old 11-01-2019, 03:32 AM   #1297
Penny_Dreadful
She/Her
Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.Penny_Dreadful is my North, my South, my East and West.
 
Penny_Dreadful's Avatar
 
Posts: 87
Karma: 142774
Join Date: Aug 2009
Location: Perth, Australia
Device: Kindle PW5 (G001PX) PW3 PW1
Quote:
Originally Posted by davidfor View Post
The word count does as well.

But, this is something I've been meaning to look at. It probably should do the stats it can based on the options and files available. Downloading the page count when there isn't a file should work.

But, no promises as to when it is done.
Ah I'm not using any Readability options but I'd forgotten that I use the word count to figure out the time to read.

Still if eventually I could get page count for empty books that would be brilliant, thanks for even looking at it Davidfor.
Penny_Dreadful is offline   Reply With Quote
Old 11-10-2019, 01:04 PM   #1298
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,005
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
FYI,

I don't know what's causing it, but from the Get Plugins dialog, right-click Version History fails for this plugin. It works for all the other plugins I tried.

I suspect the plugin forum page parser is unhappy about something minor in the Version History section of the first post. November vs Nov maybe?
JimmXinu is offline   Reply With Quote
Old 11-10-2019, 03:42 PM   #1299
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,115
Karma: 60406498
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by JimmXinu View Post
FYI,

I don't know what's causing it, but from the Get Plugins dialog, right-click Version History fails for this plugin. It works for all the other plugins I tried.

I suspect the plugin forum page parser is unhappy about something minor in the Version History section of the first post. November vs Nov maybe?
I edited it for you
theducks is offline   Reply With Quote
Old 11-10-2019, 08:38 PM   #1300
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 24,905
Karma: 47303824
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
Update to version 1.9.0

For those who haven't noticed, I released an update to this plugin yesterday. The changes in it are:
  • New: Add download page count from Skoob - thanks to @thiago.eec.
  • New: Allow a regex for extracting the page count when downloading from a web site.
  • Fix: Ignore error for books that have been removed since count job was started.
  • Update: Changes to download page count for lubimyczytac.pl - thanks to BeckyEbook.
  • Change: Don't error if downloading page count and calculation is set to ADE algorithm.
  • Fix: Warning when formats missing was repeating.

The first three are in the last beta I posted. The latter are changes since then.

Calibre should already have announced the update by now. If anyone sees any problems, please report them here.
davidfor is offline   Reply With Quote
Old 12-03-2019, 01:05 PM   #1301
keturn
Junior Member
keturn began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Dec 2019
Device: Kobo Aura
ICU is real slow

I've got an epub file here that took 115 minutes to count 1.84 million words.

With "ICU" un-checked, it takes about five seconds. (and the result is about 9% different.)

Is that expected behavior, or should we do some debugging?
keturn is offline   Reply With Quote
Old 12-04-2019, 07:13 PM   #1302
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 24,905
Karma: 47303824
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
Quote:
Originally Posted by keturn View Post
I've got an epub file here that took 115 minutes to count 1.84 million words.

With "ICU" un-checked, it takes about five seconds. (and the result is about 9% different.)

Is that expected behavior, or should we do some debugging?
I have to go with "wow". I happened to have a 1.4 million word book and it took 57 minutes on my work machine with ICU selected and 9 seconds without. I would expect the ICU method to be slower, but, I wasn't expecting that. I think it is something new as I did run the count on a 6 million word book a month or so ago, and I'm sure I was using the ICU count. Both the counts are done using methods built into calibre. I'll have to check an older version to see if it is different.

As to the difference in the result, that is to do with how the two algorithms define a word. This has been "discussed" in this thread a few times. No one won.
davidfor is offline   Reply With Quote
Old 12-04-2019, 09:47 PM   #1303
Bookstooge
Member Retired
Bookstooge ought to be getting tired of karma fortunes by now.Bookstooge ought to be getting tired of karma fortunes by now.Bookstooge ought to be getting tired of karma fortunes by now.Bookstooge ought to be getting tired of karma fortunes by now.Bookstooge ought to be getting tired of karma fortunes by now.Bookstooge ought to be getting tired of karma fortunes by now.Bookstooge ought to be getting tired of karma fortunes by now.Bookstooge ought to be getting tired of karma fortunes by now.Bookstooge ought to be getting tired of karma fortunes by now.Bookstooge ought to be getting tired of karma fortunes by now.Bookstooge ought to be getting tired of karma fortunes by now.
 
Posts: 805
Karma: 2091358
Join Date: May 2019
Device: Kindle Oasis 1st Gen, PB Era
Quote:
Originally Posted by davidfor View Post
As to the difference in the result, that is to do with how the two algorithms define a word. This has been "discussed" in this thread a few times. No one won.

I would go so far as to say that we all lost in that bit of forum'ness
Bookstooge is offline   Reply With Quote
Old 12-04-2019, 10:28 PM   #1304
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 46,845
Karma: 169712582
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
Quote:
Originally Posted by Bookstooge View Post
I would go so far as to say that we all lost in that bit of forum'ness
Save for those of us who relaxed and used the flames to make S'mores.
DNSB is online now   Reply With Quote
Old 12-05-2019, 08:54 AM   #1305
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 24,905
Karma: 47303824
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
Quote:
Originally Posted by davidfor View Post
I have to go with "wow". I happened to have a 1.4 million word book and it took 57 minutes on my work machine with ICU selected and 9 seconds without. I would expect the ICU method to be slower, but, I wasn't expecting that. I think it is something new as I did run the count on a 6 million word book a month or so ago, and I'm sure I was using the ICU count. Both the counts are done using methods built into calibre. I'll have to check an older version to see if it is different.

As to the difference in the result, that is to do with how the two algorithms define a word. This has been "discussed" in this thread a few times. No one won.
I tried this at home tonight, and the results were completely different. For the same book, it took less than 20 seconds. And was a little faster than the non-ICU word count.

I don't think it is the hardware. Home is Windows 10 laptop, with an I7 and 16GB of memory. At work it was a desktop running Ubuntu, which I think has 16GB of memory, I don't know the CPU, but, it isn't slow otherwise.
davidfor is offline   Reply With Quote
Reply

Tags
count, count pages, page count, pages, plugin


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Quality Check kiwidude Plugins 1252 08-02-2025 09:53 AM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 05:42 AM
[GUI Plugin] Quick Preferences kiwidude Plugins 62 03-16-2024 11:47 PM
[GUI Plugin] Kindle Collections (old) meme Plugins 2070 08-11-2014 12:02 AM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 12:06 AM.


MobileRead.com is a privately owned, operated and funded community.