[GUI Plugin] Count Pages

[pakz]

You were correct.
After waiting a while to get unblocked, I could successfully get page counts for books when I querried one at a time.
Already taking 3 at once seems to hit the barrier. So, I'll be taking it slow. Still gonna be so much faster than doing everything manually.

Thanks so much for the quick response and your efforts in maintaining the plugin!

[sup]

Is it ((or would it be) possible to discount sections titled "bibliography" "index", "notes" and "table of contents" (and possibly "acknowledgements")? Frequently, in non-fiction books, these can run up to half of the actual content so a book that is over 500 pages (as my Kindle counts) ends up being around 300 pages of actual content that I would read.

[davidfor]

Originally Posted by sup

Is it ((or would it be) possible to discount sections titled "bibliography" "index", "notes" and "table of contents" (and possibly "acknowledgements")? Frequently, in non-fiction books, these can run up to half of the actual content so a book that is over 500 pages (as my Kindle counts) ends up being around 300 pages of actual content that I would read.

No. And I'm not very interested in adding the function.

[sup]

Ok, thanks for the fast reply. I looked into the code and decided I can live without it for the time being:-).

I noticed that when I click the plugin button with no value in my custom column, it calculates the page count using any of the available algorithms. When I click the button again, it recalculates a thta seems to be a word count (102 337). Is that intentional? To me it seems like a bug.

When I use "e-book viewer (Calibre)" algorithm, it reports 645 as opposed to 538 reported by the actual viewer. Should these not be the same?

When I use the "Paragraphs (APNX accurate)", it reports 381. My Kindle actually reports 457 pages. Is there a way to match these two? All my books on my Kindle are actually generated in Calibre so they have a Calibre-generated APNX file.

The books are all in azw3 format.

EDIT: as per Kindle - I see I could use the number generated by the plugin and supply that to the Kindle. But actually the page numbers on the Kindle closely correspond to actual page turns (I use small font size with little margins and it pretty much corresponds with a page count increasing almost every page turn), which is something I like. So is it possible to do it the other way around?

EDIT2: Hm, in the Kindle 2/3/4/Touch Device plugin, I have checked "Send page number informatino when sending books" and it was set to "fast" method. That should amount to 2300 characters. When I use the "custom (char per page)" algorithm in the Count Pages plugin with 2300, it gives 289 pages, which is much less. 2300/(457/289) gives 1454, but when the custom value to 1454, it gave me 448 pages. I guess the Count Pages plugin and Kindle plugin count slightly different things.

EDIT3: When I try it on another ebook, the numbers are still off, but in different ratios, so the custom algorithm does not really help me.

[davidfor]

I have just updated the plugin to version 1.11.1 The changes in this version are:

• Update: Changes to download page count for lubimyczytac.pl - thanks to BeckyEbook.

As usual, calibre will announce the update in the next hour or so. And if there are any problems, please report them here.

[nqk]

Originally Posted by davidfor

I have just updated the plugin to version 1.11.1 The changes in this version are:

• Update: Changes to download page count for lubimyczytac.pl - thanks to BeckyEbook.

As usual, calibre will announce the update in the next hour or so. And if there are any problems, please report them here.

Dear Davidfor,

Does it support the "calibre pages" now? I hope you would support that if you haven't already.

[davidfor]

Originally Posted by nqk

Does it support the "calibre pages" now? I hope you would support that if you haven't already.

No, I haven't looked at that yet. It hasn't been a priority as it isn't used by anything else.

[nqk]

Originally Posted by davidfor

No, I haven't looked at that yet. It hasn't been a priority as it isn't used by anything else.

Ít is used by the Viewer and more importantly the Browser Viewer, which is consistent in all devices. I hope you will give ... Calibre viewers a chance.

[davidfor]

Originally Posted by nqk

Ít is used by the Viewer and more importantly the Browser Viewer, which is consistent in all devices. I hope you will give ... Calibre viewers a chance.

I did have a look at it over the weekend. Getting to how calibre does it is a little convoluted and I don't want to reimplement it. I'll look at it again soon, but, don't hold your breath.

[McStubb]

Any chance you can create a way to break/batch large number of word count jobs up?

Lets say I have 2,000 books. I select them all, and request word counts, Instead of having 1 job with 2000 books, I would get 20 jobs with 100 books each?

Would allow better utilization of parallel jobs, and in the event that Calibre is closed only the affected small segments fail, since you are not waiting on the full 2,000 book job to finish to record every count.

[theducks]

YOU can queue smaller groups without waiting for the previous to complete. eg 1-20, 21-40...

[davidfor]

@McStubb: Sorry, that is not something I am interested in adding. It isn't hard to do manually, and honestly, there isn't a real reason not to do them all at once. I don't think I have done 2000 in a batch, but, I have done several hundred with no issues.

[McStubb]

Originally Posted by theducks

YOU can queue smaller groups without waiting for the previous to complete. eg 1-20, 21-40...

I know that, and thats what I have been doing, but when you are trying to process 50,000 books, trying to cut a few corners speeds things up.

I was trying to do this in larger batches, but occasionally Calibre randomly closes, and any progress on active jobs gets lost.

[theducks]

Originally Posted by McStubb

I was trying to do this in larger batches, but occasionally Calibre randomly closes, and any progress on active jobs gets lost.

That might be a side effect of trying huge chunks. You run out of resources (cleanup tends to only happen at the task end).
I can't remember the last time Calibre did an ABEND and I have done 200 items tasks (mostly Modify EPUB, Quality check inspired corrections, with multiple of those queued.

[Joliet Jake]

I've been using this plugin for a few months, and suddenly it failed.

Today I added the custom column "read" and started going through my library. At one point I encountered a book that still had DRM on it. (An Epub, in fact.) Afterward the plugin stopped working.

I restarted Calibre but the plugin still doesn't work. I'm not sure what I did wrong. (Calibre maintains previous counts, but will not add new ones.)

Also, does anyone know how to change column names? For some reason it says "words" when it means "pages".

Count Page/Word Statistics
do_count_statistics - book_path=C:\Users\[name]\AppData\Local\Temp\calibre_dcjnjy\7jz7ju_count_pa ges\530.epub, pages_algorithm=0, page_count_mode=Estimate, statistics_to_run=[u'PageCount'], custom_chars_per_page=1500, icu_wordcount=True
do_count_statistics - job started for file book_path=C:\Users\[name]\AppData\Local\Temp\calibre_dcjnjy\7jz7ju_count_pa ges\530.epub
-------------------------------
Logfile for book ID 530 (Your Money or Your Life: 9 Steps to Transforming Your Relationship With Money and Achieving Financial Independence: Fully Revised and Updated for 2018)
Method of counting _page_count_mode=Estimate _download_sources=[]
results= {}
530
do_statistics_for_book: C:\Users\[name]\AppData\Local\Temp\calibre_dcjnjy\7jz7ju_count_pa ges\530.epub 0 Estimate [] [u'PageCount'] 1500 True
Traceback (most recent call last):
File "calibre_plugins.count_pages.jobs", line 155, in do_statistics_for_book
File "calibre_plugins.count_pages.statistics", line 56, in get_page_count
File "calibre_plugins.count_pages.statistics", line 95, in _open_epub_file
File "site-packages\calibre\ebooks\oeb\iterator\book.py", line 148, in __enter__
File "site-packages\calibre\ebooks\oeb\iterator\book.py", line 87, in run_extract_book
File "site-packages\calibre\utils\ipc\simple_worker.py", line 262, in fork_job
File "site-packages\calibre\utils\ipc\simple_worker.py", line 186, in run_job
File "site-packages\calibre\utils\ipc\simple_worker.py", line 123, in communicate
WorkerError: Worker failed

I am using Calibre 4.23.