[GUI Plugin] Count Pages

[BetterRed]

See ==>> https://www.mobileread.com/forums/sh...&postcount=687

DeDRM also runs when you view an eBook.

BR

[matp]

Originally Posted by BetterRed

See ==>> https://www.mobileread.com/forums/sh...&postcount=687

Not sure I understand. The books were added to calibre library without error. I understand that does NOT mean that DRM was removed in the process (as there was no conversion I am aware of, just import to library).

When viewing book with the calibre e-book reader I understand that deDRM is potentially working there too.

Almost all of the 6k books have DRM at this point as I have not converted any.

So PageCount plugin IS working for 100% of certain formats (even though they have DRM) and not for other formats. All formats do open fine with calbre e-book reader.

What am I missing here?

[theducks]

Originally Posted by matp

Not sure I understand. The books were added to calibre library without error. I understand that does NOT mean that DRM was removed in the process (as there was no conversion I am aware of, just import to library).

When viewing book with the calibre e-book reader I understand that deDRM is potentially working there too.

Almost all of the 6k books have DRM at this point as I have not converted any.

So PageCount plugin IS working for 100% of certain formats (even though they have DRM) and not for other formats. All formats do open fine with calbre e-book reader.

What am I missing here?

Depends on if the PI is set to Count YOUR library copy or LOOK UP on a 3rd party site for a count.
It can't count a DRM encumbered book (that can't be decrypted using the other PI)

[BetterRed]

Originally Posted by matp

Not sure I understand. The books were added to calibre library without error. I understand that does NOT mean that DRM was removed in the process (as there was no conversion I am aware of, just import to library).

When viewing book with the calibre e-book reader I understand that deDRM is potentially working there too.

Almost all of the 6k books have DRM at this point as I have not converted any.

So PageCount plugin IS working for 100% of certain formats (even though they have DRM) and not for other formats. All formats do open fine with calbre e-book reader.

What am I missing here?

My reading of your posts seemed to assume that because the books could be accessed by the viewer the DRM must have been removed when the books were added. Just wanted to let you know that is a false assumption.

BR

[matp]

Originally Posted by theducks

Depends on if the PI is set to Count YOUR library copy or LOOK UP on a 3rd party site for a count.
It can't count a DRM encumbered book (that can't be decrypted using the other PI)

Set to "estimate" using algorithm calibre e-book viewer. i.e. no lookup from goodreads or whatever.

All these books open fine with calibre e-book reader. i.e. no DRM encumbrance that the other PI doesn't handle.

The issue is on a format basis, not specific book basis. All formats are DRM encumbered. Only some of these formats the count pages plugin has trouble with (all books of a problem format). The other formats (also DRM encumbered), the count pages plugin has no issue counting pages. And NONE of the formats has any issue opening in calibre e-book reader (ie no plugin/DRM issue from calibre/other-PI's point of view).

I was afraid the DRM topic was going to become a bit of a distraction. Maybe it is related, but the bottom line is that calibre e-book reader and the "other PI" have no problem with ANY of these books. Only the count pages plugin has problems with certain formats (all books in a problem format fail).

Is this plugin open source in an online source repo somewhere where I can just take a look? That might be faster vector to track down the problem.

[matp]

Originally Posted by BetterRed

My reading of your posts seemed to assume that because the books could be accessed by the viewer the DRM must have been removed when the books were added. Just wanted to let you know that is a false assumption.

Thanks. I am aware but can see how that might not have been clear.

The assumption I'm making (obviously incorrectly) is that if calibre e-book reader (with assistance of whatever other plugins) has no trouble opening and paginating a book... that count pages plugin, when relying on the calibre e-book viewer "algorithm" would use the same code path and also not have any trouble.

Indeed when it comes to DRM, for certain formats (azw3, etc) count pages plugin does NOT have issue with this method. But for the other formats it does (even though calibre e-book viewer does not have any problem with those other formats).

I agree that if I convert (e.g. to epub stripping DRM in process) that count pages plugin will probably count the epub format fine...since this seems to be a format-specific issue for the count pages plugin (azw, azw4, htmlz, kfx).

Was hoping to resolve the issue so that count pages plugin could use calibre e-book viewer for all supported formats to count pages before needing to do a full library conversion that I will do at some point in the future.

Maybe the answer here is that the formats that don't have a problem DID actually (for unknown reason) have the DRM stripped during library import (could disable the "other plugin" and see if I can still view them). And the second part would be that the count pages plugin does not use the same code path as the calibre e-book viewer does and so does not benefit from the other plugin making the file accessible, meaning count pages plugin really only works on files that already have DRM removed, rather than any files the calibre viewer can access.

[BetterRed]

Originally Posted by matp

Is this plugin open source in an online source repo somewhere where I can just take a look? That might be faster vector to track down the problem.

You already have the source, it's in the Count Pages.zip.

And there's a link to the author's repository in the first post of this thread Ψ³

BR

[JSWolf]

Originally Posted by matp

calibre, version 7.26.0
count pages version 1.13.6

Spot checking some of these books, they all open and paginate fine with the calibre e-book viewer.

One book for example, calibre library says it is format "azw" (not azw3 for whatever reason). It opens fine in the Calibre e-book viewer (viewer title bar says KF8).

I suspect it is because Calibre library is reporting these as format:azw instead of format:azw3 for some reason? Not sure why they imported that way when Calibre e-book viewer reports them as KF8 (same as azw3 right?).

The AZW eBooks still have DRM. DeDRM removes the DRM when you use the viewer if DRM still exists. What you have to do for each AZW eBook is use calibre to open the directory the eBook is in and copy it. Then delete the entry. Now add the eBook back to calibre. DRM should be removed.

[JSWolf]

Originally Posted by BetterRed

My reading of your posts seemed to assume that because the books could be accessed by the viewer the DRM must have been removed when the books were added. Just wanted to let you know that is a false assumption.

BR

DeDRM runs when you use the viewer. So the eBook can still have DRM and be viewed. The azw eBooks need to be readded to calibre to remove the DRM.

[theducks]

Originally Posted by matp

Set to "estimate" using algorithm calibre e-book viewer. i.e. no lookup from goodreads or whatever.

All these books open fine with calibre e-book reader. i.e. no DRM encumbrance that the other PI doesn't handle.

The issue is on a format basis, not specific book basis. All formats are DRM encumbered. Only some of these formats the count pages plugin has trouble with (all books of a problem format). The other formats (also DRM encumbered), the count pages plugin has no issue counting pages. And NONE of the formats has any issue opening in calibre e-book reader (ie no plugin/DRM issue from calibre/other-PI's point of view).

I was afraid the DRM topic was going to become a bit of a distraction. Maybe it is related, but the bottom line is that calibre e-book reader and the "other PI" have no problem with ANY of these books. Only the count pages plugin has problems with certain formats (all books in a problem format fail).

Is this plugin open source in an online source repo somewhere where I can just take a look? That might be faster vector to track down the problem.

The PI is the source. Just use a Unzip app that lets you look inside without actually doing it. Windows Explorer can do that nativly

[BetterRed]

Originally Posted by JSWolf

DeDRM runs when you use the viewer. So the eBook can still have DRM and be viewed. The azw eBooks need to be readded to calibre to remove the DRM.

Sheesh, Jon get some new glasses, or get back to kindergarten and learn how to read - I quoted your post!

Originally Posted by BetterRed

See ==>> https://www.mobileread.com/forums/sh...&postcount=687

BR

[matp]

I appreciate you all bearing with me while I try to sort this out.

Originally Posted by JSWolf

The AZW eBooks still have DRM. DeDRM removes the DRM when you use the viewer if DRM still exists. What you have to do for each AZW eBook is use calibre to open the directory the eBook is in and copy it. Then delete the entry. Now add the eBook back to calibre. DRM should be removed.

Okay. If I understand you and BetterRed, your explanation is the following...

1. count pages requires the DRM to be removed before it can work (ie it doesn't use the same code/plugin path that calibre e-book viewer uses to access the book data).
2. most of the ~6000 books I imported (all except ~200) had the DRM stripped by calibre during import to library and sit on disk DRM-free allowing count-pages to work.
3. For some reason ~200 books that were imported at the same time as the others did NOT have the DRM removed during import and so count-pages does not work on these books (even though the calibre e-book viewer does).
4. Presumably the problem appearing to be format-specific is because calibre changes the format during import if it successfully strips the DRM (e.g. azw4 and azw which don't count pages get turned into azw3 which does count pages in 100% of the books I have in that format).

As an experiment, I've disabled the deDRM plugin and restarted calibre to check the problem formats (problem formats meaning 100% of books of that format does not count pages vs non-problem formats meaning 100% of books of that format DO count pages). I obviously didn't try to open every single book of a format but just took a sample of 3 books per format. "opens fine" means it opens in calibre ebook viewer and is readable without any error or DRM message.

Problem formats (NONE of these books count pages)

• htmlz (10 books) - opens fine (no DRM)
• azw (13 books) - I get DRM message
• azw4 (11 books) - opens fine (no DRM)
• kfx (223 books) - opens fine (no DRM, I have kfx input plugin)

Okay formats (ALL of these books count pages)

• azw3 (6240 books) - opens fine (no DRM)
• mobi (385 books) - opens fine (no DRM)

So based on this test, it appears that only the 13 azw format books still have DRM (can't open with DeDRM disabled). However the other problem formats also don't count pages and I have confirmed they don't have DRM but are openable with the calibre ebook viewer.

So while DRM might be a factor for the few azw format books (somehow they didn't import right even though they came at the same time as the others)...it isn't for the other formats that count pages doesn't work on.

This might just come back to count pages plugin not using the same code/plugin path as the calibre ebook viewer and so it can't read these other formats (regardless of DRM)?

[GeniusJ]

This plugin seems to have stopped working after the upgrade to Calibre 8.1.0. It disappeared from the toolbar and is no longer an option. When I try to configure the plugin, it tells me it can't be configured until Calibre is restarted, even after it's been restarted.

[EDIT] I have confirmed it's an issue with this plugin and Calibre 8.1.0. I downgraded Calibre to 8.0.1 and the plugin reappeared in the task bar and began working again.

[mbovenka]

Originally Posted by GeniusJ

This plugin seems to have stopped working after the upgrade to Calibre 8.1.0.

Yep, same here. Downgrading to 8.0.1 fixed it for me as well. Running Portable in my case.

[skil-phil]

Ditto. Downgrading fixed it.