updated to calibre 2.5 crazy results now from count pages plug in

[cybmole]

so I upgraded from ( i think 2.3) to 2.5 I now get results like 155,916 pages from the count pages plug in. I have not changed any other settings, the plugin is still set to use the ADE page count method.

If I rerun on books that already have sensible page count values I get these huge numbers, so i'ts not an issues with a specific book or two.
so something in the latest 64 bit calibre must be affecting the plug-in ?

I will go look for a re-download of 2.3 so see if the issue goes away.....

update.... so before changing the calibre install I tried a couple of other things.
1 restart calibre - no change to results
2. change algorithm selection in plug in, then change it back again.... no fix there either

but then I looked more closely at the plug in settings & saw that it was proposing to use the same custom calibre column (pages) for both a page count & a word count. I set the word count column to blank & all seems OK now.

but as I did NOT upgrade or tweak the plug-in at all at anytime in the last few months, I am still thinking something in the latest release needs to be looked at. the only deliberate change that I have made today was to install the new calibre version. can anyone else reproduce this ?

[vIosOnE]

My passed me the same thing and I changed to Paragraphs. I have re-run the plugin in all the books and has not happened again I. Regards.

[DoctorOhh]

Originally Posted by cybmole

so I upgraded from ( i think 2.3) to 2.5 I now get results like 155,916 pages from the count pages plug in. I have not changed any other settings, the plugin is still set to use the ADE page count method.

I upgraded from 2.3 to 2.5 64 bit Windows version and my count pages plugin continued working as expected. However I did not have both page and word count columns.

[theducks]

I have 2.5 X64 and count pages has not gone wierd.
ONLY {#pages} {#fog} and {#grade} configured

[cybmole]

write it off as a glitch then, if its not happening to others.
but for the record, I'd never used word count & I did not have a word count column configured either.
somehow the "pages" column name got into the word count output box in the plug-in configuration....
the only other possible cause, which I can't now reproduce, is that I'd asked it to page count on multiple books, after doing the 2.5 upgrade; usually I only page count a single book.

[DoctorOhh]

Originally Posted by cybmole

write it off as a glitch then, if its not happening to others.

It seems to have happened to at least one other person.

[cybmole]

well hopefully we'll hear from the plug-in author in due course.
I am not sure how to reproduce it , except maybe to go all the way through a downgrade to 2.3 and then back up to 2.5 which I'm not planning to do. I don't know enough about how/where the plug-in preferences are stored, to dig deeper.

[BetterRed]

Originally Posted by cybmole

well hopefully we'll hear from the plug-in author in due course.
I am not sure how to reproduce it , except maybe to go all the way through a downgrade to 2.3 and then back up to 2.5 which I'm not planning to do. I don't know enough about how/where the plug-in preferences are stored, to dig deeper.

@cybmole - they're in %CALIBRE_CONFIG_DIRECTORY%\plugins - eg Count Pages.json

You can open json files with just about any half decent text editor - so not notepad.

BR

[cybmole]

Originally Posted by BetterRed

@cybmole - they're in %CALIBRE_CONFIG_DIRECTORY%\plugins - eg Count Pages.json

You can open json files with just about any half decent text editor - so not notepad.

BR

thanks - well there'd be no reason for a calibre update to make changes to a plug-ins subdirectory.

but maybe some subtle change in how it would use the plug in results, if the plug-in was configured to place 2 different answers in the same column ? - maybe the plug-in was outputting both word & page count before the 2.5 upgrade but its results were being applied differently e.g. update the pages column with word count, then update it again with page -count..... & then after 2.5 the updates are done the other way around - pure speculation on my part...

all I know for sure is that I added that plug-in a very long time ago - over a year ago - back when calibre was still at 1.xx - & once I had it set to use the ADE page definition algorithm I never revisited its settings.
I don't install every calibre update, but I was previously on 2.something - probably 2.3

[BetterRed]

@cybmole - I'm not sure if it's related, but after I installed calibre 2.4, Count Pages was returning very low word counts on some books, then I noticed it was books with PDF versions, then I noticed that the Behaviour->Preferred Input list had PDF at the top followed by formats I've barely heard of, let alone have.

I can't categorically say I didn't change the list - but I can't imagine why I would have done. That said, you're right, why would a calibre install futz with optional plug-in settings.

BR

[kovidgoyal]

calibre 2.5 has a security update, it randomizes the internal seed used for generating hashmap keys. This means that any code that relies on iterating over the keys in a python dict in a fixed order will break.

Technically, it is broken anyway, since the python dict is not supposed to returns its keys in any well defined order.

I'm guessing something in that plugin indirectly relies on a fixed order iteration if the same column is used for different algorithms. That iteration order is now random, as it should be, leading to random results.

And note that a calibre update does not touch *anything* in the config folder. Updates only touch files inside the calibre installation directory.

[Goala]

Same problem here with "Count Pages" plugin.

First, excuse me if my english is not good enough.

I am suffering this problem and when looking for a solution I've found this thread. I use Calibre in a Linux AMD64 machine.

I've noticed that if I uninstall the addon and then I install it again (Calibre needs to restart) the plugin works as it should.... But just once! when I close Calibre and launch it again, "Count Pages" fails again without touching anything else.

In "Count Pages" customize window, if I click in View Library Preferences:

{
"customColumnPages": "#pages",
"algorithmPages": 1,
"customColumnGunningFog": "",
"customColumnWords": "#pages",
"SchemaVersion": 1.61,
"customColumnFleschGrade": "",
"customColumnFleschReading": "",
"customCharsPerPage": 1500
}

When I close Calibre and I launch it again, this View Library Preferences have changed to:

{
"customColumnFleschReading": "",
"customCharsPerPage": 1500,
"customColumnFleschGrade": "",
"SchemaVersion": 1.61,
"customColumnWords": "#pages",
"customColumnGunningFog": "",
"algorithmPages": 1,
"customColumnPages": "#pages"
}

I think that it's the words' count the number which is inserted in #Pages column instead the pages' count. It seems that if the customColumnWords setting appears before than the customColumnPages it's the words' count what it's inserted into the #pages column and not the pages' count.

I've changed the configuration so in Word count options I've choosed the blank option for custom column (I don't know why was the #Pages column selected here, I never choosed this setting):



And everything is ok now.

I don't know why this configuration (the quotes above) changes without touching anything.

[theducks]

Open the Calibre configuration folder. I the plugins folder: delete or rename

Count Pages.json

Then start Calibre and make your configuration (attempt)

By any chance are your settings folder connected to a cloud?

[eschwartz]

Originally Posted by Goala

Same problem here with "Count Pages" plugin.

First, excuse me if my english is not good enough.

I am suffering this problem and when looking for a solution I've found this thread. I use Calibre in a Linux AMD64 machine.

I've noticed that if I uninstall the addon and then I install it again (Calibre needs to restart) the plugin works as it should.... But just once! when I close Calibre and launch it again, "Count Pages" fails again without touching anything else.

In "Count Pages" customize window, if I click in View Library Preferences:



When I close Calibre and I launch it again, this View Library Preferences have changed to:


I think that it's the words' count the number which is inserted in #Pages column instead the pages' count. It seems that if the customColumnWords setting appears before than the customColumnPages it's the words' count what it's inserted into the #pages column and not the pages' count.

I've changed the configuration so in Word count options I've choosed the blank option for custom column (I don't know why was the #Pages column selected here, I never choosed this setting):



And everything is ok now.

I don't know why this configuration (the quotes above) changes without touching anything.

The JSON format doesn't care what order things show up in, they are just "key : value" pairs. Every time it gets updated it will get updated into a random order.

That is expected.

If changing the configuration fixed things, then I daresay that was the problem.
I do not know if or why your settings may have changed of their own volition.

[theducks]

You have Words AND Pages pointed to the same column