Beta testers for calibre 9 needed

[bustacap]

why is it eating dozens of gb on the c drive?
i assume it has something to do with the page number algorithm, but its just getting out of hand if you have a lot of comics and manga :P
space is freed again when calibre is closed

[JSWolf]

Originally Posted by bustacap

why is it eating dozens of gb on the c drive?
i assume it has something to do with the page number algorithm, but its just getting out of hand if you have a lot of comics and manga :P
space is freed again when calibre is closed

I don't know about during the counting of the entire library, but when calibre is run after the count and after the bookshelf is made, it's using less then 1GB of storage. This is while just the library loaded, the bookshelf is showing, and not doing anything else.

I know there will more storage used when you do things that require temp files.

[BetterRed]

Originally Posted by kovidgoyal

Yeah the only way to get them "correct" would be to do a full layout of the DOCX file. DOCX markup doesnt define pages, only block level elements like paragraphs. How they are laid out in pages is upto the software displaying the file. If by correct you mean what word would show then yes one has to re-implement words layout engine. This is both way too much work and way too slow for page counting.

Given the degree of inaccuracy (e.g. 38 for 28, 410 for 226) I suggest calibre should not calculate the Pages column for Books that only have a DOCX format.

If a book has multiple formats, which format takes precedence in calculating the Pages column ? Apologies if that's already been addressed.

BR

[theducks]

8.99.1 Editor ABENDS for me.
I launch using 'T', then open a file. While staring at it, The Editor just closes.
Pretty much a Stock W10 pro.

BTW The Preview did this also. The When was not consistent. One book just close shortly after launch. Another like above.

Device Name	 zzzzz
Processor	Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz   3.60 GHz
Installed RAM	32.0 GB
Storage	119 GB SSD MTFDDAK128MAM-1J1, 2.73 TB HDD Hitachi HUA723030ALA640
Graphics Card	Intel(R) HD Graphics 4600 (113 MB)
Device ID	0F99C423-E15A-454A-BC70-45851199925D
Product ID	00330-80000-00000-AA367
System Type	64-bit operating system, x64-based processor
Pen and touch	No pen or touch input is available for this display

[kovidgoyal]

Originally Posted by bustacap

why is it eating dozens of gb on the c drive?
i assume it has something to do with the page number algorithm, but its just getting out of hand if you have a lot of comics and manga :P
space is freed again when calibre is closed

Pages counting happens only once so I doubt its that. Not to mention that for comics it doesnt even extract the comic files, just counts the number of image files in the comic archive.

Look at the calibre temp directory and see what is taking up the space.

[kovidgoyal]

Originally Posted by theducks

8.99.1 Editor ABENDS for me.
I launch using 'T', then open a file. While staring at it, The Editor just closes.
Pretty much a Stock W10 pro.

This will be a Qt issue wrt to your graphics drivers. The first thing to try is update your graphics driver. Then you can try setting the env var to disable hardware acceleration in Qt WenEngine as described in https://doc.qt.io/qt-6/qtwebengine-debugging.html

[kovidgoyal]

Originally Posted by BetterRed

Given the degree of inaccuracy (e.g. 38 for 28, 410 for 226) I suggest calibre should not calculate the Pages column for Books that only have a DOCX format.

As I said before the pages column values are not meant to be any sort of "accurate" count. They basically reflect how much text and images is in the book, therefore how many pages they would take if printed out without any styling and on "common" page size. Do not use it for anything other than that.

If a book has multiple formats, which format takes precedence in calculating the Pages column ? Apologies if that's already been addressed.
BR

Starts with formats that have defined numbers of pages such as PDF and comics. Then plain text formats then EPUB then whatever is in your input format order under Preferences->Behavior.

[nqk]

Thank you Kovid,

I will definitely try this when I come back home after this weekend. I like new things, new features.

I need some clarification though:

1) If the epub3 book has the print paper pages (existing Calibre viewer sees it), will it be the page count result?

2) When a book is re-added, say via the Content Server, will it trigger the recount for that book?

....

I may have more questions....

Thank you.

Sent from my Pixel 7 Pro using Tapatalk

[kovidgoyal]

Originally Posted by nqk

1) If the epub3 book has the print paper pages (existing Calibre viewer sees it), will it be the page count result?

yes, the page count in such cases is the number of unique page entries in the EPUB pages metadata.

2) When a book is re-added, say via the Content Server, will it trigger the recount for that book?

yes.

[Sirtel]

Tested the new bookshelf view with 8.99 portable. Works nicely. I used my custom pages column as the basis, as the automatic count was wildly inaccurate in a few cases (with one ordinary epub - about 200,000 words, no images - it gave me 4800 pages ). Mostly, the count was more or less as expected, though.

I notice that if you group by authors, the books will be grouped by the author's first name. Shouldn't they be grouped by the last name (i.e. using author sort)?

Many thanks to Kovid and other contributors.

[kovidgoyal]

The heuristic is CHARS PER LINE = 70 LINES_PER_PAGE = 36. In addition images are counted as 1000 chars and headings (h1 through h6) get some additional lines. A 200,000 word book without images should be about 400 pages not 4000, I would be interested in looking at the EPUB to see why it's getting such a bad value.

For technical reasons, grouping by author sort value is a little complex/slower so I left it out. But I can certainly add a group by Author_sort value in the future.

Sub-grouping isnt supported, but, the grouping respects the overall sort within each group. So if you have sorting set to series and then group by author, the books for each author should be sorted by series, unless I screwed something up.

[Sirtel]

Originally Posted by kovidgoyal

Sub-grouping isnt supported, but, the grouping respects the overall sort within each group. So if you have sorting set to series and then group by author, the books for each author should be sorted by series, unless I screwed something up.

Yes, I already saw that after I posted, so I deleted that part from my previous post.

I've attached the scrambled epub with the egregious page count (as the book is in copyright).

[kovidgoyal]

Actually using author sort turned out not too bad: https://github.com/kovidgoyal/calibr...ff88a94748ae81

[Sirtel]

[BetterRed]

Originally Posted by kovidgoyal

As I said before the pages column values are not meant to be any sort of "accurate" count. They basically reflect how much text and images is in the book, therefore how many pages they would take if printed out without any styling and on "common" page size. Do not use it for anything other than that.



Starts with formats that have defined numbers of pages such as PDF and comics. Then plain text formats then EPUB then whatever is in your input format order under Preferences->Behavior.

I'm going to ignore the Pages column.

My Input order has manuscript formats (DOCX, ODT, RTF. MARKDOWN... TXT) at top of list. I also keep alternative covers in CBR files, so my War and Peace shows 4 pages .

BR