[GUI Plugin] Quality Check

[Rob557]

thread: "[GUI Plugin] Quality Check"

Originally Posted by fncll

... the log for "Search ePub" ... Where can I view this log?

Hi fncll,
Each time a Quality Check "Search ePub" is run, a small pop-up box appears with the options of either clicking "OK", or first clicking on "view log". That latter option allows you to see the "Search ePub" results log and copy its contents. I don't otherwise know how to access that log via its filename on the hard drive but it may not be a simple stand-alone text file anyway.

FWIW, could you clarify what you mean by seeing a note in the "changelog" ... assuming that is different from the "Search ePub" results log, what action produces a "changelog" and how do you access that log?
Cheers,
Rob

[theducks]

'Log" files are almost always TXT files every place I have seen them over the 40 years I have been using computers (as always, there are those who think they have a better way, and use a special dataset. Duho! The computers is broken, I need a SIMPLE / UNIVERSAL way to get the log)
Notepad, Notepad++, even Copy foo.log CON: (with the optional pipe to MORE )

[ilovejedd]

Question, has anyone used "Check and repair book sizes recently"? It's not working for me at all. It didn't find any discrepancies (it reported all file sizes matched) whereas there should have been thousands given I just restored ~2,000 mobi files from my backup.

[DNSB]

Originally Posted by ilovejedd

Question, has anyone used "Check and repair book sizes recently"? It's not working for me at all. It didn't find any discrepancies (it reported all file sizes matched) whereas there should have been thousands given I just restored ~2,000 mobi files from my backup.

Worked for me last week. I had editing some epubs in Sigil removing embedded fonts (who the bleep picks those fonts?) and the file sizes don't get updated so Quality Check reports them.

[ilovejedd]

Originally Posted by DNSB

Worked for me last week. I had editing some epubs in Sigil removing embedded fonts (who the bleep picks those fonts?) and the file sizes don't get updated so Quality Check reports them.

Thanks. Maybe the plugin just didn't like seeing thousands of discrepancies. Either that or it doesn't play nice in portable mode.

In any case, I just made a #size custom column that I manually update using formats_sizes().

[ilovejedd]

Hmm, looking further into this issue, there appears to be two possible causes:

1.) Caching: If I change files while Calibre is shut down, the Quality Check plugin doesn't catch any of the changes but sometimes it does if I make changes while Calibre is running.

2.) Possible use of a mapped legacy function to get the "db" size.

/src/calibre/db/legacy.py -> I believe format_metadata uses os.stat which would give the same file size as os.path.getsize

    def sizeof_format(self, index, fmt, index_is_id=False):
        book_id = index if index_is_id else self.id(index)
        return self.new_api.format_metadata(book_id, fmt).get('size', None)

/src/calibre/library/database.py

    def sizeof_format(self, index, format, index_is_id=False):
        ''' Return size of C{format} for book C{index} in bytes'''
        id = index if index_is_id else self.id(index)
        format = format.upper()
        return self.conn.get('SELECT uncompressed_size FROM data WHERE data.book=? AND data.format=?', (id, format), all=False)

Quality Check/check_fix.py

    for fmt in formats.split(','):
        db_size = db.sizeof_format(book_id, fmt, index_is_id=True)
        book_path = db.format_abspath(book_id, fmt, index_is_id=True)
        if not book_path:
            self.log.error('Unable to find path to book id:', book_id, db.title(book_id, index_is_id=True))
            continue
        if os.path.exists(book_path):
            actual_size = os.path.getsize(book_path)
            if actual_size != db_size:

That's pretty much the extent of my practically non-existent Python reading skills.

Fixing the code so sizeof_format gets information from database instead of os.stat or to prevent caching is way beyond my skill set. I'm fairly adept at cut-and-paste though, so I managed to add a nuclear option Force repair book sizes. Per the option name, this will forcibly update the sizes for all formats regardless if it's been changed or not so use with care. I only use it with Search scope - Selected book(s).

[fncll]

Originally Posted by Rob557

thread: "[GUI Plugin] Quality Check"
Hi fncll,
Each time a Quality Check "Search ePub" is run, a small pop-up box appears with the options of either clicking "OK", or first clicking on "view log". That latter option allows you to see the "Search ePub" results log and copy its contents. I don't otherwise know how to access that log via its filename on the hard drive but it may not be a simple stand-alone text file anyway.

FWIW, could you clarify what you mean by seeing a note in the "changelog" ... assuming that is different from the "Search ePub" results log, what action produces a "changelog" and how do you access that log?
Cheers,
Rob

Thanks. I've overlooked that button a thousand times!

By "changelog" I meant the one that is inside the ZIP file along with the plugin source. I made a copy and modified the plugin to provide more lines of context (if I can figure it out I will offer code to the developer to make that a user-selectable option). I also want to have it write a copy of the log each time it is run!

[MsBarrows]

Fantastic plug-in! I just finished upsizing a bunch of covers on some ebooks I'd purchased today, and found myself wondering just how many ebooks I had with covers of less than my preferred minimum size (which is only 500x700 pixels, so it's not like it's particularly vast by today's tablet screen sizes). Found a reference to this plug-in on a different thread, just ran it... I have over 500 books whose covers also need upsizing, OUCH!

But at least now I know

[compurandom]

Have fun upsizing. Make use of metadata plugins to find better covers...

[Rob557]

Originally Posted by MsBarrows

... I have over 500 books whose covers also need upsizing, OUCH! But at least now I know.

Hi MsBarrows ... after using the "Quality Check" plug-in to list out all the books for which you want to resize the cover, you can use a separate Calibre plug-in called "Resize Cover" that allows you to select those books, and bulk-resize them. FWIW, a size of 435(w) x 680(h) generally seems pretty good, and you can individually adjust for necessary cropping or distortions.

The following is a link to the "Resize Cover" plug-in page
https://www.mobileread.com/forums/sh...d.php?t=150982
i.e. mobileread.com/forums/showthread.php?t=150982

Rob

[MsBarrows]

Originally Posted by Rob557

The following is a link to the "Resize Cover" plug-in page
https://www.mobileread.com/forums/sh...d.php?t=150982
i.e. mobileread.com/forums/showthread.php?t=150982

Thanks for the advice, I've bookmarked that for future reference, though I've already worked my way manually through the vast majority of them over the last few days.

For commercially published ebooks I've been taking the time to Google for higher resolution images of the official covers, since readers and tablets are only going to continue gaining screen resolution and memory over time.

For downloaded fanfiction it was much less of a problem, since those ebooks were mostly already using covers I'd created over the years using either the Generate Cover plugin or Photoshop, so it was only a comparative handful with associated fanart used for covers that needed a size tweak.

Doesn't make much of a visual change in Calibre itself, of course, but the difference in image quality was very noticeable once I transferred all the ebooks back over to my tablet and opened them there.

[bluepiggy42]

Any thought on how I can us the quality check; search epubs function to look for the title of the book within the body of the book?

I'm am not a tech person in the least....so I am sure that i'm not even close. I've tried:

<title>
(?P<title>.+)
(title)

Thank you!!!! I love this function and use the search epubs all the time.
Christa

[ilovejedd]

Originally Posted by bluepiggy42

<title>

Assuming you have HTML search enabled, this should already show at least part of the title if it's actually set correctly.

Unfortunately, if your EPUB doesn't have correct title metadata in its OPF file, the <title> tag in the HTML files could very well have completely bogus info, too. Skimming with ebook-viewer might be your only recourse.

[bluepiggy42]

Originally Posted by ilovejedd

Assuming you have HTML search enabled, this should already show at least part of the title if it's actually set correctly.

Unfortunately, if your EPUB doesn't have correct title metadata in its OPF file, the <title> tag in the HTML files could very well have completely bogus info, too. Skimming with ebook-viewer might be your only recourse.

How would I check to see if the HTML Search is enabled?

[ilovejedd]

Originally Posted by bluepiggy42

How would I check to see if the HTML Search is enabled?

Iirc, there's like an option for plain text search in the search epub dialog. You need to uncheck that if it's checked. There might be an option for HTML search as well. If so you need to check that one.

Also, I think there's an option to show all results. Check that one. You might get lucky and the correct title might be in use in later matches.

On an iPad and I'm doing this from memory so not 100% sure what all the options are.

Like I mentioned though, if embedded title metadata in EPUB is incorrect, chances are low that you can extract the correct title programmatically.