MobileRead Forums
Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre
Reload this Page UTF-8 check?

Notices

Reply
 
Thread Tools Search this Thread
Old 11-15-2022, 12:24 AM   #1
rumplestiltskin
Zealot
rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.
 
Posts: 105
Karma: 1435120
Join Date: Nov 2010
Location: West of the Pecos
Device: FireHD8, iPad
UTF-8 check?
Among many other functions, the Modify ePub plugin does a lovely job of adding the UTF-8 HTML style where it's missing (or fixing it when another style has been erroneously set). If an ePub doesn't have the UTF-8 setting in place, Amazon's Kindle may (probably will) display the ePub's text incorrectly.

But how does one know whether the HTML style has been set to UTF-8? Well, one can have Calibre send the ePub to one's Kindle address and then discover the formatting issue is present, then delete that book, then use the Modify ePub plugin to fix the HTML style problem, then re-send the book to the Kindle again.

But what if there was a way to display the existing HTML style in a column so one would actually know whether the problem needs to be corrected (and then the Modify ePub plugin could be used)?

Perhaps there's already way to display this setting somewhere in Calibre? Obviously, inquiring minds want to know...at least this one, anyway.

Thanks very much,
Barry
Last edited by rumplestiltskin; 11-15-2022 at 01:38 AM.
rumplestiltskin is offline   Reply With Quote
Old 11-15-2022, 12:39 AM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,356
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
No, there isnt. It would require scanning book content which is too slow.
kovidgoyal is offline   Reply With Quote
Advert
Old 11-15-2022, 01:53 AM   #3
rumplestiltskin
Zealot
rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.
 
Posts: 105
Karma: 1435120
Join Date: Nov 2010
Location: West of the Pecos
Device: FireHD8, iPad
Thank you, Kovid, for your quick reply. The info seems to be in the .ncx and .opf files. As a workaround, I've been having Calibre do an automatic epub-to-epub conversion (with the UTF-8 style) upon import. Might be a waste of CPU power but at least I'm sure that my Kindle will display the text properly.
rumplestiltskin is offline   Reply With Quote
Old 11-15-2022, 04:25 AM   #4
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 79,758
Karma: 145864619
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
Quote:
Originally Posted by rumplestiltskin View Post
Thank you, Kovid, for your quick reply. The info seems to be in the .ncx and .opf files. As a workaround, I've been having Calibre do an automatic epub-to-epub conversion (with the UTF-8 style) upon import. Might be a waste of CPU power but at least I'm sure that my Kindle will display the text properly.
It's better to just use Modify ePub to set UTF-8 instead of ePub > ePub for every ePub you want to send to your Kindle.

If you want to try to automate this process when you import an ePub, you might be able to do so using an action chain with the Action Chains plugin.
JSWolf is offline   Reply With Quote
Old 11-15-2022, 06:46 PM   #5
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,062
Karma: 60358908
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by rumplestiltskin View Post
Thank you, Kovid, for your quick reply. The info seems to be in the .ncx and .opf files. As a workaround, I've been having Calibre do an automatic epub-to-epub conversion (with the UTF-8 style) upon import. Might be a waste of CPU power but at least I'm sure that my Kindle will display the text properly.
Quality check Plugin has a Search that can look a specific areas of an EPUB for the search term. OPF is one of those places
theducks is online now   Reply With Quote
Advert
Old 11-15-2022, 10:14 PM   #6
rumplestiltskin
Zealot
rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.rumplestiltskin ought to be getting tired of karma fortunes by now.
 
Posts: 105
Karma: 1435120
Join Date: Nov 2010
Location: West of the Pecos
Device: FireHD8, iPad
Thanks, theducks. A bit too complicated for my needs.

I think I'll just manually hit every new ePub as it enters my library with Modify ePub plugin's "Encode HTML in UTF-8" function. Hopefully, that should satisfy my Kindle.
rumplestiltskin is offline   Reply With Quote
Old 01-05-2023, 01:22 AM   #7
McKnitter
Member
McKnitter began at the beginning.
 
Posts: 20
Karma: 10
Join Date: Oct 2014
Device: Kindle Voyage
fix epub errors for Kindle conversion
I've sent epubs to Kindle to convert and had those weird markup marks instead of some punctuation (I assume) all through the text. My workaround has been to use Calibre to convert the epub to mobi and then back to epub, and that seems to work.

I don't know why Amazon won't allow mobi files to be sent for conversion as well as epubs. I haven't figured out how to import epubs as UTF-8, if that's what is needed, so meanwhile, I'm doing the back-and-forth conversion in Calibre.

Any suggestions for easier conversion welcome. (I'm using Calibre 6.1 still.)
McKnitter is offline   Reply With Quote
Old 01-05-2023, 01:55 AM   #8
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,356
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Just convert epub to epub no need to go to mobi first
kovidgoyal is offline   Reply With Quote
Old 01-05-2023, 12:48 PM   #9
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 46,234
Karma: 168983734
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
One item to remember is that an epub MUST use either UTF-8 or UTF-16 encoding (it's part of the specification). I have only seen 3 epubs that used UTF-16.

To quote from the EPUB 3.2 specification, section 3.3 XML Conformance:
Quote:
It MUST be encoded in UTF-8 or UTF-16 [Unicode].
While I've seen several epubs that did not use UTF-8/UTF-16, none of those were from legitimate sources.

OTOH, most publishers will require that an epub pass epubcheck before being accepted. One example of an epub that I ran into years back that tried to use ISO8859-1 encoding gave the following error messages when I ran epubcheck on it:

Code:
FATAL(RSC-016): Fatal Error while parsing file: Invalid encoding name ""ISO8859-1"".
ERROR(RSC-028): XML documents must be encoded in UTF-8, but "ISO8859-1" was detected."
DNSB is offline   Reply With Quote
Old 01-05-2023, 02:09 PM   #10
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 79,758
Karma: 145864619
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
Quote:
Originally Posted by McKnitter View Post
I've sent epubs to Kindle to convert and had those weird markup marks instead of some punctuation (I assume) all through the text. My workaround has been to use Calibre to convert the epub to mobi and then back to epub, and that seems to work.

I don't know why Amazon won't allow mobi files to be sent for conversion as well as epubs. I haven't figured out how to import epubs as UTF-8, if that's what is needed, so meanwhile, I'm doing the back-and-forth conversion in Calibre.

Any suggestions for easier conversion welcome. (I'm using Calibre 6.1 still.)
No need to convert ePub to anything. Install Modify ePub and select the UTF-8 option and use that to make sure the ePub is set to UTF-8. That should work.
JSWolf is offline   Reply With Quote
Old 01-06-2023, 07:56 PM   #11
McKnitter
Member
McKnitter began at the beginning.
 
Posts: 20
Karma: 10
Join Date: Oct 2014
Device: Kindle Voyage
Quote:
Originally Posted by kovidgoyal View Post
Just convert epub to epub no need to go to mobi first
Thanks, Kovid. I'll give that a try!
McKnitter is offline   Reply With Quote
Old 01-07-2023, 09:45 PM   #12
McKnitter
Member
McKnitter began at the beginning.
 
Posts: 20
Karma: 10
Join Date: Oct 2014
Device: Kindle Voyage
Quote:
Originally Posted by McKnitter View Post
Thanks, Kovid. I'll give that a try!
epub to epub worked a treat - thanks!
McKnitter is offline   Reply With Quote
Reply

« Previous Thread | Next Thread »

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
UTF-16 forced to UTF-8 brolny Sigil 7 09-22-2015 12:56 PM
Are DRM books with check in/check out allowed? i8abug Library Management 4 05-31-2012 02:27 PM
I specified UTF-16 instead of UTF-8 ronaldl Sigil 2 12-22-2011 04:59 AM
Malformed byte sequence: Invalid byte 2 of 3-byte UTF-8 sequence. Check encoding digireads ePub 3 04-26-2011 03:07 AM
UTF-8 tompe Calibre 2 05-06-2009 06:35 PM


All times are GMT -4. The time now is 11:09 PM.

Contact Us - FAQ - Guidelines - Privacy - Top

MobileRead.com is a privately owned, operated and funded community.