MobileRead Forums - View Single Post - Character encoding, hex, emdash, and the meaning of life.

kovidgoyal · 08-13-2011, 02:06 PM

http://docs.python.org/library/codec...dard-encodings

That looks like your HTML file has a mix of encodings. Some program in the past converted a single byte encoding to UTF-16 by blindly copying the single byte into the lower UTF-16 byte.

I'd guess the encoding for your file is cp1252 once you strip out all 0 bytes.

08-13-2011, 02:06 PM	#2
kovidgoyal creator of calibre Posts: 43,858 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	http://docs.python.org/library/codec...dard-encodings That looks like your HTML file has a mix of encodings. Some program in the past converted a single byte encoding to UTF-16 by blindly copying the single byte into the lower UTF-16 byte. I'd guess the encoding for your file is cp1252 once you strip out all 0 bytes.