![]() |
#1 |
Feral Underclass
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 3,622
Karma: 26821535
Join Date: Jan 2010
Location: Yorkshire, tha noz
Device: 2nd hand paperback
|
What is an illegal multibyte sequence ?
Trying to turn this:
http://jakonrath.blogspot.co.uk/2012...m-schreck.html into an epub with this: http://web2fb2.net/ but it just says this: ERROR: 'big5' codec can't decode bytes in position 37378-37379: illegal multibyte sequence |
![]() |
![]() |
![]() |
#2 |
Linux User
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 2,282
Karma: 6123806
Join Date: Sep 2010
Location: Heidelberg, Germany
Device: none
|
It would be a badly encoded file, except it's trying to use the wrong codec in the first place.
So it's a problem of web2fb2.net EDIT: The character in question is in the comment section though ("Yeni �kan"), at least that's where iconv fails when trying to translate from utf8 to latin1 or big5. If you don't want comments in your epub you should probably go for a more selective approach... Last edited by frostschutz; 05-17-2012 at 02:30 PM. |
![]() |
![]() |
Advert | |
|
![]() |
#3 |
Booklegger
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 1,801
Karma: 7999816
Join Date: Jun 2009
Location: Toronto, Ontario, Canada
Device: BeBook(1 & 2010), PEZ, PRS-505, Kobo BT, PRS-T1, Playbook, Kobo Touch
|
The web site appears to be using UTF-8 encoding, so there are rules about what values can occur in each position of a multi-byte sequence. This is so that you can always find the start of a multi-byte sequence even if you get plopped down in the middle of a file.
According to Table 3-6, in Section 3.9 of the Unicode Book (available from www.unicode.org as a set of pdf files) the first (and only) byte of a single byte code must start with a zero bit -ie 0xxxxxxx. For a two-byte code, the first byte is 110yyyyy and the second is 10xxxxxx. For a three byte code, the first byte is 1110zzzz, the second is 10yyyyyy, and the third is 10xxxxxx. The 16 bit code value is form by concatenating the zzzz as high order, then the yy's and finally the xx's with leading zeroes of course. The chart in the book shows it better ![]() You might need a hex editor to find that byte pair, because most text editors deal in lines; but a good unicode editor should point out the problem when it opens the file. Then you can fix it howeveer you choose. I'm not sure why it is using a 'big5' codec; that's usually used for chinese texts. edit: Dang! Beaten to the punch. So much for the long-winded (and still incomplete) explanation. Last edited by pholy; 05-17-2012 at 03:03 PM. |
![]() |
![]() |
![]() |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
SEQUENCE 77 | Darbarian | Self-Promotions by Authors and Publishers | 9 | 02-10-2013 05:03 PM |
Malformed byte sequence: Invalid byte 2 of 3-byte UTF-8 sequence. Check encoding | digireads | ePub | 3 | 04-26-2011 03:07 AM |
Series sequence? | Toxaris | Sony Reader | 9 | 04-09-2010 07:36 PM |
Problems with multibyte data flags | pdurrant | Kindle Formats | 5 | 03-13-2010 10:39 AM |
PRS-300 Author sequence | denmarks | Sony Reader | 1 | 10-05-2009 11:49 PM |