Font, ScreenSaver & USBNetwork Hacks for Kindle 2.x, 3.x & 4.x

[dhdurgee]

Originally Posted by NiLuJe

@dhdurgee: It's gonna be painful over myts, I'd recommend checking over SSH instead, if you really need to [Or, better, on a proper desktop, since it's basically a Python script].

In the meantime, you can check the system logs (showlog), but that would only pinpoint it slightly more. Most likely the book simply doesn't have a cover embedded in its metadata (or is in an unsupported format).

The two books involved were magazines and both display covers in their tables of contents and they can be viewed from there. I have python installed on my system, so I could run a script to check this. Do you have a test script? Is there a script I should copy off the K3W to run on my desktop?

Dave

[NiLuJe]

@dhdurgee: Haha! Periodicals are (generally) unsupported.

(And even when they are and the support is hidden behind a flag [like in the K5 version], they often don't bundle a proper cover. Periodicals are very peculiar, in terms of the internals of the file format).

You can check what the mobicover python script (linkss/bin/kindleunpack) throws back at you, and even double check w/ the full, upstream version of KindleUnpack if you really care about that.

[dhdurgee]

Originally Posted by NiLuJe

@dhdurgee: Haha! Periodicals are (generally) unsupported.

(And even when they are and the support is hidden behind a flag [like in the K5 version], they often don't bundle a proper cover. Periodicals are very peculiar, in terms of the internals of the file format).

You can check what the mobicover python script (linkss/bin/kindleunpack) throws back at you, and even double check w/ the full, upstream version of KindleUnpack if you really care about that.

Per your suggestion I downloaded the full KindleUnpack and ran it:

dhdurgee@DHD-Z560 ~/bin/KindleUnpack_v075/lib $ ./kindleunpack.py /media/dhdurgee/Kindle/documents/Asimov\ s\ Science\ Fiction-asin_B00T8JNGO6-type_MAGZ-v_1.azw /var/tmp
KindleUnpack v0.75
   Based on initial mobipocket version Copyright © 2009 Charles M. Hannum <root@ihack.net>
   Extensive Extensions and Improvements Copyright © 2009-2014 
       by:  P. Durrant, K. Hendricks, S. Siebert, fandrieu, DiapDealer, nickredding, tkeo.
   This program is free software: you can redistribute it and/or modify
   it under the terms of the GNU General Public License as published by
   the Free Software Foundation, version 3.
Unpacking Book...
Palm DB type: BOOKMOBI, 124 sections.
Warning: Bad key, size, value combination detected in EXTH  406 16 0000000000000000
Unpacking a Mobipocket 6 book...
Processing Mobipocket 6 section of book...
Mobi Version: 6
Codec: utf-8
Title: Asimov's Science Fiction
EXTH Title: Asimov's Science Fiction
Huffdic compression
Traceback (most recent call last):
  File "./kindleunpack.py", line 968, in <module>
    sys.exit(main())
  File "./kindleunpack.py", line 957, in main
    unpackBook(infile, outdir, apnxfile, epubver, use_hd)
  File "./kindleunpack.py", line 871, in unpackBook
    process_all_mobi_headers(files, apnxfile, sect, mhlst, K8Boundary, False, epubver, use_hd)
  File "./kindleunpack.py", line 718, in process_all_mobi_headers
    raise unpackException('Book is encrypted')
__main__.unpackException: Book is encrypted
dhdurgee@DHD-Z560 ~/bin/KindleUnpack_v075/lib $

So it appears that the problem is the script can't deal with an encrypted book at present. Given that many kindle books are encrypted, I would expect this to fail much of the time. Is there a way around this? Is there a way to manually add covers to the cache in such a situation?

Dave

[knc1]

Yes, don't buy your e-books from Amazon or other DRM supporters.

[NiLuJe]

Oh, right, forgot about that. No, shortcircuit the encryption check, that's not it. It's irrelevant for our purposes (but isn't for KindleUnpack's, hence it being an error there, but not in MobiCover).

[dhdurgee]

Originally Posted by NiLuJe

Oh, right, forgot about that. No, shortcircuit the encryption check, that's not it. It's irrelevant for our purposes (but isn't for KindleUnpack's, hence it being an error there, but not in MobiCover).

So your routine should have worked against an encrypted book? How can I test this further?

Dave

[eschwartz]

Decrypt the book maybe.
http://appprenticealf.wordpress.org

That will allow you to test the book. You don't have to do that just for SS in future though...

[NiLuJe]

@dhdurgee: Comment out the encryption check in KindleUnpack and/or directly use the kindleunpack version bundled with the hack.

[dhdurgee]

Originally Posted by NiLuJe

@dhdurgee: Comment out the encryption check in KindleUnpack and/or directly use the kindleunpack version bundled with the hack.

Per your suggestion I commented out the encryption reject and got:

dhdurgee@DHD-Z560 ~/bin/KindleUnpack_v075/lib $ ./kindleunpack.py /media/dhdurgee/Kindle/documents/Asimov\ s\ Science\ Fiction-asin_B00T8JNGO6-type_MAGZ-v_1.azw /var/tmp
KindleUnpack v0.75
   Based on initial mobipocket version Copyright © 2009 Charles M. Hannum <root@ihack.net>
   Extensive Extensions and Improvements Copyright © 2009-2014 
       by:  P. Durrant, K. Hendricks, S. Siebert, fandrieu, DiapDealer, nickredding, tkeo.
   This program is free software: you can redistribute it and/or modify
   it under the terms of the GNU General Public License as published by
   the Free Software Foundation, version 3.
Unpacking Book...
Palm DB type: BOOKMOBI, 124 sections.
Warning: Bad key, size, value combination detected in EXTH  406 16 0000000000000000
Unpacking a Mobipocket 6 book...
Processing Mobipocket 6 section of book...
Mobi Version: 6
Codec: utf-8
Title: Asimov's Science Fiction
EXTH Title: Asimov's Science Fiction
Huffdic compression
Book is encrypted
Unpacking images, resources, fonts, etc
Extracting image: image00110.jpeg from section 110
Extracting image: image00111.jpeg from section 111
Extracting image: image00112.jpeg from section 112
Extracting image: image00113.jpeg from section 113
Extracting image: image00114.jpeg from section 114
Extracting image: image00115.jpeg from section 115
Extracting image: image00116.jpeg from section 116
Extracting image: image00117.jpeg from section 117
Extracting image: cover00118.jpeg from section 118
Extracting image: image00119.jpeg from section 119
Unpacking raw markup language
Write ncx
Find link anchors
Insert data into html
Insert hrefs into html
Remove empty anchors from html
Insert image references into html
Error: Referenced image 0 was not recognized as a valid image
Error: Referenced image 0 was not recognized as a valid image
Error: Referenced image 0 was not recognized as a valid image
Error: Referenced image 0 was not recognized as a valid image
Error: Referenced image 0 was not recognized as a valid image
Error: Referenced image 0 was not recognized as a valid image
Error: Referenced image 0 was not recognized as a valid image
Error: Referenced image 0 was not recognized as a valid image
Building an opf for mobi7/azw4.
Completed
dhdurgee@DHD-Z560 ~/bin/KindleUnpack_v075/lib $

Looking in the target directory I see:

dhdurgee@DHD-Z560 ~/bin/KindleUnpack_v075/lib $ ls -l /var/tmp/mobi7/Images/
total 424
-rw-r--r-- 1 dhdurgee dhdurgee 36016 Feb 26 14:38 cover00118.jpeg
-rw-r--r-- 1 dhdurgee dhdurgee 36016 Feb 26 14:38 image00110.jpeg
-rw-r--r-- 1 dhdurgee dhdurgee 78272 Feb 26 14:38 image00111.jpeg
-rw-r--r-- 1 dhdurgee dhdurgee 26388 Feb 26 14:38 image00112.jpeg
-rw-r--r-- 1 dhdurgee dhdurgee 83056 Feb 26 14:38 image00113.jpeg
-rw-r--r-- 1 dhdurgee dhdurgee 15888 Feb 26 14:38 image00114.jpeg
-rw-r--r-- 1 dhdurgee dhdurgee 42304 Feb 26 14:38 image00115.jpeg
-rw-r--r-- 1 dhdurgee dhdurgee 47236 Feb 26 14:38 image00116.jpeg
-rw-r--r-- 1 dhdurgee dhdurgee 34532 Feb 26 14:38 image00117.jpeg
-rw-r--r-- 1 dhdurgee dhdurgee 13024 Feb 26 14:38 image00119.jpeg
dhdurgee@DHD-Z560 ~/bin/KindleUnpack_v075/lib $

So the images are there and I can view them. Is the problem that the name cover*.jpeg is unexpected?

Dave

PS: as a further test I ran the hacked version on one of the files:

dhdurgee@DHD-Z560 ~/bin/KindleUnpack_v075/lib $ ./kindleunpackhack.py /media/dhdurgee/Kindle/documents/Fantasy\ Science\ Fiction\ Extended-asin_B00TZI7G9Q-type_MAGZ-v_1.azw /var/tmp
MobiCover 0.4.N (ripped out of kindleunpack v0.66b)
   Based on initial version Copyright © 2009 Charles M. Hannum <root@ihack.net>
   Extensions / Improvements Copyright © 2009-2014 P. Durrant, K. Hendricks, S. Siebert, fandrieu, DiapDealer, nickredding, tkeo.
   This program is free software: you can redistribute it and/or modify
   it under the terms of the GNU General Public License as published by
   the Free Software Foundation, version 3.
Unpacking Book...
Palm DB type: BOOKMOBI, 176 sections.
Unpacking a Mobipocket 6 book...
Processing Mobipocket 6 section of book...
Book is encrypted
Mobi Version: 6
Codec: utf-8
Title: Fantasy & Science Fiction, Extended Edition
EXTH Title: Fantasy & Science Fiction, Extended Edition
Huffdic compression
Unpacking cover image
Extracting cover image: image00170.jpeg as cover_raw_B00TZI7G9Q.jpeg from section 170
Completed
dhdurgee@DHD-Z560 ~/bin/KindleUnpack_v075/lib $

As you can see it ran. So what is going wrong?

Dave

[NiLuJe]

Huh. Does it look sane-ish, as an image?

But since you've eliminated the usual culprit, yeah, check the system logs (syslog in a shell, or by entering ;dm in the Homescreen's searchbar), that's strange.

[dhdurgee]

Originally Posted by NiLuJe

Huh. Does it look sane-ish, as an image?

But since you've eliminated the usual culprit, yeah, check the system logs (syslog in a shell, or by entering ;dm in the Homescreen's searchbar), that's strange.

The covers extracted look OK to me. Given I don't know what to look for, I am uploading the log here for you to examine as well as the covers. After you have a chance to inspect things let me know what you would like me to do next.

Dave

[dhdurgee]

Is there a way I can restart the cover watchdog from myts? I am thinking that if I did so I could observe the standard output and error messages and they might give a clue as to the problem. Alternatively, do you have additional options I could add in starting the cover watchdog from there that could either increase debugging or capture any output for analysis.

I find that I can invoke kindleunpack.py from myts, but given the long names of the magazines it will be difficult to actually run it from there unless I can link a shorter name to it.

Any other suggestions?

Dave

PS: I copied one of the magazines to a file with shorter name and ran kindleunpack.py against it on the K3W via myts and it worked. So the puzzle remains.

[knc1]

The user storage is FAT32 - Bill G. didn't include support for links.

[eschwartz]

hardlinks maybe. What is wrong with symlinks?

(or tab autocompletion...)

[dhdurgee]

Originally Posted by eschwartz

hardlinks maybe. What is wrong with symlinks?

(or tab autocompletion...)

Didn't try a symlink. If there is a tab mapping in myts I can't find it.

Dave