[GUI Plugin] KindleUnpack - The Plugin

[bmhhtyf]

Originally Posted by DiapDealer

I doubt it has much to do with your issue, but keep in mind that any 0.72.x versions of the plugin that were floating around were strictly for testing/beta purposes. The "official" releases jumped from 0.71 to 0.73. If you can, uninstall the plugin ... restart calibre ... install the plugin ... restart calibre (before attempting to use the plugin), and see what happens.

If it still crashes, definitely try running calibre in debug mode like Kevin mentioned, to see if it will give us any clues.

This is the debug report on my laptop. Is there any clues?
calibre 调试日志
calibre 1.48 isfrozen: True is64bit: False
Windows-7-6.1.7601-SP1 Windows ('32bit', 'WindowsPE')
('Windows', '7', '6.1.7601')
Python 2.7.5
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Starting up...
Traceback (most recent call last):
File "site-packages\calibre\gui2\ui.py", line 162, in __init__
File "site-packages\calibre\gui2\ui.py", line 176, in init_iaction
File "site-packages\calibre\customize\__init__.py", line 582, in load_actual_plugin
File "importlib\__init__.py", line 37, in import_module
File "site-packages\calibre\customize\zipplugin.py", line 179, in load_module
File "calibre_plugins.kindleunpack_plugin.extractio n", line 25, in <module>
File "site-packages\calibre\customize\zipplugin.py", line 179, in load_module
File "calibre_plugins.kindleunpack_plugin.config", line 28, in <module>
File "ntpath.py", line 301, in expanduser
UnicodeDecodeError: 'utf8' codec can't decode byte 0xcc in position 9: invalid continuation byte
Started up in 4.59 seconds with 650 books

Thanks!

[DiapDealer]

Yes there are some clues. I'll check when I get home, but I'm guessing your home directory contains characters other than ascii? Still doesn't really explain why the older version works while the newer doesn't (with the same home directory). It's entirely within the realm of possibility that I just broke something along the way with regard to unicode/utf8 paths, of course.

[DiapDealer]

Yeah, all the previous versions of KindleUnpack should've been barfing on you as well (if you're using it on the same machine with the same user account), because the exact same line of code occurs in each 0.72.1/2 0.73.0 and 0.75.0.

This seems to be a Python 2.7 bug. os.path.expanduser('~') appears to be broken on Windows when usernames contain non-ascii characters. There also appears to be no interest in fixing the python bug.

Until I can come up with a workaround for the python bug, my only suggestion would be to run calibre under a user account that only contains ascii characters.

[DiapDealer]

I'm going to put this version of the plugin here for testing. In addition to updating the core to KindleUnpack 0.77, I've incorporated a workaround that I hope will solve bmhhtyf's issue. I'm sure calibre itself has a helper function or some other way to deal easily with this python bug, but until I figure out what that is, I hope this will work. If it does, I'll release it as v0.77.0.

Please let me know.

[bmhhtyf]

Originally Posted by DiapDealer

I'm going to put this version of the plugin here for testing. In addition to updating the core to KindleUnpack 0.77, I've incorporated a workaround that I hope will solve bmhhtyf's issue. I'm sure calibre itself has a helper function or some other way to deal easily with this python bug, but until I figure out what that is, I hope this will work. If it does, I'll release it as v0.77.0.

Please let me know.

This version works well. Thank you!
Hope for version 0.77.

[kovidgoyal]

@DiapDealer: from calibre.utils.filenames import expanduser

[bmhhtyf]

Originally Posted by DiapDealer

I'm going to put this version of the plugin here for testing. In addition to updating the core to KindleUnpack 0.77, I've incorporated a workaround that I hope will solve bmhhtyf's issue. I'm sure calibre itself has a helper function or some other way to deal easily with this python bug, but until I figure out what that is, I hope this will work. If it does, I'll release it as v0.77.0.

Please let me know.

By the way, I have another question. When I send both mobi (built by kindlegen) and azw3 (split by kindleunpack) to kindle paperwhite, the azw3's cover (or thumbnail) shows smaller than the mobi's, which is limited to 157x240. The original mobi's cover is 216x330. Is there any solutions?

Thanks!

[DiapDealer]

Originally Posted by kovidgoyal

@DiapDealer: from calibre.utils.filenames import expanduser

Thanks man! I knew there had to be something, but I hadn't had time to go looking yet. Appreciate it.

[DiapDealer]

Originally Posted by bmhhtyf

By the way, I have another question. When I send both mobi (built by kindlegen) and azw3 (split by kindleunpack) to kindle paperwhite, the azw3's cover (or thumbnail) shows smaller than the mobi's, which is limited to 157x240. The original mobi's cover is 216x330. Is there any solutions?

Thanks!

The normal unpacking procedure honors the "use HD images if present" setting from the plugin's configuration, but I'll be honest, I'm not that familiar with the splitting portion of the core code (other than to call it of course). I'll do some checking and ask around.

[DiapDealer]

Plugin updated to version 0.77.0 to match the updated core KindleUnpack code. Also fixed a bug that affected Windows users whose username contained non-ascii characters.

Details concerning the changes to the core KindleUnpack code can be found here.

[bmhhtyf]

When I convert azw3 to epub (one of them, not all), the plugin reports:

calibre, version 2.7.0
错误： KindleUnpack - The Plugin v0.77.0: 'Unknown_517'

Traceback (most recent call last):
File "calibre_plugins.kindleunpack_plugin.extractio n", line 194, in convert_ebook
File "calibre_plugins.kindleunpack_plugin.utilities ", line 285, in unpackEPUB
File "calibre_plugins.kindleunpack_plugin.core.kindleun pack", line 870, in unpackBook
File "calibre_plugins.kindleunpack_plugin.core.kindleun pack", line 789, in process_all_mobi_headers
File "calibre_plugins.kindleunpack_plugin.core.kindleun pack", line 542, in processMobi8
File "calibre_plugins.kindleunpack_plugin.core.mobi_opf ", line 103, in __init__
File "calibre_plugins.kindleunpack_plugin.core.mobi_opf ", line 618, in processRefinesMetadata
KeyError: 'Unknown_517'

And the Calibre debug log shows:

calibre 调试日志
calibre 2.7 [64bit] isfrozen: True is64bit: True
Windows-7-6.1.7601-SP1 Windows ('64bit', 'WindowsPE')
('Windows', '7', '6.1.7601')
Python 2.7.8
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM && Extract ISBN && Generate Cover && Quality Check && Count Pages && Modify ePub && Resize Cover && KindleUnpack - The Plugin
Starting up...
Started up in 2.61 seconds with 8 books
Book ID 42
AZW3
Q:\Calibre\Jiang Rong\Lang Tu Teng (42)\Lang Tu Teng - Jiang Rong.azw3
Palm DB type: BOOKMOBI, 396 sections.
Warning: Bad key, size, value combination detected in EXTH 406 16 0000000000000000
Unpacking a KF8 book...
Processing K8 section of book...
Mobi Version: 8
Codec: utf-8
Title: 鐙煎浘鑵?
EXTH Title: 鐙煎浘鑵?
Huffdic compression
Unpacking images, resources, fonts, etc
Extracting image: image00377.jpeg from section 377
Extracting image: cover00378.jpeg from section 378
Extracting image: image00380.jpeg from section 380
Warning: Section 383 does not contain a recognised resource
Warning: Section 384 does not contain a recognised resource
Warning: Section 385 does not contain a recognised resource
Warning: Section 386 does not contain a recognised resource
Warning: Section 387 does not contain a recognised resource
Warning: Section 388 does not contain a recognised resource
Warning: Section 389 does not contain a recognised resource
Warning: Section 390 does not contain a recognised resource
Warning: Section 391 does not contain a recognised resource
Unpacking raw markup language
Processing ncx / toc
Building an epub-like structure
Building proper xhtml for each file
Building a cover page.
Failed to check for calibre update: <urlopen error [Errno 11004] getaddrinfo failed>
Failed to check for plugin update: <urlopen error [Errno 11004] getaddrinfo failed>
Restarting with: C:\Program Files\Calibre2\calibre-debug.exe ['calibre-debug.exe', u'--gui-debug', u'd:\\temp\\tmpmdnt6f.txt']

Thanks!

[DiapDealer]

@bmhhtyf
Can you tell me what the "ePub Type" setting (in the KindleUnpack plugin configuration) is set to?

When working with that particular azw3, can you try both the 'auto' and the 'epub3' setting and see if it makes a difference?

[bmhhtyf]

Wow, 'epub3' setting works, but 'auto' doesn't work.

[DiapDealer]

Originally Posted by bmhhtyf

Wow, 'epub3' setting works, but 'auto' doesn't work.

Well that's good to know! Was it originally set to ePub2? It does seem to be a bug in the core code, regardless. If you can hang on to that problem azw3 for a bit, I'd like to get you a test version of the plugin to see if we can handle that situation better.

It may not be until later today so check back if you can.

Thanks.

[DiapDealer]

@bmhhtyf:

I had a chance to throw a test version of the plugin together. If you would be so kind as try it? After installing the test version of the plugin, please set the ePub Type back to ePub2 and see if it works for your problematic azw3. You might also see if it works on the "auto" setting.

Thanks for your help.

EDIT: to all others... there's no need to use this test version if you're not having any issues. The bugfixes that are being tested will eventually make it into the release version at some point