[Conversion Plugin] KFX Input

[Supervin79]

Hi, I have a problem with the conversions with Calibre (v.3.40.1 x64) of KFX-ZIP format files downloaded from Kindle PC (v1.24.51068): a warning message regards to the DRM doesn't allow the conversion of the files.
I use the latest plugins KFX v1.14.0 and DeDRM v.6.6.2.
I have not problem with conversion of azw or kfx format.
Can someone help me?

Thank you in advance.

[theducks]

Originally Posted by Supervin79

Hi, I have a problem with the conversions with Calibre (v.3.40.1 x64) of KFX-ZIP format files downloaded from Kindle PC (v1.24.51068): a warning message regards to the DRM doesn't allow the conversion of the files.
I use the latest plugins KFX v1.14.0 and DeDRM v.6.6.2.
I have not problem with conversion of azw or kfx format.
Can someone help me?

Thank you in advance.

MR rules say we can not help with DRM removal . Visit Alf's place where you got those tools.

[stefano.sb]

Hi, after settings tweak "kfx_input_set_format_virtual" to False the KFX input plugin correctly transfers books in KFX format from an e-ink Kindle (running firmware prior to version 5.10.2) using the calibre "Device" view settings but...
why at the end of this import the two flag "On Device" (Kindle) and "In Library" (calibre) are not set correctly? I have to use Calibre "Match book to library" function to "join" the ebook imported into library and corresponding ebook stored into device

Stefano

[jhowell]

Originally Posted by stefano.sb

Hi, after settings tweak "kfx_input_set_format_virtual" to False the KFX input plugin correctly transfers books in KFX format from an e-ink Kindle (running firmware prior to version 5.10.2) using the calibre "Device" view settings but...
why at the end of this import the two flag "On Device" (Kindle) and "In Library" (calibre) are not set correctly?

Make sure that under Preferences->Adding Books in the Reading Metadata tab that the option "Read metadata from file contents rather than file name" is checked. Without that the entry created in your calibre library during import will not match what is on the device.

[ilovejedd]

Originally Posted by jhowell

Make sure that under Preferences->Adding Books in the Reading Metadata tab that the option "Read metadata from file contents rather than file name" is checked. Without that the entry created in your calibre library during import will not match what is on the device.

I have that setting enabled but I experience the same issue as Stefano.

From what I can tell, it seems to stem from author mismatch.

On Device:
Roberts, Nora
Roberts, Nora & Nora Roberts

In Library (using Add books to library):
Nora Roberts
Nora Roberts

[jhowell]

Originally Posted by ilovejedd

I have that setting enabled but I experience the same issue as Stefano.

From what I can tell, it seems to stem from author mismatch.

On Device:
Roberts, Nora
Roberts, Nora & Nora Roberts

In Library (using Add books to library):
Nora Roberts
Nora Roberts

That is odd. It appears that calibre is not handling author names containing commas correctly for KFX books in the device view for you. (The author names for KFX books in device view look normal for me when I attach my Kindle.)

It appears there is something different between your and my calibre installations. Is it possible you have changed a calibre setting or tweak related to handling author sort names?

[ilovejedd]

Originally Posted by jhowell

That is odd. It appears that calibre is not handling author names containing commas correctly for KFX books in the device view for you. (The author names for KFX books in device view look normal for me when I attach my Kindle.)

It appears there is something different between your and my calibre installations. Is it possible you have changed a calibre setting or tweak related to handling author sort names?

That was exactly it. Thanks!

I have mixed library types in this Calibre Portable instance and had the following tweaks.

Tweaks:
author_sort_copy_method = 'copy'


Plugin Tweaks:
job_spy_author_sort_copy_method = {'kindle': 'comma'}

I normally just use K4PC 1.17 (azw3) so I hadn't encountered this previously. I recently started messing with KFX but wanted to keep my K4PC install on 1.17. Hence, I downloaded KFX to my Paperwhite and used the "Add books to library" to import to Calibre. I'll have to remember to use my Calibre Portable "book" instance/profile for transferring books from my Paperwhite.

[stefano.sb]

Originally Posted by ilovejedd

That was exactly it. Thanks!

I have mixed library types in this Calibre Portable instance and had the following tweaks.

Tweaks:
author_sort_copy_method = 'copy'


Plugin Tweaks:
job_spy_author_sort_copy_method = {'kindle': 'comma'}

Adding job_spy_author_sort_copy_method = {'kindle': 'comma'} it works!

Is there a list of Plugin Tweaks?

Thanks

[Timboli]

Hello jhowell.

This current Amazon freebie for me refused to convert from KFX.

https://www.amazon.com/Defenseless-B...dp/B00NMON9D6/

This is the error message.

calibre, version 3.40.1
ERROR: KFX conversion failed: <p><b>Cannot convert The Defenseless</b><br><br>Unexpected style definition: color: $349
Unexpected style definition: color: $349
Unexpected style definition: color: $349
Unexpected style definition: color: $349</p>

The other 11 KFX ebooks I did, converted fine.

Cheers & Thanks again for all you great work.

EDIT
Using the 'Allow conversion to complete even if errors ...' option enabled, resulted in seemingly ok conversions to EPUB and MOBI. No apparent textual errors on the many pages I checked. At least in the calibre ebook viewer.

[jhowell]

Originally Posted by Timboli

This current Amazon freebie for me refused to convert from KFX.
https://www.amazon.com/Defenseless-B...dp/B00NMON9D6/

Thanks for the error report!

That book contains KFX content that I have not seen before. I will add support for it in the next release of this plugin.

Originally Posted by Timboli

Using the 'Allow conversion to complete even if errors ...' option enabled, resulted in seemingly ok conversions to EPUB and MOBI. No apparent textual errors on the many pages I checked. At least in the calibre ebook viewer.

There will be some minor issues in the stylesheet of the book as a result of this problem, but it will not affect the text of the book.

[Timboli]

@jhowell - My pleasure and thanks.

[stefano.sb]

Originally Posted by jhowell

That is odd. It appears that calibre is not handling author names containing commas correctly for KFX books in the device view for you. (The author names for KFX books in device view look normal for me when I attach my Kindle.)

It appears there is something different between your and my calibre installations. Is it possible you have changed a calibre setting or tweak related to handling author sort names?

Hi, in my Calibre v3.40.1 with KFX_input plugin installed v1.14.0 On Device and In Library flags are not correctly set after adding a kfx ebook :-(

I have "kfx_input_set_format_virtual = False" into Plug-in Tweaks and it's checked Read metadata from contents rather than file name under Adding books preferences

For example with this (free) ebook: https://www.amazon.it/Importance-Bei.../dp/B004UJCNKC

This is (part) of Calibre log after adding..

Job: 4 Prepare files for transfer from device started
DeviceJob: 4 Prepare files for transfer from device done, calling callback
DeviceJob: 4 Prepare files for transfer from device callback returned
Job: 4 Prepare files for transfer from device finished
No details available.
Gather KFX-ZIP (from KFX Input) 1.14.0: Importing D:\documents\The Importance of Being Earnest (English Edition)_B004UJCNKC.kfx
Gather KFX-ZIP (from KFX Input): Gathered 3 file(s) as C:\Users\ssbrogio\AppData\Local\Temp\calibre_prlpz k\25xrsf.kfx-zip
DeDRM v6.6.3: Trying to decrypt 25xrsf.kfx-zip
Using Library AlfCrypto DLL/DYLIB/SO
Decrypting KFX-ZIP ebook: 25xrsf
Got DSN key from database default_key
Got DSN key from database default_key_2
Found 6 keys to try after 0.1 seconds
Decrypting KFX DRM voucher: voucher
KFX DRM voucher successfully decrypted
Decrypting KFX DRMION: The Importance of Being Earnest (English Edition)_B004UJCNKC.kfx
Decryption succeeded after 0.2 seconds
DeDRM v6.6.3: Finished after 0.2 seconds
Package KFX (from KFX Input) 1.14.0: Packaging C:\Users\ssbrogio\AppData\Local\Temp\calibre_prlpz k\sqimuu.kfx-zip
Processing container: The Importance of Being Earnest (English Edition)_B004UJCNKC.kfx
Processing container: metadata.kfx
kfxgen version: 6.28.2.0/PackageVersion:YJReaderSDK-1.1.147.0 Month-Day:09-10
Features: kfxgen.positionMaps-2, kfxgen.textBlock-1, max_id-634, reflow-section-size-5, reflow-style-1
Metadata: ASIN=B004UJCNKC, asset_id=CR!12WAG5CPRX3M15SN01MYEM5JBGNW, author="Oscar Wilde", author="Wilde, Oscar", cde_content_type=EBOK, content_id=B004UJCNKC, cover_image=955x1433, creator_version=2.15.0, file_creator=YJConversionTools, is_sample=False, issue_date=2011-03-30, language=en, override_kindle_font=False, pages=105, reading_orders=1, selection=enabled, title="The Importance of Being Earnest"
Package KFX (from KFX Input): Imported as C:\Users\ssbrogio\AppData\Local\Temp\calibre_prlpz k\y5wcuz.kfx
KFX metadata reader (from KFX Input) activated for C:\Users\ssbrogio\AppData\Local\Temp\calibre_prlpz k\urhzp__add_books\0\The Importance of Being Earnest (English Edition)_B004UJCNKC.kfx
Added The Importance of Being Earnest to db in: 0.2
Added 1 books in 3.2 seconds
DeviceJob: set_books_in_library: books to process= 218
DeviceJob: set_books_in_library finished: time= 0.0610001087189

Thanks

Stefano

[jhowell]

Originally Posted by stefano.sb

Hi, in my Calibre v3.40.1 with KFX_input plugin installed v1.14.0 On Device and In Library flags are not correctly set after adding a kfx ebook :-(

I have "kfx_input_set_format_virtual = False" into Plug-in Tweaks and it's checked Read metadata from contents rather than file name under Adding books preferences

For example with this (free) ebook: https://www.amazon.it/Importance-Bei.../dp/B004UJCNKC

I tried that book, purchased for free from Amazon.com. After importing it from my Kindle the Device and Library views show a match checkmark. Both views have the author name "Oscar Wilde" and the title "The Importance of Being Earnest".

Since you do not have a match it seems that either the author name or title must differ between views in your case. What are you seeing for those in both views?

[stefano.sb]

Originally Posted by jhowell

I tried that book, purchased for free from Amazon.com. After importing it from my Kindle the Device and Library views show a match checkmark. Both views have the author name "Oscar Wilde" and the title "The Importance of Being Earnest".

Since you do not have a match it seems that either the author name or title must differ between views in your case. What are you seeing for those in both views?

On Device view: before and after import
Title: The Importance of Being Earnest (English Edition) B004UJCNKC
Author: Unknown

On Library view: after import
Title: The Importance of Being Earnest
Author: Oscar Wilde

I see only now that on device the author is "Unknown". I have a Kindle PW3 with fw 5.10.1.1 and jailbreak.

Stefano

[jhowell]

Originally Posted by stefano.sb

On Device view: before and after import
Title: The Importance of Being Earnest (English Edition) B004UJCNKC
Author: Unknown

The author is unknown and the file name is being used as the title under device view, indicating that calibre is unable to read the metadata from that book.

I have no idea what is going wrong since that problem does not occur with the equivalent book on my Kindle. I will need more information in order to look into this further.

According to your previous log when your Kindle is connected, the main filename for that book is:
D:\documents\The Importance of Being Earnest (English Edition)_B004UJCNKC.kfx

There should also be a folder named "The Importance of Being Earnest (English Edition)_B004UJCNKC.sdr" in D:\documents. Inside that there should be a folder named "assets" containing a file named "metadata.kfx". That is where the book's title and author are stored. Let me know if this file is not found where expected. If you can zip that file and add it as an attachment to a post here then I will take a look at it. (It contains nothing specific to your device/account and none of the book's content. Also that book is no longer under copyright anyway.)