[Conversion Plugin] KFX Input

[wllmskhspr]

The "From KFX input plugin" shows this popup on the conversion complete. Is it possible not to display this?

[jhowell]

Originally Posted by wllmskhspr

The "From KFX input plugin" shows this popup on the conversion complete. Is it possible not to display this?

Not currently.

I plan to eventually improve the plugin so that it performs conversions as a background job and at that time I will add the ability to control whether or not a dialog is shown upon completion.

[DNSB]

Originally Posted by jhowell

Not currently.

I plan to eventually improve the plugin so that it performs conversions as a background job and at that time I will add the ability to control whether or not a dialog is shown upon completion.

Is allowing selecting multiple books for conversion in the plans? Either that or I am having a Doh! moment.

[jhowell]

Originally Posted by DNSB

Is allowing selecting multiple books for conversion in the plans? Either that or I am having a Doh! moment.

Not currently. But I will add that to my todo list for a future release once the ability to convert using background jobs has been implemented.

[theginger80s]

Hello, thanks so much for all your work on this! It's been a lifesaver in trying to recover usable versions of my family's Kindle books ever since discovering too late that they suddenly decided to remove the sideload option! I've immediately switched to Kobo but am trying to back everything from Kindle up.

The only thing is, almost everything converted just fine except for a handful of books and I'm not sure why those particular titles are having problems. I'm getting the error:

calibre, version 8.0.1
ERROR: KFX conversion failed: Cannot convert (title of book)
Exception('Book is incomplete. All of the KFX container files that make up the book must be combined into a KFX-ZIP file for successful conversion. (Missing containers CR!T0JGF3F0S14EQ6C4C0M401G4YWYV)\nReferenced fragment is missing from book: resource/rsrc37Z:: $417::\nMissing bcRawMedia resource/rsrc37Z')

I read the main page for the plugin here and saw this type of error referenced as an update in an earlier version. I have the latest version of the plugin so I'm not sure why I would still be getting that error on 12 specific books.

Would you be able to please tell me if I've missed something and if there's a way for me to convert and back those up? Or are we pretty much out of luck for those particular books?

Thanks again!

[jhowell]

Originally Posted by theginger80s

The only thing is, almost everything converted just fine except for a handful of books and I'm not sure why those particular titles are having problems. I'm getting the error: ...

Books in KFX format are split up into a set of files which allows the user to start reading while some of the content is still being downloaded in the background. The most likely cause of that error is that the book being imported was not fully downloaded to the Kindle app/device. That seems to happen sometimes by chance but is much more likely to occur if you download a lot of books at once.

Originally Posted by theginger80s

Would you be able to please tell me if I've missed something and if there's a way for me to convert and back those up? Or are we pretty much out of luck for those particular books?

Try removing the downloads of those specific books from the Kindle device or app and then re-downloading then again more slowly, pausing for a short time to allow each one to complete before starting the next. That will likely fix the problem.

If the problem persists with several attempts at doing that it could be due a book with actual missing content. In that case if you post the ASINs of those books I may be able to look into it further.

[theginger80s]

You're amazing. That worked perfectly; thank you so much! I was getting so annoyed because my mother relies on these cheesy cozy mysteries to fall asleep at night and she's bought about 200 of them over the years. We were not impressed by the company's shady move to suddenly prevent people from backing up and using books they have paid to legally own, so this option to recover her library and make sure she can use it properly has been, as I said, a lifesaver.

It was a massive pain because her device is ancient and constantly messes up the downloads when you try to open multiple books back to back, but with a lot of time and finagling and rebooting, I was finally able to remove and redownload all the books and get them properly backed up into my digital library. This whole thing is completely ridiculous and shameful, but I really appreciate the effort people like you put in to make these ebooks usable!

[jhowell]

Originally Posted by theginger80s

This whole thing is completely ridiculous and shameful, but I really appreciate the effort people like you put in to make these ebooks usable!

I'm glad to hear that you got it working.

I'm worried that Amazon will continue to lock things down more tightly so that extracting Kindle book purchases will become more difficult in the future. Best to do it now while you can.

[theginger80s]

Oh for sure they will. I'm done with Kindle and have already switched to Kobo and am so much happier with it as a system that I'm actually glad Amazon pulled this nonsense and drove me away. Aside from the obvious offline/sideload abilities, it's just so much cleaner. No ads, no clutter, separate tab for series, and I can actually manage my entire library through Calibre and simply transfer everything, with no effort, to any device, including collections with the Calibre tags, which is something Kindle was astoundingly lacking. I'll never buy another book from Amazon.

My mother won't buy any more books from them either, though she'll probably keep Kindle Unlimited because she likes those cozy mystery series and doesn't need to actually own copies of them. But we won't pay to "buy" any more books from them when they're not giving people proper ownership of the files. I'll be doing the same cleanup and backup for my dad when he visits in a few days and am considering buying him a Kobo too, since he doesn't even really use his Kindle right now and mostly reads on his phone or computer lol.

[mallomar]

Got an error when trying to convert this book:

Spoiler:

calibre, version 8.1.1
ERROR: KFX conversion failed: <p><b>Cannot convert Kalooki Nights</b><br><br>Exception('Unexpected image style for SVG wrapper (img h=572, w=432): b\'&lt;div style="margin-top: 0.25lh; text-align: center; text-indent: 0"&gt;&lt;img src="images/image_fm.jpg" alt="" style="left: 0; top: 0; width: 100%%"/&gt;&lt;/div&gt;\'')</p>

I also get errors when I try to open the KFX file within Calibre:

Spoiler:

calibre, version 8.1.1
ERROR: Loading book failed: Failed to open the book at /Users/rapaz/Box Sync/Calibre Library/Howard Jacobson/Kalooki Nights (663)/Kalooki Nights - Howard Jacobson.kfx. Click "Show details" for more info.

Failed to convert book: /Users/rapaz/Box Sync/Calibre Library/Howard Jacobson/Kalooki Nights (663)/Kalooki Nights - Howard Jacobson.kfx with error:
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/Ignoble Epub DeDRM.zip'
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/Inept Epub DeDRM.zip'
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/Inept PDF DeDRM.zip'
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/Kindle and Mobipocket DeDRM.zip'
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/Kindle covers (G).zip'
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/eReader PDB 2 PML.zip'
Integration status: True
----------------------------------- REMARKABLE PLUGIN web interface ------------------------
KFX metadata reader (from KFX Input) activated for /Users/rapaz/Box Sync/Calibre Library/Howard Jacobson/Kalooki Nights (663)/Kalooki Nights - Howard Jacobson.kfx
DeDRM v10.0.9: Trying to decrypt Kalooki Nights - Howard Jacobson.kfx
Unknown booktype kfx. Passing back to calibre unchanged
InputFormatPlugin: KFX Input running
on /Users/rapaz/Box Sync/Calibre Library/Howard Jacobson/Kalooki Nights (663)/Kalooki Nights - Howard Jacobson.kfx
Software versions: KFX Input 2.22.0, calibre 8.1.1, macOS-15.4-arm64-arm-64bit
KFX Input plugin help is available at https://www.mobileread.com/forums/showthread.php?t=291290
Converting /Users/rapaz/Box Sync/Calibre Library/Howard Jacobson/Kalooki Nights (663)/Kalooki Nights - Howard Jacobson.kfx
Processing container: /Users/rapaz/Box Sync/Calibre Library/Howard Jacobson/Kalooki Nights (663)/Kalooki Nights - Howard Jacobson.kfx
Features: kfxgen.pidMapWithOffset-1, kfxgen.textBlock-1, reflow-section-size-2, reflow-style-1
Metadata: ASIN=B000OVLKRM, asset_id=CR!ENJTE53PJD3ZQCGGF18EWSFW1QK2, author="Jacobson, Howard", author="Howard Jacobson", cde_content_type=EBOK, content_id=B000OVLKRM, cover_image=600x800, creator_version=2.15.0, file_creator=YJConversionTools, is_sample=False, issue_date=2007-04-03, kfxgen=20.12.238.0, language=en, max_id=634, min_kindle_version=5.6.5, pages=467, publisher="Simon & Schuster", reading_orders=1, selection=enabled, title="Kalooki Nights: A Novel", title="Kalooki Nights"
Converting book to EPUB 3
Book symbol format is original
ERROR: Unexpected image style for SVG wrapper (img h=572, w=432): b'<div style="margin-top: 0.25lh; text-align: center; text-indent: 0"><img src="images/image_fm.jpg" alt="" style="left: 0; top: 0; width: 100%"/></div>'
Failed to run pipe worker with command: from calibre.srv.render_book import viewer_main; viewer_main()
Traceback (most recent call last):
  File "calibre_plugins.kfx_input.__init__", line 114, in convert
Exception: Unexpected image style for SVG wrapper (img h=572, w=432): b'<div style="margin-top: 0.25lh; text-align: center; text-indent: 0"><img src="images/image_fm.jpg" alt="" style="left: 0; top: 0; width: 100%"/></div>'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "runpy.py", line 198, in _run_module_as_main
  File "runpy.py", line 88, in _run_code
  File "site.py", line 42, in <module>
  File "site.py", line 38, in main
  File "calibre/utils/ipc/worker.py", line 196, in main
  File "<string>", line 1, in <module>
  File "calibre/srv/render_book.py", line 845, in viewer_main
  File "calibre/srv/render_book.py", line 836, in render_for_viewer
  File "calibre/srv/render_book.py", line 813, in render
  File "calibre/ebooks/oeb/iterator/book.py", line 64, in extract_book
  File "calibre/customize/conversion.py", line 242, in __call__
  File "calibre_plugins.kfx_input.__init__", line 120, in convert
calibre.ebooks.conversion.ConversionUserFeedBack: {"msg": "<b>Cannot convert ?</b><br><br>Exception('Unexpected image style for SVG wrapper (img h=572, w=432): b\\'&lt;div style=\"margin-top: 0.25lh; text-align: center; text-indent: 0\"&gt;&lt;img src=\"images/image_fm.jpg\" alt=\"\" style=\"left: 0; top: 0; width: 100%%\"/&gt;&lt;/div&gt;\\'')", "level": "error", "det_msg": "", "title": "KFX conversion failed"}

Converting works when I use the From KFX plugin, FWIW. I'm not sure what the difference is in the converted file.

As a total aside, after polishing the EPUB in Calibre it did weird things offsetting the centered headings and I'm not sure which option is responsible for that.

[DNSB]

Am I reading your log file correctly and your calibre library is being synced with Box? Unless you configured a one-way sync which from my memories of playing with Box is not easily done. The recommendation for a one-way sync was to use RClone to do a one-way sync to Box Drive. At this time, moving your calibre library to a location where it is not being two-way synced to cloud storage.

Another item that seems a bit odd is the presence of antique DeDRM files and a couple of other plugins that are not being initialized.

I tried a sample but that converted without issue.

[jhowell]

Originally Posted by mallomar

Got an error when trying to convert this book

The conversion log shows some unexpected formatting that I had not encountered previously. The next release of the plugin will ignore that extra data.

If you do not want to wait you should be able to convert that book by using From KFX or by selecting the conversion option "Allow conversion to proceed even if errors are detected" in the KFX Input tab of the conversion dialog.

Originally Posted by mallomar

As a total aside, after polishing the EPUB in Calibre it did weird things offsetting the centered headings and I'm not sure which option is responsible for that.

Likely due to the unusual formatting contained in that book. The metadata in the conversion log shows that Amazon converted that book to KFX format in the early days of KFX, 2015. They have improved their conversion process a lot since then.

[gbm]

I have found that KFX will put "text-align" and text-indent" in the body css. Calibre conversion will not recognize text-align: center" if it is in the body css.

From kfx:

<body class="class-1">

.class-1 {text-align: center}

from calibre converted epub:

 <body class="calibre">

.calibre {
  display: block;
  font-size: 1em;
  line-height: 1.2;
  margin-bottom: 0;
  margin-left: 4pt;
  margin-right: 4pt;
  margin-top: 0;
  orphans: 1;
  padding-left: 0;
  padding-right: 0;
  text-align: justify;
  widows: 1;
}

bernie

Originally Posted by jhowell

The conversion log shows some unexpected formatting that I had not encountered previously. The next release of the plugin will ignore that extra data.

If you do not want to wait you should be able to convert that book by using From KFX or by selecting the conversion option "Allow conversion to proceed even if errors are detected" in the KFX Input tab of the conversion dialog.



Likely due to the unusual formatting contained in that book. The metadata in the conversion log shows that Amazon converted that book to KFX format in the early days of KFX, 2015. They have improved their conversion process a lot since then.

[mallomar]

Originally Posted by gbm

I have found that KFX will put "text-align" and text-indent" in the body css. Calibre conversion will not recognize text-align: center" if it is in the body css.

Odd. Maybe Kovid isn't aware of this bug?

Originally Posted by DNSB

Am I reading your log file correctly and your calibre library is being synced with Box? Unless you configured a one-way sync which from my memories of playing with Box is not easily done. The recommendation for a one-way sync was to use RClone to do a one-way sync to Box Drive. At this time, moving your calibre library to a location where it is not being two-way synced to cloud storage.

I appreciate your concern. Calibre Sync says Box storage is okay. As a safety precaution I back up my library both locally and with another cloud backup site. I also disable syncing whenever I am in Calibre and resume it when I am out of the program.

Originally Posted by DNSB

Another item that seems a bit odd is the presence of antique DeDRM files and a couple of other plugins that are not being initialized.

I tried a sample but that converted without issue.

You're referring to this, right?

Spoiler:

Failed to convert book: /Users/rapaz/Box Sync/Calibre Library/Howard Jacobson/Kalooki Nights (663)/Kalooki Nights - Howard Jacobson.kfx with error:
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/Ignoble Epub DeDRM.zip'
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/Inept Epub DeDRM.zip'
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/Inept PDF DeDRM.zip'
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/Kindle and Mobipocket DeDRM.zip'
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/Kindle covers (G).zip'
Failed to initialize plugin: '/Users/rapaz/Library/Preferences/calibre/plugins/eReader PDB 2 PML.zip'

I double checked and I only have DeDRM 10.0.9 and Obok DeDRM 10.0.9, which comes packaged with it, installed. I'm not sure what the issue is with the Kinlde hi-res covers plugin is (I'm guessing this is it, though this doesn't specify hi-res?). I also don't know what the last plugin is. Nothing comes up when I search for PDB under the plugins preferences.

Originally Posted by jhowell

The conversion log shows some unexpected formatting that I had not encountered previously. The next release of the plugin will ignore that extra data.

Thanks. Let me know if you'd like me to DM you the book file for troubleshooting.

[jhowell]

Originally Posted by gbm

Calibre conversion will not recognize text-align: center" if it is in the body css.

It works for me. I just converted a book using the calibre conversion dialog from KFX to EPUB that had a short chapter of centered text. Here is what KFX Input produced:

<body class="class-1">

.class-1 {font-family: sans-serif; font-weight: bold; text-align: center}

And here is the resulting EPUB produced by calibre conversion with text-align retained:

<body class="class">

.class {
    display: block;
    font-family: sans-serif;
    font-weight: bold;
    padding-left: 0;
    padding-right: 0;
    text-align: center;
    margin: 0 5pt;
    }

I suspect that you have some other conversion setting that is interfering. I might be able to tell from a full conversion log.