[Conversion Plugin] KFX Input

[Qualitpet]

Originally Posted by jhowell

I was able to see this for myself in a new book. It will be fixed in the next plugin release.

Cool, thanks

[jhowell]

Version 1.11.0 - 08 Dec 2018

Add plugin tweak "kfx_input_set_format_virtual" that when set to True will prevent import of books in KFX format from e-ink Kindle devices in calibre "Device" view.

Support additional KFX features. (Fixes "ERROR: Unknown com.amazon.yjconversion feature: yj_table-8", "ERROR: Unexpected Ion symbols used: $292, $293, $749, $750, $751, $752", and "ERROR: Unexpected Ion symbols used: $760, $761".)

Ignore extraneous data produced by Kindle Previewer version 3.28.1.

[Qualitpet]

Originally Posted by jhowell

Version 1.11.0 - 08 Dec 2018

Conversion using Calibre seems to be working perfectly.

I am no longer getting "ERROR: Unexpected Ion symbols used: $760, $761"

[itsleviosa]

calibre, version 3.35.0
ERROR: KFX conversion failed: Unknown com.amazon.yjconversion feature: yj_mathml-1

The ebook imported to Calibre just fine, when it didn't convert to PDF I returned the Kindle ebook thinking I got a "dud". I've since rolled back Kindle reader (1.25 to 1.17 as per suggested) but no point syncing library to check if that fixed the issue since I don't have the darn book anymore :/

Am I a complete bonehead for jumping the gun and returning the ebook too soon?

Spoiler:

Convert book 1 of 1 (An Introduction to Cognitive Behaviour Therapy: Skills and Applications)
Conversion options changed from defaults:
read_metadata_from_opf: u'C:\\Users\\ceiha\\AppData\\Local\\Temp\\calibre_ hipype\\_dsnp0.opf'
output_profile: 'generic_eink'
cover: u'C:\\Users\\ceiha\\AppData\\Local\\Temp\\calibre_ hipype\\ddbst0.jpeg'
page_breaks_before: u"//*[name()='h1' or name()='h2']"
verbose: 2
Resolved conversion options
calibre version: 3.35.0
{'allow_conversion_with_errors': False,
'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0.0,
'book_producer': None,
'change_justification': u'original',
'chapter': u"//*[((name()='h1' or name()='h2') and re:test(., '\\s*((chapter|book|section|part)\\s+)|((prolog|pr ologue|epilogue)(\\s+|$))', 'i')) or @class = 'chapter']",
'chapter_mark': u'pagebreak',
'comments': None,
'cover': u'C:\\Users\\ceiha\\AppData\\Local\\Temp\\calibre_ hipype\\ddbst0.jpeg',
'custom_size': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'expand_css': False,
'extra_css': None,
'filter_css': u'',
'fix_indents': True,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x04A5DC50>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0.0,
'linearize_tables': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_inline_navbars': False,
'output_profile': <calibre.customize.profiles.GenericEink object at 0x04A5DE50>,
'page_breaks_before': u"//*[name()='h1' or name()='h2']",
'paper_size': u'letter',
'pdf_add_toc': False,
'pdf_default_font_size': 20,
'pdf_footer_template': None,
'pdf_header_template': None,
'pdf_hyphenate': False,
'pdf_mark_links': False,
'pdf_mono_family': u'Liberation Mono',
'pdf_mono_font_size': 16,
'pdf_page_margin_bottom': 72.0,
'pdf_page_margin_left': 72.0,
'pdf_page_margin_right': 72.0,
'pdf_page_margin_top': 72.0,
'pdf_page_number_map': None,
'pdf_page_numbers': False,
'pdf_sans_family': u'Liberation Sans',
'pdf_serif_family': u'Liberation Serif',
'pdf_standard_font': u'serif',
'pdf_use_document_margins': False,
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': False,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': u'C:\\Users\\ceiha\\AppData\\Local\\Temp\\calibre_ hipype\\_dsnp0.opf',
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': u'',
'search_replace': '[]',
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': None,
'sr1_search': None,
'sr2_replace': None,
'sr2_search': None,
'sr3_replace': None,
'sr3_search': None,
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': '[]',
'uncompressed_pdf': False,
'unit': u'inch',
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'use_profile_size': False,
'verbose': 2}
InputFormatPlugin: KFX Input running
on C:\Users\ceiha\AppData\Local\Temp\calibre_hipype\j 5jwdq.kfx
Software versions: KFX Input 1.11.0, calibre 3.35, Windows-10-10.0.17763-SP0
KFX Input plugin help is available at https://www.mobileread.com/forums/sh...d.php?t=291290
Converting C:\Users\ceiha\AppData\Local\Temp\calibre_hipype\j 5jwdq.kfx
Processing container: C:\Users\ceiha\AppData\Local\Temp\calibre_hipype\j 5jwdq.kfx
kfxgen version: 7.149.1.0/PackageVersion:YJReaderSDK-1.6.200363.0 Month-Day:03-19
ERROR: Unknown com.amazon.yjconversion feature: yj_mathml-1
Features: CanonicalFormat-2, kfxgen.textBlock-1, max_id-748, reflow-section-size-3, reflow-style-2
Metadata: ASIN=B01KIGAWUS, asset_id=CR!5NSEXH102X67NERQZJTWZZ410CSX, author="Kennerley, Helen", author="Kirk, Joan", author="Westbrook, David", book_id=UgIav_5TT22dAyhmS1L3nQ1, cde_content_type=EBOK, content_id=B01KIGAWUS, cover_image=1000x1247, creator_version=2.15.0, file_creator=YJConversionTools, is_sample=False, issue_date=2016-11-16, language=en, override_kindle_font=False, pages=510, publisher="SAGE Publications", reading_orders=1, selection=enabled, title="An Introduction to Cognitive Behaviour Therapy: Skills and Applications"
Converting book to EPUB 2.0
Format is EBOK
added box-align center to correct alignment in /part0029.xhtml
Traceback (most recent call last):
File "calibre_plugins.kfx_input.__init__", line 102, in convert
File "calibre_plugins.kfx_input.__init__", line 207, in convert_from_kfx
Exception: Unknown com.amazon.yjconversion feature: yj_mathml-1
Python function terminated unexpectedly
{"det_msg": "", "title": "KFX conversion failed", "level": "error", "msg": "<b>Cannot convert An Introduction to Cognitive Behaviour Therapy: Skills and Applications</b><br><br>Unknown com.amazon.yjconversion feature: yj_mathml-1"} (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 101, in main
File "site.py", line 78, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 199, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 42, in gui_convert_override
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 27, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 1106, in run
File "site-packages\calibre\customize\conversion.py", line 244, in __call__
File "calibre_plugins.kfx_input.__init__", line 110, in convert
calibre.ebooks.conversion.ConversionUserFeedBack: {"det_msg": "", "title": "KFX conversion failed", "level": "error", "msg": "<b>Cannot convert An Introduction to Cognitive Behaviour Therapy: Skills and Applications</b><br><br>Unknown com.amazon.yjconversion feature: yj_mathml-1"}

[ZRJZTh1u]

I keep getting the following error for one of my books.
(Other ones converts to ePub w/o any problems.)

calibre, version 3.35.0
ERROR: KFX conversion failed: <p><b>Cannot convert Candy Canes, Corpses and the Gothic Haunt</b><br><br>unexpected style events in $270
unexpected style events in $270</p>

Log:

Spoiler:

Convert book 1 of 1 (Candy Canes, Corpses and the Gothic Haunt)
Conversion options changed from defaults:
output_profile: 'kindle_pw3'
cover: u'/var/folders/zt/gp1yyyyn05x53js_qkxn60900000gn/C/calibre_3.35.0_tmp_lC2zTy/p9NSyw.jpeg'
verbose: 2
page_breaks_before: u"//*[name()='h1' or name()='h2']"
read_metadata_from_opf: u'/var/folders/zt/gp1yyyyn05x53js_qkxn60900000gn/C/calibre_3.35.0_tmp_lC2zTy/_n81Ma.opf'
Resolved conversion options
calibre version: 3.35.0
{'allow_conversion_with_errors': False,
'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0.0,
'book_producer': None,
'change_justification': u'original',
'chapter': u"//*[((name()='h1' or name()='h2') and re:test(., '\\s*((chapter|book|section|part)\\s+)|((prolog|pr ologue|epilogue)(\\s+|$))', 'i')) or @class = 'chapter']",
'chapter_mark': u'pagebreak',
'comments': None,
'cover': u'/var/folders/zt/gp1yyyyn05x53js_qkxn60900000gn/C/calibre_3.35.0_tmp_lC2zTy/p9NSyw.jpeg',
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_split_on_page_breaks': False,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_toc_at_end': False,
'epub_version': u'2',
'expand_css': False,
'extra_css': None,
'extract_to': None,
'filter_css': u'',
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x10b4021d0>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0.0,
'linearize_tables': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.KindlePaperWhite3Outpu t object at 0x10b4029d0>,
'page_breaks_before': u"//*[name()='h1' or name()='h2']",
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': u'/var/folders/zt/gp1yyyyn05x53js_qkxn60900000gn/C/calibre_3.35.0_tmp_lC2zTy/_n81Ma.opf',
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': u'',
'search_replace': '[]',
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': None,
'sr1_search': None,
'sr2_replace': None,
'sr2_search': None,
'sr3_replace': None,
'sr3_search': None,
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': '[]',
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
Traceback (most recent call last):
File "calibre_plugins.kfx_input.__init__", line 102, in convert
File "calibre_plugins.kfx_input.__init__", line 207, in convert_from_kfx
Exception: unexpected style events in $270
unexpected style events in $270
Python function terminated unexpectedly: {"det_msg": "", "title": "KFX conversion failed", "msg": "<b>Cannot convert Candy Canes, Corpses and the Gothic Haunt</b><br><br>unexpected style events in $270\nunexpected style events in $270", "level": "error"}
InputFormatPlugin: KFX Input running
on /var/folders/zt/gp1yyyyn05x53js_qkxn60900000gn/C/calibre_3.35.0_tmp_lC2zTy/USGm79.kfx
Software versions: KFX Input 1.11.0, calibre 3.35, Darwin-18.2.0-x86_64-i386-64bit
KFX Input plugin help is available at https://www.mobileread.com/forums/sh...d.php?t=291290
Converting /var/folders/zt/gp1yyyyn05x53js_qkxn60900000gn/C/calibre_3.35.0_tmp_lC2zTy/USGm79.kfx
Processing container: /var/folders/zt/gp1yyyyn05x53js_qkxn60900000gn/C/calibre_3.35.0_tmp_lC2zTy/USGm79.kfx
kfxgen version: 7.191.1.0/
Features: CanonicalFormat-2, kfxgen.pidMapWithOffset-1, kfxgen.textBlock-1, max_id-761, reflow-style-2
Metadata: ASIN=B0788W2GPF, asset_id=CR!YA5T1W4E0X00NBK6H39Q79Y2F71Q, author="Stapleton, Rachael", book_id=oTn_YZbkSnCclwfYFCdkJw1, cde_content_type=EBOK, content_id=B0788W2GPF, cover_image=1297x1920, creator_version=2.15.0, file_creator=YJConversionTools, is_sample=False, issue_date=2017-12-29, language=en, pages=320, publisher=, reading_orders=1, selection=enabled, title="Candy Canes, Corpses and the Gothic Haunt: Haunted House Flippers Inc. (Bohemian Lake Book 4)"
Converting book to EPUB 2.0
Format is EBOK
ERROR: unexpected style events in $270
ERROR: unexpected style events in $270
Traceback (most recent call last):
File "/Applications/calibre.app/Contents/Resources/Python/lib/python2.7/site.py", line 154, in main
return run_entry_point()
File "/Applications/calibre.app/Contents/Resources/Python/lib/python2.7/site.py", line 114, in run_entry_point
return getattr(pmod, func)()
File "site-packages/calibre/utils/ipc/worker.py", line 199, in main
File "site-packages/calibre/gui2/convert/gui_conversion.py", line 42, in gui_convert_override
File "site-packages/calibre/gui2/convert/gui_conversion.py", line 27, in gui_convert
File "site-packages/calibre/ebooks/conversion/plumber.py", line 1106, in run
File "site-packages/calibre/customize/conversion.py", line 244, in __call__
File "calibre_plugins.kfx_input.__init__", line 110, in convert
calibre.ebooks.conversion.ConversionUserFeedBack: {"det_msg": "", "title": "KFX conversion failed", "msg": "<b>Cannot convert Candy Canes, Corpses and the Gothic Haunt</b><br><br>unexpected style events in $270\nunexpected style events in $270", "level": "error"}

[jhowell]

Originally Posted by itsleviosa

The ebook imported to Calibre just fine, when it didn't convert to PDF I returned the Kindle ebook thinking I got a "dud". I've since rolled back Kindle reader (1.25 to 1.17 as per suggested) but no point syncing library to check if that fixed the issue since I don't have the darn book anymore :/

Am I a complete bonehead for jumping the gun and returning the ebook too soon?

calibre.ebooks.conversion.ConversionUserFeedBack: {"det_msg": "", "title": "KFX conversion failed", "level": "error", "msg": "<b>Cannot convert An Introduction to Cognitive Behaviour Therapy: Skills and Applications</b><br><br>Unknown com.amazon.yjconversion feature: yj_mathml-1"}

Originally Posted by ZRJZTh1u

I keep getting the following error for one of my books.
(Other ones converts to ePub w/o any problems.)

calibre, version 3.35.0
ERROR: KFX conversion failed: <p><b>Cannot convert Candy Canes, Corpses and the Gothic Haunt</b><br><br>unexpected style events in $270
unexpected style events in $270</p>

Thank you both for the error reports. Amazon continues to make changes and add new features to KFX format. Both of these are new to me.

It will take me awhile to figure out what has changed and update the KFX Input plugin so that it can handle them.

In the mean time, this thread has information on how you can avoid KFX and get your books in a different format that calibre should be able to convert.

[itsleviosa]

Thank you for responding, AND for such a wonderful plugin! Have followed the guidelines in your response

[StarsInTheSky]

Hello, Thank you for a great Plugin. Calibre imports my book as azw3, so I hope I'm posting in the right place and it is using this plugin to do so. The problem I am having is that the book is a picture book for children in landscape mode, and the import makes a mess of the page layout. The book is free at amazon, it's called una princesa diferente. Could you please advice where the problem is, and if this can be fixed ? Thank you

Calibre 3.35, Kfx Input 1.11, Kindle 1.21

[jhowell]

Originally Posted by StarsInTheSky

Hello, Thank you for a great Plugin. Calibre imports my book as azw3, so I hope I'm posting in the right place and it is using this plugin to do so. The problem I am having is that the book is a picture book for children in landscape mode, and the import makes a mess of the page layout...

If your book shows as AZW3 instead of KFX then it is not in KFX format and is not using this plugin. Fixed-layout children's books are not available in KFX and are delivered in AZW3 (aka KF8), a different Kindle e-book format.

Calibre does not support fixed-layout formats very well.

[jhowell]

Version 1.12.0 - 20 Dec 2018

Change the default value of the "kfx_input_set_format_virtual" plugin tweak to False so that by default calibre will not import books in KFX format from e-ink Kindle devices. (Books in KFX format can no longer be imported from the latest Kindle firmware, version 5.10.2.)

Fix incorrect font size used for drop caps in some case.

Allow combinations of text-decoration line values.

Support additional KFX features. (Fixes "ERROR: Unexpected Ion symbols used: $135, $353", "ERROR: unexpected style events in $270", and "ERROR: Unknown com.amazon.yjconversion feature: yj_mathml-1".)

[itsleviosa]

Plugin update fixed my conversion issue! Thank you so much for your quick response!

Originally Posted by jhowell

Version 1.12.0 - 20 Dec 2018

Change the default value of the "kfx_input_set_format_virtual" plugin tweak to False so that by default calibre will not import books in KFX format from e-ink Kindle devices. (Books in KFX format can no longer be imported from the latest Kindle firmware, version 5.10.2.)

Fix incorrect font size used for drop caps in some case.

Allow combinations of text-decoration line values.

Support additional KFX features. (Fixes "ERROR: Unexpected Ion symbols used: $135, $353", "ERROR: unexpected style events in $270", and "ERROR: Unknown com.amazon.yjconversion feature: yj_mathml-1".)

[ZRJZTh1u]

Wow. You're awesome. Such a quick fix. Thank you so much.

[Musitcat]

I updated earlier today Calibre and along with kfx plugins and get "ERROR: KFX conversion failed: Unexpected Ion symbols used: $282" when I try to convert to epub format. It would be super helpful to know if and when there is a fix. Thanks so much.

[jhowell]

Originally Posted by Musitcat

I updated earlier today Calibre and along with kfx plugins and get "ERROR: KFX conversion failed: Unexpected Ion symbols used: $282" when I try to convert to epub format. It would be super helpful to know if and when there is a fix. Thanks so much.

That is a new error.

What book were you trying to convert?

The full conversion log would be helpful in diagnosing the problem.

[bp303]

Originally Posted by jhowell

That is a new error.

What book were you trying to convert?

The full conversion log would be helpful in diagnosing the problem.

Not OP, but I got the same error today.

log attached.

Thanks!