Conversion failures after 0.7.29

[Stash123]

I am a new user, started in Nov 2010.
After a little learning curve (very low-level only), I converted several books - tech papers and hand-written - from .rtf and .pdf format to ePub format and transferred to my iPad, easily and quickly. Loved it - sent an immediate donation, to a worthwhile cause.

Now, after I upgraded to 0.7.37, I got nothing but "conversion failure" working with .rtf files. I finally tried the same original .rtf-format files I had previously converted, and they also failed. Finally, I dumped 0.7.37 and reloaded 0.7.29. Hah! everything now works just fine, including the new book I wanted to convert!

What am I missing? Is there a "preference" or more whose default has changed since 0.7.29?

[itimpi]

I cannot think off-hand of anything that would make rtf conversion fail in the later calibre releases. They continue to work fine for me. What error messages are showing up in the conversion log?

[jackie_w]

I don't often do RTF to EPUB conversions but I just tried one. I can confirm an error if the Convert - StructureDetection - Preprocess input box is checked. When I uncheck it the conversion runs OK.

These are the error messages from the Job Details box

Spoiler:

ERROR: Conversion Error: <b>Failed</b>: Convert book 1 of 1 (Porterhouse Blue)

Convert book 1 of 1 (Porterhouse Blue)
Resolved conversion options
calibre version: 0.7.38
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 11.0,
 'book_producer': None,
 'change_justification': u'justify',
 'chapter': u"//*[name()='h2' or name()='h3']",
 'chapter_mark': u'pagebreak',
 'comments': None,
 'cover': 'c:\\docume~1\\jackies\\locals~1\\temp\\calibre_0.7.38_tmp_qdhqih\\calibre_0.7.38_i4ld9j.jpeg',
 'debug_pipeline': None,
 'disable_font_rescaling': False,
 'dont_split_on_page_breaks': False,
 'epub_flatten': False,
 'extra_css': u'p, div, li {margin-top:0.25em; margin-bottom:0;}',
 'extract_to': None,
 'flow_size': 260,
 'font_size_mapping': u'8, 9, 10, 11, 14, 16, 20, 33',
 'footer_regex': u'(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)',
 'header_regex': u'(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)',
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x048AF210>,
 'insert_blank_line': False,
 'insert_metadata': True,
 'isbn': None,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': u'//h:h2',
 'level2_toc': u'//h:h3',
 'level3_toc': None,
 'line_height': 0.0,
 'linearize_tables': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 10.0,
 'max_toc_links': 0,
 'minimum_line_height': 0.0,
 'no_chapters_in_toc': False,
 'no_default_epub_cover': False,
 'no_inline_navbars': False,
 'no_svg_cover': False,
 'output_profile': <calibre.customize.profiles.SonyReaderOutput object at 0x048AF610>,
 'page_breaks_before': u'/',
 'prefer_metadata_cover': False,
 'preprocess_html': True,
 'preserve_cover_aspect_ratio': False,
 'pretty_print': True,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': 'c:\\docume~1\\jackies\\locals~1\\temp\\calibre_0.7.38_tmp_qdhqih\\calibre_0.7.38_lkgnz7.opf',
 'remove_first_image': False,
 'remove_footer': False,
 'remove_header': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'series': None,
 'series_index': None,
 'smarten_punctuation': True,
 'tags': None,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'use_auto_toc': False,
 'verbose': 2}
InputFormatPlugin: RTF Input running
on C:\Calibre\Novels\Tom Sharpe\Porterhouse Blue (2749)\Porterhouse Blue - Tom Sharpe.rtf
Converting RTF to XML...
	Preprocessing to convert unicode characters
Parsing XML...
Converting XML to HTML...
*********  Preprocessing HTML  *********
Python function terminated unexpectedly
  'utf8' codec can't decode byte 0xc2 in position 0: unexpected end of data (Error Code: 1)
Traceback (most recent call last):
  File "site.py", line 103, in main
  File "site.py", line 85, in run_entry_point
  File "site-packages\calibre\utils\ipc\worker.py", line 107, in main
  File "site-packages\calibre\gui2\convert\gui_conversion.py", line 24, in gui_convert
  File "site-packages\calibre\ebooks\conversion\plumber.py", line 853, in run
  File "site-packages\calibre\customize\conversion.py", line 216, in __call__
  File "site-packages\calibre\ebooks\rtf\input.py", line 299, in convert
  File "site-packages\calibre\ebooks\conversion\utils.py", line 195, in __call__
  File "site-packages\calibre\ebooks\conversion\utils.py", line 112, in get_word_count
  File "site-packages\calibre\utils\wordcount.py", line 85, in get_wordcount_obj
  File "site-packages\calibre\utils\wordcount.py", line 67, in get_wordcount
  File "site-packages\calibre\utils\wordcount.py", line 56, in nonj_len
UnicodeDecodeError: 'utf8' codec can't decode byte 0xc2 in position 0: unexpected end of data

[kovidgoyal]

fixed in next release.

[jackie_w]

Thank you.

[Stash123]

Originally Posted by itimpi

I cannot think off-hand of anything that would make rtf conversion fail in the later calibre releases. They continue to work fine for me. What error messages are showing up in the conversion log?

Here are error mesages
Error window message:
"Failed: Convert book 1 of 1 (Drowntown-as converted)"

Last few lines of "Show Details" window:

" …
File "site-packages/calibre/customize/conversion.py", line 216, in _call_
File "site-packages/calibre/ebooks/rtf/input.py", line 299, in convert
File "site-packages/calibre/ebooks/conversion/utils.py", line 272, in _call_
File "site-packages/calibre/ebooks/conversion/preprocess.py", line 231, in _call_
UnicodeDecodeError: 'utf8; codec can't decode byte 0cx2 in position 232: invalid continuation byte"

The original book file was "Drowntown-as-converted.rtf", an rtf file output from the Mac's Preview app.

[Stash123]

Originally Posted by kovidgoyal

fixed in next release.

Also - Thank you.

I wish I understood Calibre in more detail - to know what it's trying to do and what its built-in logic looks for while doing it. Maybe too many possibilities and parameters for a quick learn...

[Stash123]

Originally Posted by jackie_w

I don't often do RTF to EPUB conversions but I just tried one. I can confirm an error if the Convert - StructureDetection - Preprocess input box is checked. When I uncheck it the conversion runs OK.

These are the error messages from the Job Details box

Spoiler:

ERROR: Conversion Error: <b>Failed</b>: Convert book 1 of 1 (Porterhouse Blue)

Convert book 1 of 1 (Porterhouse Blue)
Resolved conversion options
calibre version: 0.7.38
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 11.0,
 'book_producer': None,
 'change_justification': u'justify',
 'chapter': u"//*[name()='h2' or name()='h3']",
 'chapter_mark': u'pagebreak',
 'comments': None,
 'cover': 'c:\\docume~1\\jackies\\locals~1\\temp\\calibre_0.7.38_tmp_qdhqih\\calibre_0.7.38_i4ld9j.jpeg',
 'debug_pipeline': None,
 'disable_font_rescaling': False,
 'dont_split_on_page_breaks': False,
 'epub_flatten': False,
 'extra_css': u'p, div, li {margin-top:0.25em; margin-bottom:0;}',
 'extract_to': None,
 'flow_size': 260,
 'font_size_mapping': u'8, 9, 10, 11, 14, 16, 20, 33',
 'footer_regex': u'(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)',
 'header_regex': u'(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)',
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x048AF210>,
 'insert_blank_line': False,
 'insert_metadata': True,
 'isbn': None,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': u'//h:h2',
 'level2_toc': u'//h:h3',
 'level3_toc': None,
 'line_height': 0.0,
 'linearize_tables': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 10.0,
 'max_toc_links': 0,
 'minimum_line_height': 0.0,
 'no_chapters_in_toc': False,
 'no_default_epub_cover': False,
 'no_inline_navbars': False,
 'no_svg_cover': False,
 'output_profile': <calibre.customize.profiles.SonyReaderOutput object at 0x048AF610>,
 'page_breaks_before': u'/',
 'prefer_metadata_cover': False,
 'preprocess_html': True,
 'preserve_cover_aspect_ratio': False,
 'pretty_print': True,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': 'c:\\docume~1\\jackies\\locals~1\\temp\\calibre_0.7.38_tmp_qdhqih\\calibre_0.7.38_lkgnz7.opf',
 'remove_first_image': False,
 'remove_footer': False,
 'remove_header': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'series': None,
 'series_index': None,
 'smarten_punctuation': True,
 'tags': None,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'use_auto_toc': False,
 'verbose': 2}
InputFormatPlugin: RTF Input running
on C:\Calibre\Novels\Tom Sharpe\Porterhouse Blue (2749)\Porterhouse Blue - Tom Sharpe.rtf
Converting RTF to XML...
	Preprocessing to convert unicode characters
Parsing XML...
Converting XML to HTML...
*********  Preprocessing HTML  *********
Python function terminated unexpectedly
  'utf8' codec can't decode byte 0xc2 in position 0: unexpected end of data (Error Code: 1)
Traceback (most recent call last):
  File "site.py", line 103, in main
  File "site.py", line 85, in run_entry_point
  File "site-packages\calibre\utils\ipc\worker.py", line 107, in main
  File "site-packages\calibre\gui2\convert\gui_conversion.py", line 24, in gui_convert
  File "site-packages\calibre\ebooks\conversion\plumber.py", line 853, in run
  File "site-packages\calibre\customize\conversion.py", line 216, in __call__
  File "site-packages\calibre\ebooks\rtf\input.py", line 299, in convert
  File "site-packages\calibre\ebooks\conversion\utils.py", line 195, in __call__
  File "site-packages\calibre\ebooks\conversion\utils.py", line 112, in get_word_count
  File "site-packages\calibre\utils\wordcount.py", line 85, in get_wordcount_obj
  File "site-packages\calibre\utils\wordcount.py", line 67, in get_wordcount
  File "site-packages\calibre\utils\wordcount.py", line 56, in nonj_len
UnicodeDecodeError: 'utf8' codec can't decode byte 0xc2 in position 0: unexpected end of data

I tried your suggestion, un-checked the preprocess box, no effect - same conversion error message, same list of details.

The repeated, with the footer-detection box unchecked also - same error result.

Sorry...