AZW3/Mobi to Epub conversion errors

[gabby98]

OK, so the original problem I had started here, where I thought some conversions were getting "Stuck". After some advice about patience, most of those we fine. Now, I have a few that are throwing errors and thought maybe I should start a new thread about these.

One book is giving this error:

Spoiler:

calibre, version 1.5.0 (win32, isfrozen: True)
Conversion Error: Failed: Convert book 3 of 3 ([book_title]))

Convert book 3 of 3 ([book_title])
Resolved conversion options
calibre version: 1.5.0
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0.0,
'book_producer': None,
'change_justification': u'original',
'chapter': u"//*[((name()='h1' or name()='h2') and re:test(., '\\s*((chapter|book|section|part)\\s+)|((prolog|pr ologue|epilogue)(\\s+|$))', 'i')) or @class = 'chapter']",
'chapter_mark': u'pagebreak',
'comments': None,
'cover': u'C:\\Users\\pc\\AppData\\Local\\Temp\\calibre_gfb jya\\buysur.jpeg',
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_split_on_page_breaks': False,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_toc_at_end': False,
'extra_css': None,
'extract_to': None,
'filter_css': u'',
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x02304110>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0.0,
'linearize_tables': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.GenericEink object at 0x02304310>,
'page_breaks_before': u"//*[name()='h1' or name()='h2']",
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': u'C:\\Users\\pc\\AppData\\Local\\Temp\\calibre_gfb jya\\0bxru4.opf',
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': u'',
'search_replace': '[]',
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': None,
'sr1_search': None,
'sr2_replace': None,
'sr2_search': None,
'sr3_replace': None,
'sr3_search': None,
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: MOBI Input running
on C:\Users\pc\AppData\Local\Temp\calibre_gfbjya\0p7a 0o.mobi
Extracting text...
Adding anchors...
Extracting text...
Adding anchors...
Python function terminated unexpectedly
(Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 189, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 31, in gui_convert_override
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 1027, in run
File "site-packages\calibre\customize\conversion.py", line 241, in __call__
File "site-packages\calibre\ebooks\conversion\plugins\mobi_in put.py", line 35, in convert
File "site-packages\calibre\ebooks\mobi\reader\mobi6.py", line 171, in extract_content
File "re.py", line 151, in sub
MemoryError

5 others are giving this error:

Spoiler:

calibre, version 1.5.0
ERROR: Conversion Failed: <p><b>Failed to convert: <p>
Many older ebook reader devices are incapable of displaying
EPUB files that have internal components over a certain size.
Therefore, when converting to EPUB, calibre automatically tries
to split up the EPUB into smaller sized pieces. For some
files that are large undifferentiated blocks of text, this
splitting fails.
<p>You can <b>work around the problem</b> by either increasing the
maximum split size under EPUB Output in the conversion dialog,
or by turning on Heuristic Processing, also in the conversion
dialog. Note that if you make the maximum split size too large,
your ebook reader may have trouble with the EPUB.


Convert book 5 of 5 (calibre, version 1.5.0 (win32, isfrozen: True)
Conversion Error: Failed: Convert book 3 of 3 ([book_title])

Convert book 3 of 3 ([book_title])
Resolved conversion options
calibre version: 1.5.0
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0.0,
'book_producer': None,
'change_justification': u'original',
'chapter': u"//*[((name()='h1' or name()='h2') and re:test(., '\\s*((chapter|book|section|part)\\s+)|((prolog|pr ologue|epilogue)(\\s+|$))', 'i')) or @class = 'chapter']",
'chapter_mark': u'pagebreak',
'comments': None,
'cover': u'C:\\Users\\pc\\AppData\\Local\\Temp\\calibre_gfb jya\\buysur.jpeg',
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_split_on_page_breaks': False,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_toc_at_end': False,
'extra_css': None,
'extract_to': None,
'filter_css': u'',
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x02304110>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0.0,
'linearize_tables': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.GenericEink object at 0x02304310>,
'page_breaks_before': u"//*[name()='h1' or name()='h2']",
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': u'C:\\Users\\pc\\AppData\\Local\\Temp\\calibre_gfb jya\\0bxru4.opf',
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': u'',
'search_replace': '[]',
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': None,
'sr1_search': None,
'sr2_replace': None,
'sr2_search': None,
'sr3_replace': None,
'sr3_search': None,
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: MOBI Input running
on C:\Users\pc\AppData\Local\Temp\calibre_gfbjya\0p7a 0o.mobi
Extracting text...
Adding anchors...
Extracting text...
Adding anchors...
Python function terminated unexpectedly
(Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 189, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 31, in gui_convert_override
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 1027, in run
File "site-packages\calibre\customize\conversion.py", line 241, in __call__
File "site-packages\calibre\ebooks\conversion\plugins\mobi_in put.py", line 35, in convert
File "site-packages\calibre\ebooks\mobi\reader\mobi6.py", line 171, in extract_content
File "re.py", line 151, in sub
MemoryError
)
Resolved conversion options
calibre version: 1.5.0
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0.0,
'book_producer': None,
'change_justification': u'original',
'chapter': u"//*[((name()='h1' or name()='h2') and re:test(., '\\s*((chapter|book|section|part)\\s+)|((prolog|pr ologue|epilogue)(\\s+|$))', 'i')) or @class = 'chapter']",
'chapter_mark': u'pagebreak',
'comments': None,
'cover': u'C:\\Users\\CHASTI~1\\AppData\\Local\\Temp\\calib re_ckuce5\\4avpmv.jpeg',
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_split_on_page_breaks': False,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_toc_at_end': False,
'extra_css': None,
'extract_to': None,
'filter_css': u'',
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x03DEB1D0>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0.0,
'linearize_tables': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.GenericEink object at 0x03DEB3D0>,
'page_breaks_before': u"//*[name()='h1' or name()='h2']",
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': u'C:\\Users\\CHASTI~1\\AppData\\Local\\Temp\\calib re_ckuce5\\qsrkh5.opf',
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': u'',
'search_replace': '[]',
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': None,
'sr1_search': None,
'sr2_replace': None,
'sr2_search': None,
'sr3_replace': None,
'sr3_search': None,
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: MOBI Input running
on C:\Users\CHASTI~1\AppData\Local\Temp\calibre_ckuce 5\6t4lwc.mobi
Extracting text...
Adding anchors...
Extracting images...
Cleaning up HTML...
Parsing HTML...
Converting style information to CSS...
Creating OPF...
Parsing all content...
Parsing The_Short_Second_Life_of_Bree_T.html ...
Forcing The_Short_Second_Life_of_Bree_T.html into XHTML namespace
Parsing styles.css ...
Reading TOC from NCX...
Merging user specified metadata...
Detecting structure...
Flattening CSS and remapping font sizes...
Source base font size is 12.00000pt
Removing fake margins...
Found 6 items of level: div_1
Found 12 items of level: div_2
Found 6 items of level: p_2
Ignoring level p_2
div_1 left margin stats: Counter({u'': 1})
div_1 right margin stats: Counter({u'': 1})
div_2 left margin stats: Counter()
div_2 right margin stats: Counter()
Cleaning up manifest...
Trimming unused files from manifest...
Trimming u'images/00002.jpg' from manifest
Trimming u'images/00001.jpg' from manifest
Creating EPUB Output...
Splitting markup on page breaks and flow limits, if any...
Splitting on page-break at id=calibre_pb_0
Splitting on page-break at id=calibre_pb_1
Splitting on page-break at id=calibre_pb_2
Splitting on page-break at id=calibre_pb_3
Splitting on page-break at id=calibre_pb_4
Splitting on page-break at id=calibre_pb_5
Looking for large trees in The_Short_Second_Life_of_Bree_T.html...
Found large tree #3
Splitting...
Split point: {http://www.w3.org/1999/xhtml}div /*/*[2]/*[2]
Split tree too small
Splitting...
Split point: {http://www.w3.org/1999/xhtml}div /*/*[2]/*[1]
Split tree too small
Splitting...
Split point: {http://www.w3.org/1999/xhtml}div /*/*[2]/*[2]/*[1263]
Split tree too small
Splitting...
Split point: {http://www.w3.org/1999/xhtml}div /*/*[2]/*[2]/*[1262]
Split tree too small
Splitting...
Python function terminated unexpectedly
Could not find reasonable point at which to split: [book_title].html Sub-tree size: 264 KB (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 189, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 31, in gui_convert_override
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 1181, in run
File "site-packages\calibre\ebooks\conversion\plugins\epub_ou tput.py", line 199, in convert
File "site-packages\calibre\ebooks\oeb\transforms\split.py", line 59, in __call__
File "site-packages\calibre\ebooks\oeb\transforms\split.py", line 69, in split_item
File "site-packages\calibre\ebooks\oeb\transforms\split.py", line 213, in __init__
File "site-packages\calibre\ebooks\oeb\transforms\split.py", line 453, in split_to_size
File "site-packages\calibre\ebooks\oeb\transforms\split.py", line 453, in split_to_size
File "site-packages\calibre\ebooks\oeb\transforms\split.py", line 453, in split_to_size
File "site-packages\calibre\ebooks\oeb\transforms\split.py", line 453, in split_to_size
File "site-packages\calibre\ebooks\oeb\transforms\split.py", line 446, in split_to_size
calibre.ebooks.oeb.transforms.split.SplitError: Could not find reasonable point at which to split: [book_title].html Sub-tree size: 264 KB

Note on the 2nd error...I did try altering the Heuristic Processing and maximum split size settings to see if that would help - it did not.

Any help would be greatly appreciated!

Thank you

[theducks]

The first ran out of memory. (was this the only conversion running?)

The book was too complex or you tried with heuristics ON. turn it off, then convert. Then (optional) turn it on and do a EPUB => EPUB convert to further refine.


The second
TEMPORARY increase the split size from 260K to about 400K (found in the EPUB Output section)
Upon completion, Change it back and do another EPUB => EPUB convert

[gabby98]

The first I think may have been running with one other conversion. Is there a way to tell calibre how many to process at once?

The second error I think i tried increasing to 500 but that may have been too much. Will try 400 and see if its any better. I do know that I tried changing the HP settings from off to on and back again. hopefully the size thing will work.

ETA: For second error, dang'it if it didn't work this time. 3 worked after changing to 400, 1 at 500 and 1 at 600. Thanks for that. I tried several times the other day, just didn't wanna cooperate i guess (or was that before i updated to the newest version? I'll never remember )

ETA2: The epub to epub, changing the size back to 260 is still erroring out. How much of a problem will this really be on my reader or phone?

[theducks]

Originally Posted by gabby98

The first I think may have been running with one other conversion. Is there a way to tell calibre how many to process at once?

The second error I think i tried increasing to 500 but that may have been too much. Will try 400 and see if its any better. I do know that I tried changing the HP settings from off to on and back again. hopefully the size thing will work.

ETA: For second error, dang'it if it didn't work this time. 3 worked after changing to 400, 1 at 500 and 1 at 600. Thanks for that. I tried several times the other day, just didn't wanna cooperate i guess (or was that before i updated to the newest version? I'll never remember )

ETA2: The epub to epub, changing the size back to 260 is still erroring out. How much of a problem will this really be on my reader or phone?

Many devices (still) can't handle big chunks.

This problem can happen If the book is poorly constructed: 1 huge paragraph with <br /> between the proper place.



Try Sigil and just pick a split point.
Or possibly
A few minutes with Sigil and REGEX fixes by replacing the <br />\s+([A-Z"“] with a </p> <p class=...>\1 <<idea only. Needs tune for actual content.

[gabby98]

thanks

[BetterRed]

Originally Posted by gabby98

The first I think may have been running with one other conversion. Is there a way to tell calibre how many to process at once?

Attachment shows my set up on jobs - my experience with those settings is that whilst an individual job may take longer, overall I can get more done because when calibre is doing conversions I can do other things without feeling any significant impact. I normally run calibre on a quad core i5 system with 6GB of RAM.

If you are running on Windows, and you are using the 32 bit or portable editions then you may get over some conversion problems or better performance by using 64bit edition (if your rig is 64bit capable). Kovid posted something recently in which he seemed to indicate that the main (only ?) benefit he knows of with the 64 bit edition is in large/complex conversions

If you do that then I suggest you first remove any associations you may created in Windows for the 32 bit calibre viewer (C:\Program Files (X86)\Calibre2\ebook-viewer.exe). Then after installing the 64 bit edition recreate the associations for the 64 bit calibre viewer (C:\Program Files\Calibre2\ebook-viewer.exe). If/when you decide to un-install the 32 bit version I would recommend you use the Windows Remove programs facility in the Control Panel - I'm suspicious of gadgets like Revo - they have been known to be too aggressive.

BR

[gabby98]

@BR

I knew it was there somewhere (limiting the simultaneous conversions)! I do use the portable version cause I have it set just the way I like it and I can do my work anywhere. But I suppose it wouldn't hurt to install the 64 bit version for extras.

More to play with tonight

[gabby98]

Man I'm needy this week

Is there a way to copy settings/plugins from portable to actual pc install?

ty....again

Oh and it seems the book with the first error is just BAD...can't even find it in the original location anymore. Oh well, wasn't one of my must reads

[BetterRed]

@gabby98 - this is what I'd do (I've never need to do it though)

1. after installing the 64bit version I would copy the Configuration folder to a safe place - last button on Preferences->Miscellaneous will take you into the folder.
   
2. delete everything in there, and then copy the contents of ...Calibre Portable\Calibre Settings into there.
   
3. point the 64 bit version at your library via Library->Switch Create Library,
   
4. should be easy to test - are your plugins there, are settings there etc, if not restore the safe copy and wait for better advice

BR

[gabby98]

Thank you....wasn't sure where it was on the actual install cause I've never used it before.

no worries, I'm a computer person so "backup backup backup" is part of my everyday life :P

ETA: Lovely...worked perfectly!