Catalog generation fails when title contains specific accented characters

[riki]

I have generated a catalog of ebooks quite a few times without problems, but after I added a book with an accented character in its title, the process always fails. I made a few tests, and it appears that not all accented characters cause problems - I've found the character "à" to be the culprit.

Here's what Calibre has to report about it.

calibre, version 0.8.14
ERROR: Conversion Error: <b>Failed</b>: Generate catalog

Generate catalog
 Sections: Authors, Titles, Series, Recently Added, Descriptions
Catalog_EPUB_MOBI(): Generating mobi for kindle in GUI environment
 connected_device: 'None'
 book count: 2
 opts:
  authorClip: 60
  catalog_title: u'My Booklist'
  connected_kindle: False
  descriptionClip: 100
  exclude_book_marker: u':'
  exclude_genre: u'(\\[.+\\])|(book_is_read)'
  exclude_tags: u'~,Catalog,book_check_before_adding'
  header_note_source_field: u'#imported_kindle_collections'
  merge_comments: ':before:True'
  output_profile: 'kindle'
  read_book_marker: u'tag:'
  search_text: None
  sort_by: None
  sort_descriptions_by_author: True
  sync: True
  thumb_width: '1.00'
  wishlist_tag: u'Wishlist'
 existing thumb cache at C:\Documents and Settings\User101\Application Data\calibre\caches\catalog\thumbs.zip, cached_thumb_width: 1.00"
 Begin catalog source generation
     DPI = 168; thumbnail dimensions: 84 x 112
Python function terminated unexpectedly
  'utf8' codec can't decode byte 0xc3 in position 16: unexpected end of data (Error Code: 1)
Traceback (most recent call last):
  File "site.py", line 132, in main
  File "site.py", line 109, in run_entry_point
  File "site-packages\calibre\utils\ipc\worker.py", line 181, in main
  File "site-packages\calibre\gui2\convert\gui_conversion.py", line 68, in gui_catalog
  File "site-packages\calibre\library\catalog.py", line 5110, in run
  File "site-packages\calibre\library\catalog.py", line 1420, in buildSources
  File "site-packages\calibre\library\catalog.py", line 1952, in generateHTMLByTitle
UnicodeDecodeError: 'utf8' codec can't decode byte 0xc3 in position 16: unexpected end of data

[kovidgoyal]

Fixed in next release. Though there may well be other bugs that show up on non utf-8 windows systems.

[riki]

A huge thank you, Kovid!
I must have been lucky - your replies were as quick as they get...

[Manichean]

Moderator Notice
Moved to correct subforum.

Originally Posted by riki

I must have been lucky - your replies were as quick as they get...

Actually, that's pretty normal for him

[subul15]

I am using the 8.14 version of calibre. Suddenly it is showing error in generating catalogs. It was working fine up until a few days but now suddenly it has stopped. Don't know what has gone wrong..can someone help me.

[Manichean]

Needs more detail. What's the error? What catalog format are you trying to create?

[subul15]

Originally Posted by Manichean

Needs more detail. What's the error? What catalog format are you trying to create?

I am getting the error when I try to create in epub or mobi format.

One correction .... I am using 0.8.15 version

This is the msg I am getting with the error..

"Generate catalog
Sections: Authors, Descriptions
Catalog_EPUB_MOBI(): Generating epub for sony in GUI environment
connected_device: 'None'
book count: 24
opts:
authorClip: 100
catalog_title: u'Elizabeth Thornton'
connected_kindle: False
descriptionClip: 380
exclude_book_marker: u':Book'
exclude_genre: u'\\[.+\\]'
exclude_tags: u'~,'
header_note_source_field: ''
merge_comments: '::True'
output_profile: 'sony'
read_book_marker: u'tag:+'
search_text: None
sort_by: None
sort_descriptions_by_author: True
sync: False
thumb_width: '1.00'
wishlist_tag: u'Wishlist'
Python function terminated unexpectedly
'utf8' codec can't decode byte 0xbc in position 45: invalid start byte (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 181, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 68, in gui_catalog
File "site-packages\calibre\library\catalog.py", line 5099, in run
File "site-packages\calibre\library\catalog.py", line 1052, in __init__
File "site-packages\calibre\utils\zipfile.py", line 751, in __init__
File "site-packages\calibre\utils\zipfile.py", line 786, in _GetContents
File "site-packages\calibre\utils\zipfile.py", line 847, in _RealGetContents
File "site-packages\calibre\utils\zipfile.py", line 388, in _decodeFilename
File "encodings\utf_8.py", line 16, in decode
UnicodeDecodeError: 'utf8' codec can't decode byte 0xbc in position 45: invalid start byte"

[kovidgoyal]

That error indicates a corrupted catalog thumbnail cache. Open the calibre config dir and delete the file caches\catalog\thumbs.zip from it.

[subul15]

Originally Posted by kovidgoyal

That error indicates a corrupted catalog thumbnail cache. Open the calibre config dir and delete the file caches\catalog\thumbs.zip from it.

Thank you so much..

Phew!! It's working now...