calibredb add failes

[asm0dey]

When I run command

calibredb add -r ../Books/native/ --with-library .

I get an error
Ian Fleming

Traceback (most recent call last):
  File "/usr/bin/calibredb", line 21, in <module>
    sys.exit(main())
  File "/usr/lib/calibre/calibre/db/cli/main.py", line 250, in main
    return run_cmd(cmd, opts, args[1:], DBCtx(opts))
  File "/usr/lib/calibre/calibre/db/cli/main.py", line 40, in run_cmd
    ret = m.main(opts, args, dbctx)
  File "/usr/lib/calibre/calibre/db/cli/cmd_add.py", line 474, in main
    do_add(
  File "/usr/lib/calibre/calibre/db/cli/cmd_add.py", line 268, in do_add
    book_title, ids, mids, dups = dbctx.run(
  File "/usr/lib/calibre/calibre/db/cli/main.py", line 183, in run
    return m.implementation(self.db.new_api, None, *args)
  File "/usr/lib/calibre/calibre/db/cli/cmd_add.py", line 180, in implementation
    return func(db, notify_changes, is_remote, args)
  File "/usr/lib/calibre/calibre/db/cli/cmd_add.py", line 172, in format_group
    added_ids, updated_ids, duplicates = do_adding(
  File "/usr/lib/calibre/calibre/db/cli/cmd_add.py", line 63, in do_adding
    identical_book_list = find_identical_books(mi, identical_books_data)
  File "/usr/lib/calibre/calibre/db/utils.py", line 68, in find_identical_books
    author_ids = author_map.get(icu_lower(a))
  File "/usr/lib/calibre/calibre/utils/icu.py", line 191, in change_case
    return _icu.change_case(x, which, _locale)
TypeError: Not a unicode string

First of all, "Ian Flemming" looks very unicode-y to me. Second of all, I would like to have information about particular file which causes an error. Third of all, I would like to solve this issue

If there is a way to turn on some debug/verbose logging for calibredb add —*that would be cool.

I do this all on my server, so I can't use desktop calibreversion. That's why I'm trying to setup calibre-web + calibredb

Any ideas how can I fix it?

[kovidgoyal]

use the official calibre binaries rather than your distro package and you will be fine

[asm0dey]

Originally Posted by kovidgoyal

use the official calibre binaries rather than your distro package and you will be fine

Thanks, will try! My library is of enormous size like 600k books, so may take some time.

[asm0dey]

Originally Posted by kovidgoyal

use the official calibre binaries rather than your distro package and you will be fine

Nop, sorry to say this, but this time error looks like this:

Traceback (most recent call last):
  File "runpy.py", line 194, in _run_module_as_main
  File "runpy.py", line 87, in _run_code
  File "site.py", line 45, in <module>
  File "site.py", line 41, in main
  File "calibre/db/cli/main.py", line 250, in main
  File "calibre/db/cli/main.py", line 40, in run_cmd
  File "calibre/db/cli/cmd_add.py", line 474, in main
  File "calibre/db/cli/cmd_add.py", line 268, in do_add
  File "calibre/db/cli/main.py", line 183, in run
  File "calibre/db/cli/cmd_add.py", line 180, in implementation
  File "calibre/db/cli/cmd_add.py", line 172, in format_group
  File "calibre/db/cli/cmd_add.py", line 63, in do_adding
  File "calibre/db/utils.py", line 68, in find_identical_books
  File "calibre/utils/icu.py", line 191, in change_case
TypeError: Not a unicode string

[theducks]

Originally Posted by asm0dey

Thanks, will try! My library is of enormous size like 600k books, so may take some time.

No need to re-import.
Just uninstall the distro version, then use the official (command line) site.

It will find your existing Library (because that is in the settings) and proceed from there.

[asm0dey]

Originally Posted by theducks

No need to re-import.
Just uninstall the distro version, then use the official (command line) site.

It will find your existing Library (because that is in the settings) and proceed from there.

Exactly what I did. New error is above (looks almost the same)

[asm0dey]

If there is any way to debug —*I am willing to help. Debug builds, extended logging — anything. Just let me know.

A bit more context: books are in fb2 format.

[kovidgoyal]

Ah this will be a bug in fb2 metadata reader plugin not generating unicode author names. The workaround is here: https://github.com/kovidgoyal/calibr...198e3830f79586

[asm0dey]

Originally Posted by kovidgoyal

Ah this will be a bug in fb2 metadata reader plugin not generating unicode author names. The workaround is here: https://github.com/kovidgoyal/calibr...198e3830f79586

Awesome! It's there any way to get a nightly build with this fix included or the only way is to build it myself?

[kovidgoyal]

You dont need to build: https://manual.calibre-ebook.com/develop.html

[asm0dey]

Originally Posted by kovidgoyal

You dont need to build: https://manual.calibre-ebook.com/develop.html

Instelled dev version, can confirm that the fix works, thank you!