calibre-debug --export-all-calibre-data hangs at metadata.db

shayaknyc · 01-26-2026, 07:10 PM

Hey folks and Kovid,

Firstly, I want to just say, this is an immaculate piece of software, and I have been using this for literal years. It's by far one of my most prized digital assets. Every few months, I backup and archive my entire calibre library, using the following command:

Code:

calibre-debug --export-all-calibre-data [/path/to/empty/dir] all

This has been working flawlessly for years.

The last time I ran this command and it worked well was on 4 Oct 2025. I decided to run the export/backup again today, and everything appeared to be working alright, however, after the standard plugin errors, which are inconsequential, it hit the metadata.db file which is usually backs-up first, and begins the file countdown, but now it just hangs at the metadata.db. It's now been running for about 2 hours, usually by now it completes, but it's still stuck at the metadata.db file. Here's the output of my error when I run the command:

Code:

$ calibre-debug --export-all-calibre-data /home/shayaknyc/ayp/Calibre-Backup-20260126/ all
Exporting libraries: /home/shayaknyc/win-d/Users/shaya/Documents/Calibre Library to: /home/shayaknyc/ayp/Calibre-Backup-20260126/
Failed to initialize plugin: '/home/shaya/.config/calibre/plugins/ANOBII.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 202, in exec_module
  File "calibre/customize/zipplugin.py", line 198, in get_code
  File "calibre_plugins.ANOBII.__init__", line 39
        cached_cover_url_is_reliable = True
    ^
TabError: inconsistent use of tabs and spaces in indentation
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/Barnes & Noble.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 209, in exec_module
  File "calibre_plugins.barnes_noble.__init__", line 11, in <module>
    from urllib import quote
ImportError: cannot import name 'quote' from 'urllib' (/opt/calibre/lib/calibre-extensions/python-lib.bypy.frozen/urllib/__init__.pyc)
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/DOC Input.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 329, in load
calibre.customize.InvalidPlugin: The plugin at /home/shayaknyc/.config/calibre/plugins/DOC Input.zip cannot be used on linux
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/KoboBooks.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 209, in exec_module
  File "calibre_plugins.kobobooks.__init__", line 10, in <module>
    import time, re, HTMLParser
ModuleNotFoundError: No module named 'HTMLParser'
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/Read MP3 AudioBook metadata.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 209, in exec_module
  File "calibre_plugins.audiobookmetadatareader.__init__", line 8, in <module>
    from common import DEBUG
ModuleNotFoundError: No module named 'common'
/home/shayaknyc/win-d/Users/shaya/Documents/Calibre Library 0 2
metadata.db 0 2824

Nothing has changed in my environment (including the space in the source library path). I'm running Arch Linux, and running calibre v8.16.2.

Other than this, the software works great and I have no problems with this at all. This is the first time I've come across an issue like this, and I would greatly appreciate any insight or advice to resolve this so I may continue backing up my precious library. Thank you in advance!

kovidgoyal · 01-26-2026, 10:42 PM

Press ctrl+C that should interrupt it and get you a stack trace.

shayaknyc · 01-26-2026, 11:00 PM

Here's the full output with the stacktrace:

Code:

$ calibre-debug --export-all-calibre-data /home/shayaknyc/ayp/Calibre-Backup-20260126/ all
Exporting libraries: /home/shayaknyc/win-d/Users/shaya/Documents/Calibre Library to: /home/shayaknyc/ayp/Calibre-Backup-20260126/
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/ANOBII.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 202, in exec_module
  File "calibre/customize/zipplugin.py", line 198, in get_code
  File "calibre_plugins.ANOBII.__init__", line 39
        cached_cover_url_is_reliable = True
    ^
TabError: inconsistent use of tabs and spaces in indentation
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/Barnes & Noble.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 209, in exec_module
  File "calibre_plugins.barnes_noble.__init__", line 11, in <module>
    from urllib import quote
ImportError: cannot import name 'quote' from 'urllib' (/opt/calibre/lib/calibre-extensions/python-lib.bypy.frozen/urllib/__init__.pyc)
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/DOC Input.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 329, in load
calibre.customize.InvalidPlugin: The plugin at /home/shayaknyc/.config/calibre/plugins/DOC Input.zip cannot be used on linux
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/KoboBooks.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 209, in exec_module
  File "calibre_plugins.kobobooks.__init__", line 10, in <module>
    import time, re, HTMLParser
ModuleNotFoundError: No module named 'HTMLParser'
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/Read MP3 AudioBook metadata.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 209, in exec_module
  File "calibre_plugins.audiobookmetadatareader.__init__", line 8, in <module>
    from common import DEBUG
ModuleNotFoundError: No module named 'common'
/home/shayaknyc/win-d/Users/shaya/Documents/Calibre Library 0 2
metadata.db 0 2824
^CTraceback (most recent call last):
  File "calibre/db/backend.py", line 2721, in _backup_database
apsw.BusyError: not an error

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "runpy.py", line 198, in _run_module_as_main
  File "runpy.py", line 88, in _run_code
  File "site.py", line 47, in <module>
  File "site.py", line 43, in main
  File "calibre/debug.py", line 308, in main
  File "calibre/utils/exim.py", line 554, in run_exporter
  File "calibre/utils/exim.py", line 213, in export
  File "calibre/db/cache.py", line 86, in call_func_with_lock
  File "calibre/db/cache.py", line 3169, in export_library
  File "calibre/db/backend.py", line 2726, in backup_database
  File "calibre/db/backend.py", line 2720, in _backup_database
  File "contextlib.py", line 446, in __exit__
KeyboardInterrupt

kovidgoyal · 01-26-2026, 11:04 PM

That looks like something else has opened the calibre database and hence you are getting busy errors from sqlite.

shayaknyc · 01-26-2026, 11:13 PM

Quote:

Originally Posted by kovidgoyal

That looks like something else has opened the calibre database and hence you are getting busy errors from sqlite.

Code:

$ pwd
/home/shayaknyc/win-d/Users/shaya/Documents/Calibre Library
$ sudo lsof metadata.db
[sudo] password for shayaknyc:

$

I don't have calibre running, and I don't have anything else accessing the file. Same thing happens - it just hangs at metadata.db. Also, I've had calibre running in the background before when running these commands without issue, so not sure why it would throw an error now, even if I was running calibre or had something accessing this file.

kovidgoyal · 01-26-2026, 11:18 PM

See if that helps: https://github.com/kovidgoyal/calibr...0f70adda71720a

shayaknyc · 01-26-2026, 11:25 PM

Quote:

Originally Posted by kovidgoyal

See if that helps: https://github.com/kovidgoyal/calibr...0f70adda71720a

You'll forgive me, but I'm not finding the cache.py file anywhere in the /opt/calibre sub-path. Where am I supposed to apply this patch? I installed Calibre via the command-line linux installer....

Edit: is the assumption for me to reinstall calibre?

kovidgoyal · 01-26-2026, 11:30 PM

Wait for the next release or run calibre from source as described in: https://manual.calibre-ebook.com/develop.html

shayaknyc · Yesterday, 11:51 AM

Ok, so I cloned the repo, and set the CALIBRE_DEVELOP_FROM variable to the full path for the src directory. Presumably, any subsequent usage of the calibre-debug command should utilize this source tree for the python scripts, yeah? If so, the command still appears to hang in exactly the same place:

Code:

$ echo $CALIBRE_DEVELOP_FROM
/home/shayaknyc/git/calibre/src

$ calibre-debug --export-all-calibre-data /home/shayaknyc/ayp/Calibre-Backup-20260127 all
Exporting libraries: /home/shayaknyc/win-d/Users/shaya/Documents/Calibre Library to: /home/shayaknyc/ayp/Calibre-Backup-20260127
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/ANOBII.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 202, in exec_module
  File "calibre/customize/zipplugin.py", line 198, in get_code
  File "calibre_plugins.ANOBII.__init__", line 39
        cached_cover_url_is_reliable = True
    ^
TabError: inconsistent use of tabs and spaces in indentation
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/Barnes & Noble.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 209, in exec_module
  File "calibre_plugins.barnes_noble.__init__", line 11, in <module>
    from urllib import quote
ImportError: cannot import name 'quote' from 'urllib' (/opt/calibre/lib/calibre-extensions/python-lib.bypy.frozen/urllib/__init__.pyc)
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/DOC Input.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 329, in load
calibre.customize.InvalidPlugin: The plugin at /home/shaya/.config/calibre/plugins/DOC Input.zip cannot be used on linux
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/KoboBooks.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 209, in exec_module
  File "calibre_plugins.kobobooks.__init__", line 10, in <module>
    import time, re, HTMLParser
ModuleNotFoundError: No module named 'HTMLParser'
Failed to initialize plugin: '/home/shayaknyc/.config/calibre/plugins/Read MP3 AudioBook metadata.zip'
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 833, in initialize_plugins
  File "calibre/customize/ui.py", line 87, in load_plugin
  File "calibre/customize/zipplugin.py", line 310, in load
  File "importlib/__init__.py", line 126, in import_module
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "calibre/customize/zipplugin.py", line 209, in exec_module
  File "calibre_plugins.audiobookmetadatareader.__init__", line 8, in <module>
    from common import DEBUG
ModuleNotFoundError: No module named 'common'
/home/shayaknyc/win-d/Users/shaya/Documents/Calibre Library 0 2
metadata.db 0 2824
^CTraceback (most recent call last):
  File "calibre/db/backend.py", line 2721, in _backup_database
apsw.BusyError: not an error

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "runpy.py", line 198, in _run_module_as_main
  File "runpy.py", line 88, in _run_code
  File "site.py", line 47, in <module>
  File "site.py", line 43, in main
  File "calibre/debug.py", line 308, in main
  File "calibre/utils/exim.py", line 554, in run_exporter
  File "calibre/utils/exim.py", line 213, in export
  File "calibre/db/cache.py", line 86, in call_func_with_lock
  File "calibre/db/cache.py", line 3169, in export_library
  File "calibre/db/backend.py", line 2726, in backup_database
  File "calibre/db/backend.py", line 2720, in _backup_database
  File "contextlib.py", line 446, in __exit__
KeyboardInterrupt

Am I doing something wrong? I can confirm the cache.py file has the commit you reference above.

kovidgoyal · Yesterday, 11:00 PM

Stick a print statement in there to check if you are indeed running from source.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Export/import all calibre data	deleted_account23	Library Management	1	07-16-2024 01:38 PM
Calibre 5.7.2 Hangs When Restarted In Debug Mode	baslow	Calibre	9	12-17-2020 06:07 PM
Cannot modify selected data within Export Calibre data	Pholipe	Library Management	1	09-05-2019 12:34 PM
Export Calibre Data	GeckoFriend	Library Management	4	03-27-2018 04:15 PM
Calibre Hangs when downloading Metadata	Rudyman	Library Management	9	08-19-2011 12:17 PM

01-26-2026, 10:42 PM	#2
kovidgoyal creator of calibre Posts: 45,918 Karma: 29228280 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Press ctrl+C that should interrupt it and get you a stack trace.

01-26-2026, 11:04 PM	#4
kovidgoyal creator of calibre Posts: 45,918 Karma: 29228280 Join Date: Oct 2006 Location: Mumbai, India Device: Various	That looks like something else has opened the calibre database and hence you are getting busy errors from sqlite.

01-26-2026, 11:18 PM	#6
kovidgoyal creator of calibre Posts: 45,918 Karma: 29228280 Join Date: Oct 2006 Location: Mumbai, India Device: Various	See if that helps: https://github.com/kovidgoyal/calibr...0f70adda71720a

01-26-2026, 11:30 PM	#8
kovidgoyal creator of calibre Posts: 45,918 Karma: 29228280 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Wait for the next release or run calibre from source as described in: https://manual.calibre-ebook.com/develop.html

Yesterday, 11:00 PM	#10
kovidgoyal creator of calibre Posts: 45,918 Karma: 29228280 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Stick a print statement in there to check if you are indeed running from source.