View Single Post
Old 02-20-2017, 11:00 AM   #154
AnselmD
Zealot
AnselmD began at the beginning.
 
Posts: 105
Karma: 10
Join Date: Oct 2013
Device: none
Quote:
Originally Posted by Terisa de morgan View Post
Hi,

This version should resolve @AnselmD's problem for sure (bug more or less..) and hopefully @giuseppe's too.
Thank you very much @terisa,
this looks much better now, nevertheless rarely the database seems to be under stress (BusyError: BusyError: database is locked).
Miscellaneous -> "Max. simultaneous conversion/new Download/plugin jobs" was set to 4.

Code:
DEBUG: 2382.7 File:  pg131.epub
DEBUG: 2382.7 Updating column  #fileext for book id:  711  with value:  epub
DEBUG: 2383.0 Updating column  #filename for book id:  711  with value:  pg131
Added The Pilgrim's Progress from this world to that which is to come / Delivered under the simi
litude of a dream, by John Bunyan to db in: 3.2
DEBUG: 2385.8 File:  pg128.epub
DEBUG: 2385.8 Updating column  #fileext for book id:  712  with value:  epub
DEBUG: 2386.1 Updating column  #filename for book id:  712  with value:  pg128
Added The Arabian Nights Entertainments to db in: 3.1
DEBUG: 2389.1 File:  pg126.epub
DEBUG: 2389.1 Updating column  #fileext for book id:  713  with value:  epub
DEBUG: 2389.4 Updating column  #filename for book id:  713  with value:  pg126
Added The Poison Belt to db in: 3.1
DEBUG: 2392.3 File:  pg125.epub
DEBUG: 2392.3 Updating column  #fileext for book id:  714  with value:  epub
DEBUG: 2392.5 Updating column  #filename for book id:  714  with value:  pg125
Added A Girl of the Limberlost to db in: 3.2
DEBUG: 2395.4 File:  pg124.epub
DEBUG: 2395.4 Updating column  #fileext for book id:  715  with value:  epub
DEBUG: 2395.7 Updating column  #filename for book id:  715  with value:  pg124
Added Deuterocanonical Books of the Bible / Apocrypha to db in: 3.1
Running file type plugin GetFileName failed with traceback:
Traceback (most recent call last):
  File "site-packages/calibre/customize/ui.py", line 209, in run_plugins_on_postadd
  File "calibre_plugins.getfilename.__init__", line 154, in postadd
  File "calibre_plugins.getfilename.config", line 110, in get_library_config
  File "site-packages/calibre/library/__init__.py", line 11, in db
  File "site-packages/calibre/db/legacy.py", line 76, in __init__
  File "site-packages/calibre/db/legacy.py", line 48, in create_backend
  File "site-packages/calibre/db/backend.py", line 402, in __init__
  File "site-packages/calibre/db/backend.py", line 576, in initialize_custom_columns
  File "site-packages/calibre/db/backend.py", line 822, in execute
  File "src/cursor.c", line 231, in resetcursor
BusyError: BusyError: database is locked
Added At the Earth's Core to db in: 2.5
DEBUG: 2400.9 File:  pg120.epub
DEBUG: 2400.9 Updating column  #fileext for book id:  717  with value:  epub
DEBUG: 2401.3 Updating column  #filename for book id:  717  with value:  pg120
Added Treasure Island to db in: 3.2
DEBUG: 2404.4 File:  pg119.epub
DEBUG: 2404.4 Updating column  #fileext for book id:  718  with value:  epub
DEBUG: 2404.7 Updating column  #filename for book id:  718  with value:  pg119
Added A Tramp Abroad to db in: 3.3
DEBUG: 2407.6 File:  pg121.epub
DEBUG: 2407.6 Updating column  #fileext for book id:  719  with value:  epub
DEBUG: 2407.8 Updating column  #filename for book id:  719  with value:  pg121
Added Northanger Abbey to db in: 3.1
DEBUG: 2410.7 File:  pg122.epub
DEBUG: 2410.7 Updating column  #fileext for book id:  720  with value:  epub
DEBUG: 2411.1 Updating column  #filename for book id:  720  with value:  pg122
Added The Return of the Native to db in: 3.2
DEBUG: 2414.0 File:  pg118.epub
DEBUG: 2414.0 Updating column  #fileext for book id:  721  with value:  epub
DEBUG: 2414.3 Updating column  #filename for book id:  721  with value:  pg118
Added Big Dummy's Guide to the Internet to db in: 3.2
Code:
Added 832 books in 2736.0 seconds
This is 1 book each 3.2 seconds. I wouldn't expect this as stressful for the database. I do not additional access the database and I have only one instance of calibre running. I am using a hard drive for the calibre library with ext4 file system and a SSD as boot (and temporary) drive.

An overview which processes accesses the metadata.db

Code:
lsof |grep metadata.db
lsof: WARNING: can't stat() tracefs file system /sys/kernel/debug/tracing
      Output information may be incomplete.
calibre-d 24110              xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110              xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110              xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110              xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
GUIPool   24110 13424        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
GUIPool   24110 13424        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
GUIPool   24110 13424        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
GUIPool   24110 13424        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
QXcbEvent 24110 24116        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
QXcbEvent 24110 24116        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
QXcbEvent 24110 24116        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
QXcbEvent 24110 24116        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
Listener  24110 24132        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
Listener  24110 24132        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
Listener  24110 24132        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
Listener  24110 24132        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
Server    24110 24135        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
Server    24110 24135        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
Server    24110 24135        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
Server    24110 24135        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
calibre-d 24110 24136        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 24136        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 24136        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 24136        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
DeviceMan 24110 24137        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
DeviceMan 24110 24137        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
DeviceMan 24110 24137        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
DeviceMan 24110 24137        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
CheckForU 24110 24138        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
CheckForU 24110 24138        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
CheckForU 24110 24138        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
CheckForU 24110 24138        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
MetadataB 24110 24139        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
MetadataB 24110 24139        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
MetadataB 24110 24139        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
MetadataB 24110 24139        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
Qt\x20bea 24110 24142        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
Qt\x20bea 24110 24142        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
Qt\x20bea 24110 24142        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
Qt\x20bea 24110 24142        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
calibre-d 24110 30823        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30823        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30823        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30823        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
calibre-d 24110 30824        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30824        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30824        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30824        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
calibre-d 24110 30825        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30825        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30825        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30825        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal
calibre-d 24110 30826        xyz   15uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30826        xyz   23uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30826        xyz   33uw     REG               8,98  1340416   88997890 /media/xyz/ebooks/testfilename8/metadata.db
calibre-d 24110 30826        xyz   34u      REG               8,98     6704   89000540 /media/xyz/ebooks/testfilename8/metadata.db-journal


Click image for larger version

Name:	Screenshot from 2017-02-20 16-17-26.png
Views:	747
Size:	177.2 KB
ID:	155145
debuglog.7z.zip

Last edited by AnselmD; 02-20-2017 at 11:12 AM.
AnselmD is offline   Reply With Quote