11-14-2018, 05:45 PM | #196 |
Deviser
Posts: 2,265
Karma: 2090983
Join Date: Aug 2013
Location: Texas
Device: none
|
CorruptError: database disk image is malformed
Your debug log notes at the top that Calibre has not been shutting down gracefully, and at the bottom says:
Code:
Traceback (most recent call last): File "site-packages/calibre/gui2/ui.py", line 1056, in closeEvent File "site-packages/calibre/gui2/ui.py", line 972, in shutdown File "site-packages/calibre/db/cache.py", line 63, in call_func_with_lock File "site-packages/calibre/db/cache.py", line 617, in set_pref File "site-packages/calibre/db/backend.py", line 134, in set File "site-packages/calibre/db/backend.py", line 123, in __setitem__ File "site-packages/calibre/db/backend.py", line 845, in execute File "src/cursor.c", line 236, in resetcursor CorruptError: CorruptError: database disk image is malformed If you are running CALM with your Calibre Libraries on a network, that could be the problem. Ensure that there are no capitalization differences between your stated paths and the actual paths. Walk before you run. Try temporarily consolidating only one (1) single Source Library that is on a local drive into a CALM Target Library that is on the same local drive. If that works, then you have a functional baseline to start from, and you would know whether or not your current issues were likely caused by your computing environment. DaltonST |
07-08-2019, 03:20 PM | #197 |
Deviser
Posts: 2,265
Karma: 2090983
Join Date: Aug 2013
Location: Texas
Device: none
|
Version 2.0.33 Python 3 compatibility; Minimum version now 3.41.3.
Version 2.0.33 -2019-07-08 Python 3 compatibility; Minimum version now 3.41.3.
Upgrade Calibre first. As always, test a new version of CALM against test Libraries using the various "Metadata Tools" that update your Source Libraries. The CALM Target Library can always be deleted and recreated via a new Consolidation job, but your Source Libraries need to be protected from undesired changes. Always back up their metadata.db files before using the "Metadata Tools" to do mass changes of them from the CALM Target Library. Remember to back up your personal metadata_tools.db file in your CALM Target Library directory, since it has your personally-maintained "Derive Genres" configuration, not to mention all of your Tag Rules. You do not want to have to manually recreate all of those rules, so do yourself a favor and back that db up. DaltonST |
Advert | |
|
11-13-2019, 06:50 PM | #198 |
Library Breeder (She/Her)
Posts: 1,153
Karma: 1900479
Join Date: Apr 2015
Location: Fullerton, California
Device: Kobo Aura HD (1) PW3 (4) PW3 2019 new edition (1)
|
I am attempting to use CALM for the first time, and I got my library columns all standardized, but it is still giving me problems with some of them. I used JobSpy to get the custom column matrix and confirmed that the lables, headers, and desctiptions are all the same. I can't seem to get past this column,
label name datatype id editable is_multiple normalized display all_the_book_sources All_Sources text 66 1 1 1 {"description": "", "is_names": false} the info is kind of smooshed, but you can see what the details are. Can you help? Is is possible that because the title is All_Sources, and the label is "#all_the_book_sources", this is the problem? I changed the header to be less words. calibre, version 4.3.0 ERROR: CALM: GENERATION OF CUSTOM COLUMNS TERMINATED PREMATURELY........ERROR: >>>>Exception in db.create_custom_column creating new custom column: ConstraintError: UNIQUE constraint failed: custom_columns.label The failed parameter used was: all_the_book_sources_14 All_Sources text with display: {} with is-multiple: True Last edited by Rellwood; 11-13-2019 at 06:54 PM. |
11-13-2019, 07:20 PM | #199 |
Library Breeder (She/Her)
Posts: 1,153
Karma: 1900479
Join Date: Apr 2015
Location: Fullerton, California
Device: Kobo Aura HD (1) PW3 (4) PW3 2019 new edition (1)
|
Is there a way of using the metadata tools outside of the CALM library? I want to fix the metadata in my main library, but since I have never been able to create the CALM library because of errors, I can't. I want to standardize my metadata, but unless I use CALM, I can't.
|
11-13-2019, 08:46 PM | #200 |
Deviser
Posts: 2,265
Karma: 2090983
Join Date: Aug 2013
Location: Texas
Device: none
|
The is_names in displays looks different. The ToolTips are necessary reading. The custom columns must be identical in all respects (except for Description) to be combined.
Also, you would get the error that you posted only if you forgot to refresh the CALM skeleton Target Library after each failed generation. That causes the duplicate key error. CALM tools use the CALM Target Library. If you are trying to synchronize all of your Tags, have you thought about creating a spreadsheet for each of the Job Spy Tag Scrubbing Rules Tables and then uploading each one to each of your Libraries to run? DaltonST Last edited by DaltonST; 11-14-2019 at 09:39 AM. |
Advert | |
|
12-19-2019, 10:35 AM | #201 |
Member
Posts: 14
Karma: 10
Join Date: Nov 2019
Device: Kindle Fire
|
Hello, trying to get calm to work, and I'm able to get to the stage where it runs the consolidation and I'm getting this error message:
Code:
SQLError: near "s": syntax error Job: "CALM Consolidation" failed with error: Traceback (most recent call last): File "site-packages\calibre\gui2\threaded_jobs.py", line 83, in start_work File "calibre_plugins.consolidate_all_library_metadata.calm_consolidation", line 100, in main_calm_consolidation File "calibre_plugins.consolidate_all_library_metadata.calm_consolidation", line 203, in CALM_Control File "calibre_plugins.consolidate_all_library_metadata.calm_consolidation", line 382, in source_control File "calibre_plugins.consolidate_all_library_metadata.calm_consolidation", line 1424, in apsw_attach_to_source SQLError: SQLError: near "s": syntax error |
12-19-2019, 11:11 AM | #202 |
Deviser
Posts: 2,265
Karma: 2090983
Join Date: Aug 2013
Location: Texas
Device: none
|
You did not state what OS and Calibre Version you are using, and did not attach a screenprint of your Source Library Tab within CALM.
Looks like a value in one of your Source Libraries has some irregular punctuation that SQLite cannot handle. Example: a double-quote that does not belong there. Also, run in Debug Mode for a full debugging log. DaltonST Last edited by DaltonST; 12-19-2019 at 11:15 AM. |
12-19-2019, 12:48 PM | #203 | |
Member
Posts: 14
Karma: 10
Join Date: Nov 2019
Device: Kindle Fire
|
Quote:
|
|
12-19-2019, 12:49 PM | #204 | |
Member
Posts: 14
Karma: 10
Join Date: Nov 2019
Device: Kindle Fire
|
Quote:
That was the issues. Apostrophe in one of the Libraries. Thanks for the quick reply. |
|
12-22-2019, 05:00 PM | #205 |
Deviser
Posts: 2,265
Karma: 2090983
Join Date: Aug 2013
Location: Texas
Device: none
|
Version 2.0.34 Technical changes after Python 3.8 testing with Calibre 4.99.2.
Version 2.0.34 -2019-12-22 Technical changes after Python 3.8 testing with Calibre 4.99.2. Minimum version now 4.6 Upgrade Calibre first, as always.
DaltonST |
02-19-2020, 10:48 AM | #206 |
Deviser
Posts: 2,265
Karma: 2090983
Join Date: Aug 2013
Location: Texas
Device: none
|
Version 2.0.35 CALM 'Derive Genres' technically upgraded
Version 2.0.35 -2020-02-19 CALM 'Derive Genres' technically upgraded to be consistent with QuarantineAndScrub's recently technically overhauled 'Derive Genres'.
DaltonST |
02-21-2020, 03:38 PM | #207 |
Library Breeder (She/Her)
Posts: 1,153
Karma: 1900479
Join Date: Apr 2015
Location: Fullerton, California
Device: Kobo Aura HD (1) PW3 (4) PW3 2019 new edition (1)
|
Quick Question,
Can enumerated colunms (comments with set data) be included if they are all the same? Splitting a big library using it as the template for 5 new libraries. I don't know if I need to convert the columns to tags or if I can leave them. Oh, and I updated to Windows 10 and am using the latest version of Calibre |
02-22-2020, 10:19 AM | #208 | |
Deviser
Posts: 2,265
Karma: 2090983
Join Date: Aug 2013
Location: Texas
Device: none
|
Enumerations
Quote:
If you tested a generation to check your settings, you would see a list in the Generation Tab that looks something like: Code:
s:/calibre/calibremcs --------------------- #abc_numeric - ABC Numeric - int - Activated s:/calibre/calibremcs2 -------------------- #abc_numeric - ABC Numeric - int - Activated s:/calibre/calibremcs --------------------- #author_book_count - ABC - text - Activated s:/calibre/calibremcs2 -------------------- #author_book_count - ABC - text - Activated s:/calibre/calibremcs --------------------- #been_read - Read? - bool - Activated s:/calibre/calibremcs --------------------- #ddc - DDC - text - Activated s:/calibre/calibremcs2 -------------------- #ddc - DDC - text - Activated s:/calibre/calibremcs --------------------- #ff_author_id - FF Author ID - text - Activated s:/calibre/calibremcs --------------------- #ff_author_names - FF Author Names - text - Activated s:/calibre/calibremcs --------------------- #ff_metadata - FF Metadata - comments - Activated s:/calibre/calibremcs --------------------- #genre_source - Genre (Source) - text - Activated s:/calibre/calibremcs2 -------------------- #genre_source - Genre (Source) - text - Activated s:/calibre/calibremcs --------------------- #isbn_source - ISBN (Source) - composite - Not Activated s:/calibre/calibremcs2 -------------------- #isbn_source - ISBN (Source) - composite - Not Activated s:/calibre/calibremcs2 -------------------- #isni_url - ISNI.org URL - composite - Not Activated s:/calibre/calibremcs2 -------------------- #lc_authority_name_url - LC Authority Name URL - composite - Not Activated s:/calibre/calibremcs --------------------- #lcc - LCC - text - Activated s:/calibre/calibremcs2 -------------------- #lcc - LCC - text - Activated s:/calibre/calibremcs --------------------- #lcead - LC Extra Author Details - text - Activated s:/calibre/calibremcs2 -------------------- #lcead - LC Extra Author Details - text - Activated s:/calibre/calibremcs2 -------------------- #loc_lccn - LOC LCCN - composite - Not Activated s:/calibre/calibremcs2 -------------------- #loc_lccn_url - LOC LCCN URL - composite - Not Activated s:/calibre/calibremcs --------------------- #mcs_was_indexed - MCS - bool - Activated s:/calibre/calibremcs --------------------- #mycomments - MyComments - comments - Activated s:/calibre/calibremcs2 -------------------- #mycomments - MyComments - comments - Activated s:/calibre/calibremcs --------------------- #mydate - MyDate - datetime - Activated s:/calibre/calibremcs2 -------------------- #mydate - MyDate - datetime - Activated s:/calibre/calibremcs2 -------------------- #myenumeration - MyEnumeration - enumeration - Activated s:/calibre/calibremcs --------------------- #myfloat - MyFloat - float - Activated s:/calibre/calibremcs2 -------------------- #myfloat - MyFloat - float - Activated s:/calibre/calibremcs --------------------- #myinteger - MyInteger - int - Activated s:/calibre/calibremcs2 -------------------- #myinteger - MyInteger - int - Activated s:/calibre/calibremcs --------------------- #mymcsenumeration - MyMCSEnumeration - enumeration - Activated s:/calibre/calibremcs --------------------- #myrating - My Rating - rating - Activated s:/calibre/calibremcs2 -------------------- #myrating - My Rating - rating - Activated s:/calibre/calibremcs --------------------- #myserieslike - MySeriesLike - series - Activated s:/calibre/calibremcs2 -------------------- #myserieslike - MySeriesLike - series - Activated s:/calibre/calibremcs --------------------- #mysize - MySize - composite - Not Activated If Enumeration datatypes do not have the IDENTICAL valid values, the CALM Target Library would cause major Calibre GUI freezing, since Calibre assumes that you would not mix apple Enumerations with orange Enumerations. Use the Job Spy tool for creating a matrix of all Custom Columns in all of your Calibre Libraries so you can compare them carefully, including the Display on the right side of the matrix. If you search this thread, for "Enumeration", you will find that one particular user said "they were identical", but they were not, and had major issues. Caveat Emptor. Having said that, after the above occurred, I added special logic to stop it from happening again...most of the time. The burden is still on the user to comply with the ToolTips in the Generation Tab. DaltonST |
|
03-09-2020, 05:12 PM | #209 |
Library Breeder (She/Her)
Posts: 1,153
Karma: 1900479
Join Date: Apr 2015
Location: Fullerton, California
Device: Kobo Aura HD (1) PW3 (4) PW3 2019 new edition (1)
|
Thanks!
I wasn't sure if enumeration was an option. I understand that they need to be the same. I might just create new libraries from a single one and move all the books into them so the columns are the same. |
05-05-2020, 11:09 PM | #210 |
Junior Member
Posts: 6
Karma: 10
Join Date: May 2020
Device: KindlePW5
|
I'm having issues on Linux. And I know exactly what is wrong (well, I think).
`calm_dialog.py:6882` at least. There are several calls to `.lower()` for directories. For anything that uses a case sensitive file system, this means that file might not exist. I can have `/home/xvicarious/Calibre Library`, `/home/xvicarious/calibre library`, etc. That is what I gathered from the debug logs. It says it can't find the database. Well its not really looking in the right place. |
Tags |
calibredb, consolidate, genre, tags |
Thread Tools | Search this Thread |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
[GUI Plugin] KindleUnpack - The Plugin | DiapDealer | Plugins | 492 | 10-25-2022 08:13 AM |
[Metadata Source Plugin] SRU - Library of Congress & GBV (ger) | vform | Plugins | 3 | 01-28-2014 04:54 PM |
Getting custom metadata field in GUI plugin | SauliusP. | Development | 7 | 02-11-2012 01:31 AM |
[GUI Plugin] Plugin Updater **Deprecated** | kiwidude | Plugins | 159 | 06-19-2011 12:27 PM |
Can I make Sony Ebook Library consolidate my library? | palex481 | Sony Reader | 5 | 05-18-2008 07:44 PM |