View Single Post
Old 10-02-2015, 04:48 PM   #1
DaltonST
Deviser
DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.
 
DaltonST's Avatar
 
Posts: 1,612
Karma: 255700
Join Date: Aug 2013
Location: Texas
Device: 10" Win10 Tablet w/Calibre64, CalibreSpy & Freda+
[GUI Plugin] Consolidate All Library Metadata (CALM)

[GUI Plugin] Consolidate All Library Metadata (CALM): A Calibre Add-on

Application Functions and Features:
Spoiler:

[1] Consolidate a snapshot of all of the standard and custom column metadata for all of your Calibre Libraries into a temporary CALM Target Library.

[2] View the consolidated metadata of all of your books from all of your Calibre Libraries simultaneously;

[3] Standardize Tags, Genres, Identifiers and most Custom Columns centrally in the snapshot CALM Target Library using CALM's Metadata Tools;

[4] Propagate the standardized Tags, Genres, Identifiers and most Custom Columns from the snapshot CALM Target Library back to the 'real' Source Libraries;


Questions & Answers:
Spoiler:
[1] Do I need CALM if I have only a single Calibre Library?

The answer is often 'Yes'. CALM has Metadata Tools for standardizing and deriving Tags and Genres using Rules that you maintain based on your personal needs and desires.

If you do not use Tags and Genres, or if they are already standardized, and if you do not frequently add new books to your single Calibre Library, then you do not need CALM.


[2] I have many Libraries, but my metadata is already 'perfect' and entirely standardized. What does CALM have to offer me?

Consolidation of the basic metadata for all of the books in all of your libraries so you can view and analyze it all simultaneously using both Calibre advanced search functions and the MultiColumnSearch plug-in's additional advanced search capabilities.

Afterward, using CALM-specific functionality, you can shuffle your books among your many libraries for the purpose of moving them into their correct locations, as well as deleting cross-library duplicates.


[3] Is CALM's Consolidation Job just a mass “copy” from all of my Calibre Libraries into the CALM Target Library?

No. Absolutely not. The Consolidation Job creates a temporary “snapshot” Calibre Library that has no book formats whatsoever. It copies the standard metadata for each book in each specified “Source Library”, but not the book itself. For that reason, the consolidation job executes quickly.


[4] Does CALM also consolidate custom columns?

Yes. All, some or none. You decide.


[5] Is the CALM Target Library a fully functional, "real", Calibre Library?

Yes. Of course. Otherwise, you would not be able to use any Calibre plugins, including the ones recommended below.


Requires Minimum Calibre Version: 4.6


Companion Plugin - Essential : View Manager

Companion Plugin - Recommended : Job Spy

Companion Plugin - Recommended : MultiColumnSearch


Version History:
Spoiler:
Version 2.0.35 -2020-02-19 CALM 'Derive Genres' technically upgraded to be consistent with QuarantineAndScrub's 'Derive Genres'.
Version 2.0.34 -2019-12-22 Technical changes after Python 3.8 testing with Calibre 4.99.2. Minimum version now 4.6
Version 2.0.33 -2019-07-08 Python 3 compatibility; Minimum version now 3.41.3.
Version 2.0.32 -2017-06-11 Calibre Standard Schema Version of template CALM Target Library metadata.db updated to Version 23 automatically by Calibre itself.
Version 2.0.31 -2017-05-21 Technical changes.
Version 2.0.30 -2017-05-14 Technical and functional changes for Calibre 3.0.0 compatibility. Calibre Release 3.0.0 deprecated the use of calibredb while the GUI is also running. The "Library Tools" Tab has been deleted, and is no longer available for use. You will no longer be able to shuffle your books among your Calibre Library ecosystem from a single centralized control panel (i.e., the CALM Target Library). You will need to manually add, copy, and/or delete your books by switching to each different Source Library in your ecosystem. You also will no longer be able to refresh the metadata.opf files for all of your books in all of your Source Libraries with a single click of a button.
Version 2.0.29 -2017-05-05 Allow themes with user-defined icons.
Version 2.0.28 -2016-08-24 'Purge_all_enumerations' message fixed.
Version 2.0.27 -2016-08-22 Enumerations changed.
Version 2.0.26 -2016-08-12 Calibre Release 2.64 implemented new attributes for Custom Column datatype=comments. CALM was changed to be aware of the new attributes during Generation.

Version History-Archive:
Spoiler:

Version 2.0.25 -2016-07-30 Bug fix for OSX and Linux.

Version 2.0.24 -2016-07-30 Bug fix in library path sorting for OSX and Linux.

Version 2.0.23 -2016-07-29 Bug fix related to saving preferences within the Source Library tab if the user did not immediately move to the other tabs and execute a function that would also save, albeit indirectly, the Source Library preferences.

Version 2.0.22 -2016-07-28 Fixed Source Libraries Tab Load-All-Known-Libraries function.

Version 2.0.21 -2016-07-28 Bug Fix.

Version 2.0.20 -2016-07-28 Bug Fix.

Version 2.0.19 -2016-06-24 Compatibility improvement for use with Linux and OSX; now does not delete any Identifiers that start with a 'z', nor 'doi'.

Version 2.0.18 -2016-05-25 Technical changes.

Version 2.0.17 -2016-03-26 Attempt to solve OSX subprocess issue.

Version 2.0.16 -2016-03-05 Speed Optimization for the Consolidation of the MCS 'Word-Book Index'; Miscellaneous enhancements.

Version 2.0.15 -2016-03-04 New: Option to consolidate the 'Multi-Column Search' plug-in 'Word-Book Index' into the CALM Target Library so that MCS Word-Book Queries may be executed against all consolidated Source Libraries simultaneusly.

Version 2.0.14 -2016-02-16 Technical tweaks.

Version 2.0.13 -2016-02-03 New Metadata Tool: Copy almost any Target Library Custom Column back to the mapped Source Library Custom Column, replacing the Source with the Target. Analagous to what is already available for Tags and Genre.

Version 2.0.12 - 2016-01-12 Miscellaneous enhancements.

Version 2.0.11 - 2015-12-27 Miscellaneous enhancements.

Version 2.0.10 - 2015-12-26 Composite Custom Columns that would cause Template Key Errors in the Target Library are made inert after Generation. The cause of these errors is usually a lack of Custom Column Standardization within the Source Libraries.

Version 2.0.9 - 2015-12-24 Miscellaneous tweaks.

Version 2.0.8 - 2015-12-24 New 'Standard' CALM Target Library Custom Column: #source_cover. The CALM Template Target Library used to 'refresh' has been updated to always show that new Standard Custom Column. Unless you start with a clean slate, you will have to update View Manager yourself.

Version 2.0.7 - 2015-12-23 New 'Standard' CALM Target Library Custom Column: #source_format_types. The CALM Template Target Library used to 'refresh' has been updated to always show that new Standard Custom Column, and to also color that column 'blue'. Unless you start with a clean slate, you will have to update View Manager and the Look&Feel color rules yourself.

Version 2.0.6 - 2015-12-18 Consolidation now properly updates the index for Series-Like custom columns.

Version 2.0.5 - 2015-12-17 Miscellaneous technical changes.

Version 2.0.4 - 2015-12-15 Miscellaneous technical changes and enhancements.

Version 2.0.3 - 2015-12-11 Miscellaneous tweaks.

Version 2.0.2 - 2015-12-02 Menu function to delete "Non-Library Codes Identifiers" changed to also not delete new LC Identifier "loc_lccn".

Version 2.0.1 - 2015-11-20 Metadata Tools "Delete non-ISBN/ISSN Identifiers" function changed to also not delete any Identifiers created by the Library Codes plugin (viaf,lc,lccn,isni, oclc, oclc-owi). The pushbutton and other text were changed to say "Non-Library Codes".

Version 2.0.0 - 2015-10-30 Major Functionality and User Interface Enhancements to Enable the Consolidation of all, some, or no Source Library Custom Columns. Performance Improvements. Revised ToolTips and Embedded Instructions and FAQs.

Version 1.0.0 - 2015-10-02 Initial release.

Attached Thumbnails
Click image for larger version

Name:	calm_target_library_gui_all_standard_and_custom_columns_example.jpg
Views:	1280
Size:	863.4 KB
ID:	143312   Click image for larger version

Name:	calm_selective_activation_example.jpg
Views:	2504
Size:	531.6 KB
ID:	150606   Click image for larger version

Name:	calm_source_custom_columns_tab_listing.jpg
Views:	1820
Size:	441.3 KB
ID:	150607   Click image for larger version

Name:	calm_enumeration_custom_column_examples_version2027.jpg
Views:	940
Size:	235.7 KB
ID:	151125   Click image for larger version

Name:	calm_metadata_tool_custom_column_synchronization.jpg
Views:	252
Size:	370.6 KB
ID:	172314  
Attached Files
File Type: pdf calm_tag_rules_tables_maintenance_instructions.pdf (567.4 KB, 1258 views)
File Type: pdf calm_derive_genres_instructions.pdf (567.6 KB, 1176 views)
File Type: pdf CALM_Slideshow_Version_2.pdf (6.23 MB, 1261 views)
File Type: zip consolidate_all_library_metadata.zip (547.3 KB, 196 views)

Last edited by DaltonST; 02-19-2020 at 11:45 AM. Reason: Version 2.0.35
DaltonST is offline   Reply With Quote