View Single Post
Old 06-22-2016, 11:13 AM   #1
DaltonST
Deviser
DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.DaltonST ought to be getting tired of karma fortunes by now.
 
DaltonST's Avatar
 
Posts: 2,265
Karma: 2090983
Join Date: Aug 2013
Location: Texas
Device: none
[GUI Plugin] Zotero Metadata Importer

[GUI Plugin] Zotero Metadata Importer

Summary:

You must use Zotero to use ZMI, which both imports files from Zotero into Calibre, and exports files from Calibre for import into Zotero.

  • ZMI has the ability to export Calibre metadata to an RIS file specifically formatted for Zotero, including an "L1" RIS Tag used by Zotero to automatically import a Calibre .pdf file into Zotero as an Item's File Attachment, and an "L4" RIS Tag that does the same for other ebook formats, such as .epub or .mobi or any others.
  • If you want your Zotero book files in Calibre along with their Zotero metadata, ZMI is currently the only known mechanism to do so other than manually keying it into Calibre. Refer to the attached images that provide an overview.

    You must use ZMI to add your Zotero books to Calibre if you want ZMI to automatically update those books with the Zotero metadata. Do not use the "Add Books" button in Calibre unless you want to manually enter the Zotero Metadata.
  • ZMI has a "Compare to Zotero" function that will use the Zotero "KEY", which is assigned automatically by Zotero to each and every item, and which is imported by ZMI into Calibre, to compare Zotero items to Calibre books. This comparison is by both Collection in Zotero, and for all Calibre books in your ZMI Calibre Library regardless of Collection assignment.

    This comparison will automatically update Calibre metadata for each book with its currently assigned Zotero Collection. If a Zotero item is part of more than one (1) Collection, ZMI will report that fact.

    See the example ZMI Comparison Report for all Collections below.

    Spoiler:



    Full Listing of All Zotero Collections and Items Compared to Calibre


    ------------------------------------------


    Grand Total Collection Items in Zotero: 48
    Grand Total Zotero Items in Calibre: 2


    ------------------------------------------


    Standard 37VM3FBC Digital sound recorder: a case study on designing embedded systems using the UML notation id: 13867


    Standard 49QMRUPD A critical customer identification model for technology and service providers id: 13866


    Standard 4F4MT6AR *MISSING: Vorgehensweise bei einer qualitativen Expertenbefragung am Beispiel Fondsmanager journalArticle


    Standard 6Y57NUZB *MISSING: A scientist's view.pdf attachment application/pdf


    Standard 72P258HM *MISSING: ETHER AND THE THEORY OF RELATIVITY bookSection


    Standard 9YA8AJJR *MISSING: 3722-1.pdf attachment application/pdf


    Standard AETQ35R2 *MISSING: Asymmetrische Verschlüsselung (mathematische Grundlagen) journalArticle


    Standard AEU7AJHZ *MISSING: Adaptive MIMO-OFDM for future mobile radio communications conferencePaper


    Standard BVMM3W74 *MISSING: The Post-Embargo Open Access Citation Advantage: It Exists (Probably), It’s Modest (Usually), and the Rich Get Richer (of Course) journalArticle


    Standard C3MAYEKW *MISSING: Persistence of Different-sized Populations: A inEmpirical Assessment of Rapid Extinctions in Bighorn Sheep journalArticle


    Standard CD5ATU78 *MISSING: An Introduction to Ontologies and Ontology Engineering bookSection


    Standard CMVPBQBN *MISSING: Effect of Sociality and Season on Gray Wolf (Canis lupus) Foraging Behavior: Implications for Estimating Summer Kill Rate journalArticle


    Standard D5VLTK4W *MISSING: Front-loading problem solving in co-development: managing the contractual, organisational and cognitive dimensions journalArticle


    Standard DQ35VHCQ *MISSING: THE POTENTIAL OF THREE-DIMENSIONAL DISPLAY- TECHNOLOGIES FOR THE VISUALIZATION OF GEO- VIRTUAL ENVIRONMENTS journalArticle


    Standard DUYS9WV4 *MISSING: Open access, readership, citations: a randomized controlled trial of scientific journal publishing journalArticle


    Standard E8DKSHFB *MISSING: [THESIS TITLE GOES HERE] - Georgia Tech Thesis Office.pdf attachment application/pdf


    Standard ESLXLLTL *MISSING: Quantifying Landscape Ruggedness for Animal Habitat Analysis: A Case Study Using Bighorn Sheep in the Mojave Desert journalArticle


    Standard FQ8QHGI4 *MISSING: A lightweight methodology for rapid ontology engineering journalArticle


    Standard FU36AL86 *MISSING: Neonatal mortality of elk driven by climate, predator phenology and predator community composition journalArticle


    Standard GA9QN984 *MISSING: The Challenges and Issues with Nanotechnology at the Product Development Stage journalArticle


    Standard GBCHIRDB *MISSING: 2.pdf attachment application/pdf


    Standard HYAAVK9M *MISSING: Ontology Engineering in the Era of Linked Data | ASIS&T journalArticle


    Standard I8YQ4YJD *MISSING: Open Access Citation Advantage: An Annotated Bibliography journalArticle


    Standard IDN2HM4M *MISSING: Molecular Surveillance for Bartonella, Borrelia, and Rickettsia Species in Ticks from Desert Bighorn Sheep (Ovis canadensis) and Mule Deer (Odocoileus hemionus) in Southern California, USA journalArticle


    Standard J4NSBRB9 *MISSING: Highways block gene flow and cause a rapid decline in genetic diversity of desert bighorn sheep journalArticle


    Standard L53K2XQT *MISSING: Yellowstone after Wolves journalArticle


    Standard M94CL4EK *MISSING: 8Nanomat_Szene_Lambauer_Voss_IER.pdf attachment application/pdf


    Standard NDY7NA2F *MISSING: Corynebacterium pseudotuberculosis and Copper Deficiency in a Male Rocky Mountain Bighorn Sheep (Ovis canadensis canadensis) in Utah, USA journalArticle


    Standard NZ69YTNT *MISSING: Von der Hochschule ins Berufsleben journalArticle


    Standard PB2KLSCV *MISSING: nanoDE-Report_2011.pdf attachment application/pdf


    Standard QMQ9DPX2 *MISSING: The future of entrepreneurial ®nance journalArticle


    Standard QNM7SFWI *MISSING: 10_EN_303.pdf attachment application/pdf


    Standard SDQ9XWIC *MISSING: 1461.de.pdf attachment application/pdf


    Standard T5A3C4XN *MISSING: H.R.5751 - 114th Congress (2015-2016): Shiras Moose Protection and Recovery Act bill


    Standard TJNAFX8X *MISSING: big_data_the_management_revolution.pdf attachment application/pdf


    Standard UJW9JGPB *MISSING: PROF. DR. RUDOLF VOLKART journalArticle


    Standard UPK5MVT4 *MISSING: DOES ONLINE AVAILABILITY INCREASE CITATIONS? THEORY AND EVIDENCE FROM A PANEL OF ECONOMICS AND BUSINESS JOURNALS journalArticle


    Standard USYZVXUG *MISSING: big_data_the_management_revolution.pdf attachment application/pdf


    Standard VKJYN8G4 *MISSING: Predator-prey size relationships in an African large-mammal food web journalArticle


    Standard W5WXTCC8 *MISSING: Predicting the evolutionary consequences of trophy hunting on a quantitative trait journalArticle


    Standard W77ACTU9 *MISSING: KlausurLoesungUeT1-1_4.4.2003.dvi - Unknown.pdf attachment application/pdf


    Standard X95SHFEQ *MISSING: Direct and indirect effects of early-life environment on lifetime fitness of bighorn ewes journalArticle


    Standard XZ49MKK7 *MISSING: Doing what your neighbour does: neighbour proximity, familiarity and postural alignment increase behavioural mimicry journalArticle


    Standard Y4C4S5BR *MISSING: Thoughts on Cloning Humans.pdf attachment application/pdf


    Standard YLQ5UGTG *MISSING: Wolf kill rates across winter in a low-density moose system in Alaska journalArticle



    Collection Items - Total: 45


    Collection Items - Missing: 43


    Collection Items - Match: 2


    ------------------------------------------


    Standard Duplicate1 37VM3FBC Digital sound recorder: a case study on designing embedded systems using the UML notation id: 13867


    Standard Duplicate1 49QMRUPD A critical customer identification model for technology and service providers id: 13866



    Collection Items - Total: 2


    Collection Items - Missing: 0


    Collection Items - Match: 2


    ------------------------------------------


    Standard Duplicate2 37VM3FBC Digital sound recorder: a case study on designing embedded systems using the UML notation id: 13867



    Collection Items - Total: 1


    Collection Items - Missing: 0


    Collection Items - Match: 1


    ------------------------------------------
    Total Number of Zotero Collections: 3
    ------------------------------------------


    All Items - Total: 48


    All Items - Missing: 43


    All Items - Match: 5


    ------------------------------------------


    Grand Total Collection Items in Zotero: 48
    Grand Total Zotero Items in Calibre: 2


    ------------------------------------------
    No Orphan Calibre 'ZKeys' found. All Calibre 'ZKeys' are also in Zotero.
    ------------------------------------------


  • The ZMI "User Guide" is comprised of all of the ToolTips throughout the ZMI Tabs.


What is Zotero?
Spoiler:

Zotero is free and open-source reference management software to manage bibliographic data and related research materials (such as PDF files). Notable features include web browser integration, online syncing, generation of in-text citations, footnotes and bibliographies, as well as integration with the word processors Microsoft Word, LibreOffice, OpenOffice.org Writer and NeoOffice. It is produced by the Center for History and New Media at George Mason University (GMU).

For more information: Zotero Overview



Workaround for File Attachment Issues:
Spoiler:

Scenario: ZMI will import your Zotero CSV file perfectly, but it cannot find your actual Zotero File Attachments in your Zotero storage directory. The reason is unknown, but you want to start using Calibre for your Zotero File Attachments and Metadata as soon as possible. This is how:

[1] Set your ZMI options to create empty books if no file attachments are found.

[2] Run ZMI in auto-step mode with your 'real' CSV file.

[3] Finish the updating of the new empty books' metadata in ZMI by clicking the remaining pushbuttons etc.

[4] Navigate to your Zotero 'storage' folder.

[5] Drag-and-drop each .pdf onto the Calibre Book Detail pane (on the right) for the appropriately selected "empty book". That will be easy, since the Zotero storage files have the Zotero Key in their path, and Calibre has it in the ZKey Custom Column. You can also match on author and title, of course. Calibre will ask you if you really want to add that new format. Say "yes".

You will then have your Zotero .pdf files in Calibre with all of the appropriate ZMI-created Calibre metadata.

When the reason for your temporary problem is solved, you can cease using this Drag-and-drop workaround.




Requires Minimum Calibre Version: 6.0.0 Desktop Version Only

Requires Minimum Zotero Version: 6.0.15 Desktop Version Only

Old & Deprecated versions of ZMI: https://www.mobileread.com/forums/sh...d.php?t=327472

Other Useful Calibre Plugins to Consider:


Version History:
Spoiler:

Version 1.0.78 - 2023-01-12 Qt.core.
Version 1.0.77 - 2022-11-30 Miscellany. Minimum Calibre version now 6.0.0.
Version 1.0.76 - 2022-04-14 Miscellany. Minimum Calibre version now 5.99.9.
Version 1.0.75 - 2022-04-06 Enhanced the Comparison Tab Feature "Show Full Listing [All Books]"
Version 1.0.74 - 2022-04-05 Collection Comparison ToolTips enhanced. New Comparison Tab Feature: Show Full Listing [All Books].
Version 1.0.73 - 2022-04-03 Collection assignment now uses a 3d potential #zotero_key Custom Column value in addition to the Calibre Identifiers zkey and zkey_file. This 3d source is rarely useful, but compensates for "drift" between Zotero and Calibre for items originally imported from a Zotero exported .csv file.
Version 1.0.72 - 2022-03-25 Qt6 Compatibility for Calibre Version 5.99.8+. Technical changes.
Version 1.0.70 - 2020-12-14 Technical changes.
Version 1.0.69 - 2020-12-13 Compatibility changes for Calibre 5.7. Minimum Version now 5.7.
Version 1.0.68 - 2020-07-20 Qt tweaks so the ZMI dialog displays the same in Linux on a 14" Chromebook with Debian as it does in Windows 10 on a 21" display.
Version 1.0.67 - 2020-07-13 RIS File export: add new pushbutton for exporting L1/L4 Tags that have the absolute path of the respective Calibre book (instead of the path of the intermediate temporary file) to provide the ability to "Link" to the original Calibre book rather than importing into Zotero the physical book file itself. Caution: "Linking" a Calibre book instead of "Storing" it in Zotero disables the ZMI "Collection Comparison" function for each Linked book, since by definition the Linked book does not physically exist in Zotero storage.
Version 1.0.66 - 2020-07-09 Python 3 compatibility, especially for users who had never previously first used Python 2 ZMI.
Version 1.0.65 - 2020-04-24 Regression testing and a general tune-up. Suggestion: Add the 'Mark Books' action to the 'Context Menu' via 'Preferences > Toolbars & Menus > Context Menus'.
Version 1.0.64 - 2020-04-02 RIS tag "AU": {authors} OR {author_sort}; ToolTips for RIS Export configuration revised accordingly.
Version 1.0.63 - 2020-01-03 Technical changes after Python 3.8 testing with Calibre 4.99.2
Version 1.0.62 - 2020-01-02 Technical changes after Python 3.8 testing with Calibre 4.99.2
Version 1.0.61 - 2019-11-15 Miscellaneous Technical Changes.
Version 1.0.60 - 2019-05-30 Python 3 compatibility. Minimum Calibre version now 3.41.3.
Version 1.0.59 - 2018-04-12 Miscellaneous enhancements.
Version 1.0.58 - 2018-04-11 New: Add the Zotero Key to each just-exported Calibre book after its import into Zotero so that the ZMI:Comparison Tab functionality may be used for both books imported from Zotero and Zotero books imported from Calibre.
Version 1.0.57 - 2018-04-07 New: RIS Export Tag L4 for Ebook file attachments
Version 1.0.56 - 2018-04-07 New: RIS Export Tag L1 for PDF file attachments
Version 1.0.55 - 2018-04-05 Beta: Activated RIS Export Tag L1 for PDF file attachments
Version 1.0.54 - 2018-04-04 Beta: Added RIS Export Tag L1 for .PDF Files
Version 1.0.53 - 2017-10-22 New ZMI option to create an empty book if the sole file attachment is html.
Version 1.0.52 - 2017-10-21 Technical tweaks re: showing all incomplete books.
Version 1.0.51 - 2017-09-23 Miscellaneous tweaks.
Version 1.0.50 - 2017-09-22 Calibre 3.8 now required. Update Calibre prior to updating ZMI. Functionality changes for Calibre 3.8.0 compatibility related to setting the 'covers' for newly imported Zotero 'books'.
Version 1.0.49 - 2017-08-04 New ZMI Tab: Export RIS File. Export Calibre metadata as .ris file designed specifically for import into Zotero.
Version 1.0.48 - 2017-07-28 Fixed regression error in mark/select new ZMI book interaction.
Version 1.0.47 - 2017-07-27 Miscellaneous tweaks.
Version 1.0.46 - 2017-07-26 Miscellaneous Enhancements.
Version 1.0.45 - 2017-07-25 Fixed item "title".
Version 1.0.44 - 2017-07-25 Comparison Tab enhancements.
Version 1.0.43 - 2017-07-24 Enhancement to capture Zotero Collection for all Calibre books regardless of whether it is a file attachment or not.
Version 1.0.42 - 2017-07-23 Technical changes for Zotero 5.0 Compatibility (e.g. change in column name in Zotero table itemAttachments).
Version 1.0.41 - 2017-06-11 Technical changes for Calibre 3.0.0 compatibility.
Version 1.0.40 - 2017-05-21 Technical changes.
Version 1.0.39 - 2017-05-12 Technical changes for Calibre 3.0.0 compatibility.
Version 1.0.38 - 2017-05-05 Allow themes with user-defined icons.
Version 1.0.37 - 2017-01-17 ToolTip and other miscellaneous tweaks.
Version 1.0.36 - 2017-01-14 Technical changes to account for variability in Zotero .csv file data.
Version 1.0.35 - 2016-08-12 "List Failed Adds" fixed.
Version 1.0.34 - 2016-08-12 Implemented the new features of Calibre 2.64 Custom Columns datatype of 'comments'. Zotero Custom Columns have been changed to always be 'long-text' with the heading on the 'side' of the book detail pane.
Version 1.0.33 - 2016-07-20 Changed temporary file creation for "empty books" to avoid failures.
Version 1.0.32 - 2016-07-20 Enhancement to the handling of complex .html files having many associated images and javascript files that need to be zipped together prior to adding to Calibre.
Version 1.0.31 - 2016-07-19 Repair any invalid or corrupt CSV 'file attachment' path values during the import process.
Version 1.0.30 - 2016-07-19 New: User options to copy Zotero automatic and/or manual tags to Calibre Tags.
Version 1.0.29 - 2016-07-18 Changes to 'Compare Zotero Database to Calibre Database' to take advantage of the new Identifier 'zkey_file'.
Version 1.0.28 - 2016-07-18 Major enhancements. New Identifier: zkey_file. New user option to import .txt, .text, .html and .htm file attachments as Calibre "books", although Calibre will automatically convert the html files into .zip formatted books. Those must then be converted from .zip to .epub to be readable in an e-reader. New user option to import Zotero items that have no file attachments.
Version 1.0.27 - 2016-07-15 Miscellaneous enhancements; New Calibre Identifier of 'zcollection' is updated for books with their matching Zotero collection name automatically whenever the Compare function is executed for their Zotero collection.
Version 1.0.26 - 2016-07-15 New: Compare Zotero Database to Calibre Database to find Zotero books missing from Calibre.

Version 1.0.25 - 2016-07-13 Miscellaneous enhancements.
Version 1.0.24 - 2016-07-12 Miscellaneous enhancements. Requires Minimum Calibre Version 2.62 to be installed. Upgrade Calibre first.
Version 1.0.23 - 2016-07-07 New: 'Auto-Select Multiple CSV Files' then Auto-Process all of them simultaneously. Afterwards, archive or delete the original CSV files.
Version 1.0.22 - 2016-07-06 Miscellaneous enhancements.
Version 1.0.21 - 2016-07-05 Technical enhancements.
Version 1.0.20 - 2016-07-04 Technical enhancements.
Version 1.0.19 - 2016-07-03 Enhancements to increase the efficiency of the ZMI 'process'.
Version 1.0.18 - 2016-07-02 Miscellany.
Version 1.0.17 - 2016-07-01 Many small enhancements to increase the efficiency of the ZMI 'process'.
Version 1.0.16 - 2016-06-30 New options to enhance the efficiency of the ZMI 'process'.
Version 1.0.15 - 2016-06-30 New: Progress Dialog with ability to cancel; miscellaneous tweaks; ToolTip enhancements.
Version 1.0.14 - 2016-06-30 Major Enhancements.
Version 1.0.13 - 2016-06-28 Changes.
Version 1.0.12 - 2016-06-28 Major Enhancements.
Version 1.0.11 - 2016-06-28 Enhancements.
Version 1.0.10 - 2016-06-27 Major enhancements.
Version 1.0.9 - 2016-06-27 New CSV-related error messages to assist in correcting CSV data issues
Version 1.0.8 - 2016-06-27 Enhancements.
Version 1.0.7 - 2016-06-26 Enhancements.
Version 1.0.6 - 2016-06-26 Major enhancements.
Version 1.0.5 - 2016-06-25 Major enhancements.
Version 1.0.4 - 2016-06-24 New Identifier: DOI (Document Object ID) added from ZDoi. New messages while calibredb is adding missing books.
Version 1.0.3 - 2016-06-22 New: Detects Keys for Zotero books that do not exist anywhere in Calibre in the ZKey (#zotero_key) Custom Column and also not anywhere in the Identifiers table, and offers to run calibredb to add them. Calibredb then adds the book while also adding an Identifier of zkey with a value of the CSV key to the Calibre book. Automated matching of the Identifier zkey with the CSV to automatically update metadata from Zotero is then possible.
Version 1.0.2 - 2016-06-22 Changes for Linux & OSX; New auto-run Validation of Custom Columns after ZMI starts.
Version 1.0.1 - 2016-06-22 Initial release.
Attached Thumbnails
Click image for larger version

Name:	zmi_custom_columns_version_1_0_0.jpg
Views:	4662
Size:	202.2 KB
ID:	149586   Click image for larger version

Name:	zmi_example_v1027.jpg
Views:	5668
Size:	1.20 MB
ID:	150244   Click image for larger version

Name:	zmi_all_tabs_version_1_0_34.jpg
Views:	3265
Size:	411.0 KB
ID:	150876   Click image for larger version

Name:	zmi_zcollection_identifier.jpg
Views:	2769
Size:	1.00 MB
ID:	158085   Click image for larger version

Name:	zmi_export_ris_custom_configured_for_zotero.jpg
Views:	2397
Size:	906.5 KB
ID:	158253   Click image for larger version

Name:	zmi_tag_L1_example.jpg
Views:	2398
Size:	1.02 MB
ID:	163294   Click image for larger version

Name:	zmi_ris_all.jpg
Views:	1965
Size:	804.4 KB
ID:	163300   Click image for larger version

Name:	zmi_tag_L4.jpg
Views:	1896
Size:	917.5 KB
ID:	163318   Click image for larger version

Name:	zmi_retrieve_zkey_from_new_zotero_attachments.jpg
Views:	2161
Size:	1.04 MB
ID:	163427   Click image for larger version

Name:	collection comparison - show full listing example.jpg
Views:	521
Size:	201.8 KB
ID:	193128   Click image for larger version

Name:	zotero_storage_sqlite_example_attachment.jpg
Views:	336
Size:	1.07 MB
ID:	198231   Click image for larger version

Name:	DaltonSTplugins@20230122.jpg
Views:	279
Size:	420.6 KB
ID:	199198  
Attached Files
File Type: zip zotero_metadata_importer.zip (68.8 KB, 23302 views)

Last edited by DaltonST; 02-06-2023 at 12:03 PM. Reason: Version 1.0.78
DaltonST is offline   Reply With Quote