Calibre for scientific publications or other documents? - Page 2

BetterRed · 06-19-2016, 08:25 PM

@excaliber - the XMP code is put there by the built in calibre Embed Metadata tool - you probably need to add the tool to a toolbar or assign it a shortcut (I have it as ctrl+e). I don't know if it gets injected into the PDF when it's exported - probably.

When you edit metadata in calibre it is written to the database but it is NOT written to the library format files - PDF, EPUB etc. A significant number of calibre users prefer to leave the library format files in their original state.

It is written into exported format files that are sent, saved or mailed. In the past the 'normal' way to get the current metadata into a library format file was to do a like-to-like conversion; but the Embed Metadata (introduced a year or two ago) tool is faster and safer, particularly for PDF's.

This ==>> PDF-XChange Viewer, AFAIK it doesn't run native on Linux, it might under Wine.

BR

excaliber · 06-20-2016, 08:37 AM

@BetterRed: OK, I have found Embed Metadata tool and it works great! I can see the basic metadata as well as all extra metadata from Calibre.
I know "PDF-XChange Viewer", I use it on Windows.

If I am not wrong Zotero fetches metadata from google scholar. If there was a functioning plugin for fetching metadata from google scholar or other site then we could enter all this kind of docs directly into Calibre. As I mentioned before there is actually such a plugin but at least for me it doesn't work. When I click at "Configure selected source" I get errors like these:

calibre 2.59 embedded-python: True is64bit: True
Linux-4.4.0-22-generic-x86_64-with-debian-jessie-sid Linux ('64bit', 'ELF')
('Linux', '4.4.0-22-generic', '#40~14.04.1-Ubuntu SMP Fri May 13 17:27:45 UTC 2016')
Python 2.7.9
Linux: ('debian', 'jessie/sid', '')
Successfully initialized third party plugins: Clean Metadata && Count Pages && Author Book Count && Reading List && View Manager && Search The Internet && Generate Cover && Find Duplicates && Drop Search Results && Get PDF Metadata && Import List && BOL_DE && Walk Search History && Get DJVU Metadata && Google Scholar && Diaps Editing Toolbag && MultiColumnSearch && Save To Format && Author Book Count Hierarchy && Favourites Menu && Annotations && Extract ISBN && User Category && Open With && Goodreads && English Noun Frequency && Recoll Full Text Search && Wiki Reader && Job Spy && Quality Check && Quick Preferences && Consolidate All Library Metadata && Manage Series && Library Codes && Astro-ph
Traceback (most recent call last):
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 329, in configure_plugin
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 334, in do_config
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 274, in __init__
File "calibre_plugins.googlescholar_metadata.__init __", line 35, in config_widget
File "site-packages/calibre/customize/zipplugin.py", line 179, in load_module
File "calibre_plugins.googlescholar_metadata.config ", line 10, in <module>
ImportError: No module named PyQt4

calibre, version 2.59.0
ERROR: Unhandled exception: <b>ImportError</b>:cannot import name ConfigWidget
calibre 2.59 embedded-python: True is64bit: True
Linux-4.4.0-22-generic-x86_64-with-debian-jessie-sid Linux ('64bit', 'ELF')
('Linux', '4.4.0-22-generic', '#40~14.04.1-Ubuntu SMP Fri May 13 17:27:45 UTC 2016')
Python 2.7.9
Linux: ('debian', 'jessie/sid', '')
Successfully initialized third party plugins: Clean Metadata && Count Pages && Author Book Count && Reading List && View Manager && Search The Internet && Generate Cover && Find Duplicates && Drop Search Results && Get PDF Metadata && Import List && BOL_DE && Walk Search History && Get DJVU Metadata && Google Scholar && Diaps Editing Toolbag && MultiColumnSearch && Save To Format && Author Book Count Hierarchy && Favourites Menu && Annotations && Extract ISBN && User Category && Open With && Goodreads && English Noun Frequency && Recoll Full Text Search && Wiki Reader && Job Spy && Quality Check && Quick Preferences && Consolidate All Library Metadata && Manage Series && Library Codes && Astro-ph
Traceback (most recent call last):
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 329, in configure_plugin
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 334, in do_config
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 274, in __init__
File "calibre_plugins.googlescholar_metadata.__init __", line 35, in config_widget
ImportError: cannot import name ConfigWidget

I have already installed python-qt4 on my machine. I don't know why the plugin complains. Maybe a developer could look into it.

DaltonST · 06-20-2016, 09:10 AM

@excaliber:

I am progressing with the new Zotero Metadata Importer plug-in, but I need some more real data to use to test with. Could you email me a new .csv file that contains the data for ~10 .pdf files, plus also those same .pdf files? Taken together, they should be broadly representative of most of your .pdf files in your Zotero.

Thanks.

DaltonST

davidfor · 06-20-2016, 09:28 AM

Quote:

Originally Posted by excaliber

@BetterRed: OK, I have found Embed Metadata tool and it works great! I can see the basic metadata as well as all extra metadata from Calibre.
I know "PDF-XChange Viewer", I use it on Windows.

If I am not wrong Zotero fetches metadata from google scholar. If there was a functioning plugin for fetching metadata from google scholar or other site then we could enter all this kind of docs directly into Calibre. As I mentioned before there is actually such a plugin but at least for me it doesn't work. When I click at "Configure selected source" I get errors like these:

calibre 2.59 embedded-python: True is64bit: True
Linux-4.4.0-22-generic-x86_64-with-debian-jessie-sid Linux ('64bit', 'ELF')
('Linux', '4.4.0-22-generic', '#40~14.04.1-Ubuntu SMP Fri May 13 17:27:45 UTC 2016')
Python 2.7.9
Linux: ('debian', 'jessie/sid', '')
Successfully initialized third party plugins: Clean Metadata && Count Pages && Author Book Count && Reading List && View Manager && Search The Internet && Generate Cover && Find Duplicates && Drop Search Results && Get PDF Metadata && Import List && BOL_DE && Walk Search History && Get DJVU Metadata && Google Scholar && Diaps Editing Toolbag && MultiColumnSearch && Save To Format && Author Book Count Hierarchy && Favourites Menu && Annotations && Extract ISBN && User Category && Open With && Goodreads && English Noun Frequency && Recoll Full Text Search && Wiki Reader && Job Spy && Quality Check && Quick Preferences && Consolidate All Library Metadata && Manage Series && Library Codes && Astro-ph
Traceback (most recent call last):
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 329, in configure_plugin
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 334, in do_config
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 274, in __init__
File "calibre_plugins.googlescholar_metadata.__init __", line 35, in config_widget
File "site-packages/calibre/customize/zipplugin.py", line 179, in load_module
File "calibre_plugins.googlescholar_metadata.config ", line 10, in <module>
ImportError: No module named PyQt4

calibre, version 2.59.0
ERROR: Unhandled exception: <b>ImportError</b>:cannot import name ConfigWidget
calibre 2.59 embedded-python: True is64bit: True
Linux-4.4.0-22-generic-x86_64-with-debian-jessie-sid Linux ('64bit', 'ELF')
('Linux', '4.4.0-22-generic', '#40~14.04.1-Ubuntu SMP Fri May 13 17:27:45 UTC 2016')
Python 2.7.9
Linux: ('debian', 'jessie/sid', '')
Successfully initialized third party plugins: Clean Metadata && Count Pages && Author Book Count && Reading List && View Manager && Search The Internet && Generate Cover && Find Duplicates && Drop Search Results && Get PDF Metadata && Import List && BOL_DE && Walk Search History && Get DJVU Metadata && Google Scholar && Diaps Editing Toolbag && MultiColumnSearch && Save To Format && Author Book Count Hierarchy && Favourites Menu && Annotations && Extract ISBN && User Category && Open With && Goodreads && English Noun Frequency && Recoll Full Text Search && Wiki Reader && Job Spy && Quality Check && Quick Preferences && Consolidate All Library Metadata && Manage Series && Library Codes && Astro-ph
Traceback (most recent call last):
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 329, in configure_plugin
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 334, in do_config
File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 274, in __init__
File "calibre_plugins.googlescholar_metadata.__init __", line 35, in config_widget
ImportError: cannot import name ConfigWidget

I have already installed python-qt4 on my machine. I don't know why the plugin complains. Maybe a developer could look into it.

Calibre uses its own Python installation. This includes Qt5. The plugin is old and has not been updated to Qt5. I've had a look at it and fixed this. I have attached this. It works at least to load and do a search. I have no idea if the results it returns are correct or not.

Edit: I should have looked more. The github site for the plugin says the author moved to Zotero, so hasn't continued with the plugin. I doubt if the version posted works and I have no interest in working on it. But, I'll leave it here in case someone is interested.

excaliber · 06-20-2016, 12:23 PM

@davidfor: thanks for your fast reaction! I have tested your updated version of "google scholar" plugin and it works! The downside with it is that I have to enter manually at least a part of the title and and a part of the author so it can fetch metadata. With Zotero and Docear one can drag'n'drop files and with a click of a button all relevant metadata will be fetched for them. Although the success rate in my case was 30%-40% (files with correct metadata). Apart from that, Zotero was able to fetch more metadata than Calibre and Docear.

davidfor · 06-20-2016, 07:55 PM

Glad it is at least partly working. From my quick glance at the code, it is incomplete. I don't think it gets all the metadata and it is missing some of the integration with calibre. Someone might be interested in completing it. But, the big thing is how the actual data sources compare. If Google Scholar doesn't have the metadata, then the plugin cannot retrieve it. If the others are better sources, then they would be better to use.

For the drag'n'drop, you should be able to drop the book in the calibre library. If it already has the basic details such as title and author, then you shouldn't need to type anything.

DaltonST · 06-21-2016, 11:08 AM

Refer to: https://www.mobileread.com/forums/sho...d.php?t=275476

06-19-2016, 08:25 PM	#16
BetterRed null operator (he/him) Posts: 20,570 Karma: 26954694 Join Date: Mar 2012 Location: Sydney Australia Device: none	@excaliber - the XMP code is put there by the built in calibre Embed Metadata tool - you probably need to add the tool to a toolbar or assign it a shortcut (I have it as ctrl+e). I don't know if it gets injected into the PDF when it's exported - probably. When you edit metadata in calibre it is written to the database but it is NOT written to the library format files - PDF, EPUB etc. A significant number of calibre users prefer to leave the library format files in their original state. It is written into exported format files that are sent, saved or mailed. In the past the 'normal' way to get the current metadata into a library format file was to do a like-to-like conversion; but the Embed Metadata (introduced a year or two ago) tool is faster and safer, particularly for PDF's. This ==>> PDF-XChange Viewer, AFAIK it doesn't run native on Linux, it might under Wine. BR Last edited by BetterRed; 06-19-2016 at 08:36 PM.

06-20-2016, 09:10 AM	#18
DaltonST Deviser Posts: 2,265 Karma: 2090983 Join Date: Aug 2013 Location: Texas Device: none	Zotero Metadata Importer plug-in @excaliber: I am progressing with the new Zotero Metadata Importer plug-in, but I need some more real data to use to test with. Could you email me a new .csv file that contains the data for ~10 .pdf files, plus also those same .pdf files? Taken together, they should be broadly representative of most of your .pdf files in your Zotero. Thanks. DaltonST

06-21-2016, 11:08 AM	#22
DaltonST Deviser Posts: 2,265 Karma: 2090983 Join Date: Aug 2013 Location: Texas Device: none	Zotero Metadata Importer plug-in Refer to: https://www.mobileread.com/forums/sho...d.php?t=275476 Last edited by DaltonST; 06-22-2016 at 11:15 AM. Reason: ZMI

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
What features would you expect from an e-book reader for scientific publications?	Pismire	General Discussions	40	01-09-2014 10:33 PM
Scientific papers downloadable as epubs - Calibre management?	Rhialto	Calibre	6	10-11-2013 10:47 AM
Linking to documents in the calibre library	rickyhow	Devices	2	04-04-2011 09:50 PM
Emailing Calibre documents	geneaber	Calibre	6	11-16-2009 04:38 AM
Question about editing documents once they are in Calibre	ficbot	Calibre	4	09-10-2009 09:58 PM

06-20-2016, 08:37 AM	#17
excaliber Connoisseur Posts: 59 Karma: 10 Join Date: Nov 2013 Device: Samsung Galaxy Tab 2 10.1 P5110	@BetterRed: OK, I have found Embed Metadata tool and it works great! I can see the basic metadata as well as all extra metadata from Calibre. I know "PDF-XChange Viewer", I use it on Windows. If I am not wrong Zotero fetches metadata from google scholar. If there was a functioning plugin for fetching metadata from google scholar or other site then we could enter all this kind of docs directly into Calibre. As I mentioned before there is actually such a plugin but at least for me it doesn't work. When I click at "Configure selected source" I get errors like these: calibre 2.59 embedded-python: True is64bit: True Linux-4.4.0-22-generic-x86_64-with-debian-jessie-sid Linux ('64bit', 'ELF') ('Linux', '4.4.0-22-generic', '#40~14.04.1-Ubuntu SMP Fri May 13 17:27:45 UTC 2016') Python 2.7.9 Linux: ('debian', 'jessie/sid', '') Successfully initialized third party plugins: Clean Metadata && Count Pages && Author Book Count && Reading List && View Manager && Search The Internet && Generate Cover && Find Duplicates && Drop Search Results && Get PDF Metadata && Import List && BOL_DE && Walk Search History && Get DJVU Metadata && Google Scholar && Diaps Editing Toolbag && MultiColumnSearch && Save To Format && Author Book Count Hierarchy && Favourites Menu && Annotations && Extract ISBN && User Category && Open With && Goodreads && English Noun Frequency && Recoll Full Text Search && Wiki Reader && Job Spy && Quality Check && Quick Preferences && Consolidate All Library Metadata && Manage Series && Library Codes && Astro-ph Traceback (most recent call last): File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 329, in configure_plugin File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 334, in do_config File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 274, in __init__ File "calibre_plugins.googlescholar_metadata.__init __", line 35, in config_widget File "site-packages/calibre/customize/zipplugin.py", line 179, in load_module File "calibre_plugins.googlescholar_metadata.config ", line 10, in <module> ImportError: No module named PyQt4 calibre, version 2.59.0 ERROR: Unhandled exception: <b>ImportError</b>:cannot import name ConfigWidget calibre 2.59 embedded-python: True is64bit: True Linux-4.4.0-22-generic-x86_64-with-debian-jessie-sid Linux ('64bit', 'ELF') ('Linux', '4.4.0-22-generic', '#40~14.04.1-Ubuntu SMP Fri May 13 17:27:45 UTC 2016') Python 2.7.9 Linux: ('debian', 'jessie/sid', '') Successfully initialized third party plugins: Clean Metadata && Count Pages && Author Book Count && Reading List && View Manager && Search The Internet && Generate Cover && Find Duplicates && Drop Search Results && Get PDF Metadata && Import List && BOL_DE && Walk Search History && Get DJVU Metadata && Google Scholar && Diaps Editing Toolbag && MultiColumnSearch && Save To Format && Author Book Count Hierarchy && Favourites Menu && Annotations && Extract ISBN && User Category && Open With && Goodreads && English Noun Frequency && Recoll Full Text Search && Wiki Reader && Job Spy && Quality Check && Quick Preferences && Consolidate All Library Metadata && Manage Series && Library Codes && Astro-ph Traceback (most recent call last): File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 329, in configure_plugin File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 334, in do_config File "site-packages/calibre/gui2/preferences/metadata_sources.py", line 274, in __init__ File "calibre_plugins.googlescholar_metadata.__init __", line 35, in config_widget ImportError: cannot import name ConfigWidget I have already installed python-qt4 on my machine. I don't know why the plugin complains. Maybe a developer could look into it.

06-20-2016, 12:23 PM	#20
excaliber Connoisseur Posts: 59 Karma: 10 Join Date: Nov 2013 Device: Samsung Galaxy Tab 2 10.1 P5110	@davidfor: thanks for your fast reaction! I have tested your updated version of "google scholar" plugin and it works! The downside with it is that I have to enter manually at least a part of the title and and a part of the author so it can fetch metadata. With Zotero and Docear one can drag'n'drop files and with a click of a button all relevant metadata will be fetched for them. Although the success rate in my case was 30%-40% (files with correct metadata). Apart from that, Zotero was able to fetch more metadata than Calibre and Docear.

06-20-2016, 07:55 PM	#21
davidfor Grand Sorcerer Posts: 24,907 Karma: 47303748 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	Glad it is at least partly working. From my quick glance at the code, it is incomplete. I don't think it gets all the metadata and it is missing some of the integration with calibre. Someone might be interested in completing it. But, the big thing is how the actual data sources compare. If Google Scholar doesn't have the metadata, then the plugin cannot retrieve it. If the others are better sources, then they would be better to use. For the drag'n'drop, you should be able to drop the book in the calibre library. If it already has the basic details such as title and author, then you shouldn't need to type anything.