Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Conversion

Notices

Reply
 
Thread Tools Search this Thread
Old 02-21-2014, 01:35 PM   #1
unboggling
Wizard
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,065
Karma: 858115
Join Date: Jan 2011
Device: Kobo Clara, Kindle Paperwhite 10
XMP Metadata in PDF ?

"What's new" for release 1.25 says this:

Quote:
calibre can now read and write XMP metadata from PDF files. This means that all metadata that you can create in calibre, including custom columns, can be stored in the PDF files. It is also useful when importing PDF files created by some academic publishers, that sometimes have good XMP metadata, such as DOI identifiers, tags and so on.
I didn't see any changes in Preferences for PDF input and output. Did I miss something?

If I wanted to put metadata in calibre into PDF files, exactly where and how would I do that?
unboggling is offline   Reply With Quote
Old 02-21-2014, 02:29 PM   #2
eschwartz
Ex-Helpdesk Junkie
eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.
 
eschwartz's Avatar
 
Posts: 19,422
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
I assume like all metadata saving it will happen automatically?

The difference is, now PDF gets that to begin with.

Save to disk or convert it.
eschwartz is offline   Reply With Quote
Advert
Old 02-21-2014, 04:39 PM   #3
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 20,415
Karma: 25894272
Join Date: Mar 2012
Location: Sydney Australia
Device: none
Did a Save to disk - did not add the metadata

Did a PDF to PDF conversion and it did inject the metadata, and I can 'see' it in Acrobat, PDF XChange and Nitro, but they're limited in what they display.

Acrobat & XChange show Comments as un-rendered HTML in Subject, Nitro has nothing there. Subject is a single line of text usually used for something like 'Genre', so I'm not sure about having Comments there.

BR
BetterRed is online now   Reply With Quote
Old 02-21-2014, 07:44 PM   #4
unboggling
Wizard
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,065
Karma: 858115
Join Date: Jan 2011
Device: Kobo Clara, Kindle Paperwhite 10
I also tested PDF save to disk, which didn't add any extra metadata that I could find.

After PDF to PDF conversion, Adobe reader (on OS X) shows unrendered HTML from Comments in Subject, while Skim shows Subject as blank. Neither reader application showed metadata from custom columns. On the 2 PDFs I tested, anyway.

If all that metadata is being stored in the PDF, where is it stored and how does one access it from within the PDF reader, if not in "Properties" or "Get Info"? Or if it wasn't stored in those tested PDFs but could have been, with some arcane technique, what is the arcane technique?

ETA. And does it depend on various security settings of the PDF file?

Last edited by unboggling; 02-21-2014 at 08:18 PM.
unboggling is offline   Reply With Quote
Old 02-21-2014, 08:48 PM   #5
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,744
Karma: 22446736
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
The vast majority of PDF readers dont support XMP metadata, which is why I never bothered adding support for it to calibre for such a long time. If you want to see the metadata, add the PDF file again to calibre.
kovidgoyal is online now   Reply With Quote
Advert
Old 02-21-2014, 09:23 PM   #6
unboggling
Wizard
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,065
Karma: 858115
Join Date: Jan 2011
Device: Kobo Clara, Kindle Paperwhite 10
Quote:
Originally Posted by kovidgoyal View Post
The vast majority of PDF readers dont support XMP metadata, which is why I never bothered adding support for it to calibre for such a long time. If you want to see the metadata, add the PDF file again to calibre.
Oh, thanks. Yeah, I was just learning on Wikipedia what apps support XMP:

http://en.wikipedia.org/wiki/Extensi...adata_Platform

Skim doesn't support XMP. According to Adobe, Adobe Reader does support it, but even so, I found no way to display XMP in Adobe Reader. I let ownership of Acrobat lapse a year or two ago (and won't buy it again just for this). Just installed ExifTool, but I'm not very good with command line applications.

Last edited by unboggling; 02-21-2014 at 09:27 PM.
unboggling is offline   Reply With Quote
Old 02-21-2014, 09:28 PM   #7
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,744
Karma: 22446736
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Indeed, the only reason XMP support was added at this time was that there is now at least one academic publisher (Elsevier) that does produce PDF files with good XMP metadata, thus it made sense to read XMP metadata. And if you read it, then you have to write it as well, otherwise you get bug reports like I changed the metadata but it doesn't show up in the PDF.
kovidgoyal is online now   Reply With Quote
Old 02-21-2014, 10:07 PM   #8
unboggling
Wizard
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,065
Karma: 858115
Join Date: Jan 2011
Device: Kobo Clara, Kindle Paperwhite 10
Quote:
Originally Posted by kovidgoyal View Post
.... If you want to see the metadata, add the PDF file again to calibre.
Tried that with a couple saved out PDF to PDF converted PDFs. Still didn't see any extra metadata (like from custom columns) after adding them back into calibre. The only place in calibre I know of to look for embedded metadata is in Viewer, click the metadata icon, which showed PDF metadata as before the save-out and re-add. Unless I missed something obvious....

Quote:
Originally Posted by kovidgoyal View Post
Indeed, the only reason XMP support was added at this time was that there is now at least one academic publisher (Elsevier) that does produce PDF files with good XMP metadata, thus it made sense to read XMP metadata. And if you read it, then you have to write it as well, otherwise you get bug reports like I changed the metadata but it doesn't show up in the PDF.
Thanks for the explanations. I was just curious. I don't have many PDFs or use them much. But lots of other people do. So I anticipated there'd be questions.
unboggling is offline   Reply With Quote
Old 02-21-2014, 10:14 PM   #9
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,744
Karma: 22446736
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
You sure you dont have the pdf metadata reader/writer plugins disabled? I just tried the following experiment:

1) Import a pdf into calibre
2) Edit the value of a custom
3) Save the pdf to disk
4) Import the saved pdf back into calibre (and allow adding of the duplicate)
5) the newly added duplicate has the edited value from step (2) in the custom column
kovidgoyal is online now   Reply With Quote
Old 02-21-2014, 10:50 PM   #10
unboggling
Wizard
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,065
Karma: 858115
Join Date: Jan 2011
Device: Kobo Clara, Kindle Paperwhite 10
PDF metadata reader and writer plugins are not missing or disabled.

When I do those 5 steps, with "save metadata in OPF file" turned off, the newly added duplicate shows no values in the custom columns that were edited before the save to disk.

With "save metadata in OPF file" turned on, the custom columns of the saved-out re-add are populated correctly. But that's because of the OPF, not the XMP.

Are you saying the saved out PDF has those custom column values XMP embedded, and the new book record's custom columns should be filled automatically with those values during the Add Book creation of that new book record? If that's what's supposed to happen, it is not happening for me, when "save metadata in OPF file" is turned off during the save.

Last edited by unboggling; 02-21-2014 at 11:12 PM.
unboggling is offline   Reply With Quote
Old 02-21-2014, 11:06 PM   #11
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,744
Karma: 22446736
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Yes the custom columns are embedded in the PDF on save. They are read even if no OPF is present. You can look at their definitions by running

pdfinfo -meta file.pdf

(pdfinfo is in the calibre install directory)
kovidgoyal is online now   Reply With Quote
Old 02-21-2014, 11:45 PM   #12
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 20,415
Karma: 25894272
Join Date: Mar 2012
Location: Sydney Australia
Device: none
restructured

Last edited by BetterRed; 02-22-2014 at 12:38 AM.
BetterRed is online now   Reply With Quote
Old 02-21-2014, 11:45 PM   #13
unboggling
Wizard
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,065
Karma: 858115
Join Date: Jan 2011
Device: Kobo Clara, Kindle Paperwhite 10
Eureka. Hooah. Success. I had "read metadata from file contents" turned off for the Add. With it turned on, the custom column metadata embedded in the pdf populates the custom columns. (Without the OPF present during the Add). So that confusion is solved.

This has nothing to do with conversion, just metadata read and write at import or export. So that confusion is solved. (ETA: Though conversion also updates the metadata in the output format.)



But after installing command line tools with 1.25 on OS X:

MacCatlin:frameworks unbogg$ pdfinfo -meta /users/unbogg/books/raw/_working/bazaar.pdf
-bash: pdfinfo: command not found

Like I said, I'm not real good with command line.

Last edited by unboggling; 02-22-2014 at 03:26 AM.
unboggling is offline   Reply With Quote
Old 02-21-2014, 11:49 PM   #14
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,744
Karma: 22446736
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
@unboggling: If you are on OS X pdfinfo will not be installed as a command line tool, you will need to find it inside the calibre application bundle.

@BR: covers are not inserted into PDF and all custom column metadata is inserted using a special namespace so it does not cause problems for any other application.
kovidgoyal is online now   Reply With Quote
Old 02-22-2014, 12:19 AM   #15
unboggling
Wizard
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,065
Karma: 858115
Join Date: Jan 2011
Device: Kobo Clara, Kindle Paperwhite 10
Quote:
Originally Posted by kovidgoyal View Post
@unboggling: If you are on OS X pdfinfo will not be installed as a command line tool, you will need to find it inside the calibre application bundle.
Found it. I think on OS X I'd have to input the pdf file to pdfinfo in a script. But I have no burning need to take the time to do it.

Quote:
Originally Posted by kovidgoyal View Post
@BR: covers are not inserted into PDF and all custom column metadata is inserted using a special namespace so it does not cause problems for any other application.
Some people may not want all their custom column metadata automatically saved willy-nilly into exported PDFs.

Though personally, I wish custom column metadata could be written into other formats besides PDF. Such as EPUB.
unboggling is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Pdf, calibre and metadata. Student1 Calibre 31 06-20-2014 03:47 AM
PDF MetaData dekz Calibre 5 06-10-2010 01:50 PM
metadata and PDF booksonthemove Calibre 6 03-13-2010 09:40 PM
0.5.11 PDF metadata thibaulthalpern Calibre 2 05-09-2009 09:14 AM
pdf and other metadata karl9000 Calibre 1 04-20-2009 02:04 PM


All times are GMT -4. The time now is 11:25 PM.


MobileRead.com is a privately owned, operated and funded community.