Reconversion: multiplying metadata?

saxondawg · 01-28-2012, 10:33 PM

At times I have reconverted some or all of my books, for various reasons (such as improvements in the program). Recently, with a new Kindle Fire, I discovered that I needed to go through and re-convert, taking out a certain pdoc code, so that the Fire would place my personal books in the books section rather than docs. (I'm persnickety about things like that, going to "Books" to find all my books.)

I've now noticed that a great number of my books have the metadata three times at the beginning of the book, one occurrence after the other. Now, if this is my biggest problem, I should be counting my blessings. But persnickety people rarely count blessings. They persnicket.

So I can actually live with this, but for one thing, I'm surprised this happened because it does suggest that when the books were reconverted, they didn't work from the original source file (very often an .epub with me). If they had, they wouldn't have re-added the metadata, right? Maybe I have this wrong, but that's my logic. I would think that in reconversion, the metadata should not be added on top of the OLD metadata.

First, does anyone know why this might have happened? Second, is there some non-nightmarish way to run a macro or simple plug-in that will check each file and make sure there is only one metadata file, eliminating dupes?

Again--it's a small thing, and I can live with it as is. But you know us perfectionists. I can't really go through a 1,000-book collection and individually re-edit all these files, so I'm stuck with multiple metas unless someone knows a batch way to fix it

kovidgoyal · 01-28-2012, 10:59 PM

When you reconvert a mobi file, metadata is multiplied. There is no way to identify and replace metadata from a MOBI file. Simple delete all the MOBI format from all books that also have epub, (formats:mobi and formats:epub in the sarch bar) then run the conversion.

saxondawg · 01-29-2012, 07:03 PM

Thanks, Kovid. I would have assumed that a reconvert would have worked from the source file (epub or whatever). I guess the converted calibre book will be considered the source file, once it exists. Well, as I said, it's not a big deal.

CWatkinsNash · 01-29-2012, 07:09 PM

Quote:

Originally Posted by saxondawg

Thanks, Kovid. I would have assumed that a reconvert would have worked from the source file (epub or whatever). I guess the converted calibre book will be considered the source file, once it exists. Well, as I said, it's not a big deal.

In the conversion window, there's an "input" dropdown with different formats in the upper left. You can select whichever you like, as long as that format exists for the book.

Edited to add: Actually, that drop-down only shows the available formats, so that simplifies things. (There's another feature that shows all that I confused it with for a moment.) So if you still have the original epub format in the book record, you can select that one for the conversion.

saxondawg · 01-29-2012, 11:24 PM

That's extremely helpful, CWatkins. I hadn't thought to actually check the conversion window for some reason. Of course Calibre does save the original source file, and I do, too. When I reconvert, I will make it a point to select the desired source file.

CWatkinsNash · 01-29-2012, 11:36 PM

Quote:

Originally Posted by saxondawg

That's extremely helpful, CWatkins. I hadn't thought to actually check the conversion window for some reason. Of course Calibre does save the original source file, and I do, too. When I reconvert, I will make it a point to select the desired source file.

You're welcome!

saxondawg · 01-29-2012, 11:52 PM

UPDATE: Just for anyone still listening--I don't want to give out bad info. Calibre does indeed use the original source file. There is the option to use whatever ones are available, but the default seem to be the original.

I checked the input option in the conversion dialogue on several files, and saw that when an epub was the source, or, say, a .zip--that was the default for a new conversion. In my case, myolder books, when reconverted, multiplied those metadata headers, because at some point I lost my old Calibre library folder (can't even remember why) and reconverted from the file copies I had--all of which were .mobi files, of course. I had forgotten this until I reviewed.

Mark another one up for "user error."

Calibre was doing what was most logical all along. I had simply forgotten I no longer had a lot of my old source files from epub days.

speakingtohe · 01-30-2012, 02:35 AM

I wonder if converting to epub and then converting back to mobi could fix the problem. I don't completely understand the issue so it is probably a silly suggestion, but it never hurts to mention.

Helen

Noughty · 01-31-2012, 05:25 PM

I have the same problem. Mainly because I converted a bunch of books to mobi (even from mobi format) so I would have metadata at the beginning since kindle doesn't show metadata in book details. And I didn't mark the ones I already converted so I converted some multiple times.
I wish there was only one metadata, but I'd rather have too many than no metadata.
Is where a way to know if the format was converted/modified? Is there some log or something like that? A column like "last modified" etc...

speakingtohe · 01-31-2012, 06:20 PM

There is a column called modified but it is affected by other things such as global tag changes.

What worked for me is to have the original format turned on. Then when you convert mobi to mobi the original file extension is renamed to original_mobi.
This file is then used for conversions if you convert again. You can delete it of course, but I don't as calibre also saves the conversion settings. Takes up disk space of course, but I like it.

Helen

Noughty · 01-31-2012, 07:52 PM

Original_mobi usually fails to me. Since I do converts in bulk and you cannot chose mobi format as input in that case. If a book has any other format it chooses that one and original mobi is just replaced. So I lose the original mobi and do not have it in formats field.

speakingtohe · 01-31-2012, 08:31 PM

AFAIK original_mobi is never replaced. You cannot convert to that format. The original mobi file can be replaced

You can choose mobi as your preferred input for conversions and delete saved conversion settings when bulk converting. Then calibre will always choose mobi as its input source, unless an original_mobi file exists. If file does not exist it will then create one.

Of course you may be using an older version of the software or have the tweak turned of, in which case I am probably confusing you.

But I assure you it does work.

Helen

Noughty · 01-31-2012, 09:34 PM

My calibre version isn't old. Could you explain how to make it work? For example I have two books
1 epub, mobi, pdf
2 epub, mobi

I choose them and press c. It doesn't allow to choose the input, only output. So it uses epub for converting and not mobi. mobi file is deleted and new one made in it's place. How to make it create original_mobi?

theducks · 01-31-2012, 10:04 PM

Quote:

Originally Posted by Noughty

My calibre version isn't old. Could you explain how to make it work? For example I have two books
1 epub, mobi, pdf
2 epub, mobi

I choose them and press c. It doesn't allow to choose the input, only output. So it uses epub for converting and not mobi. mobi file is deleted and new one made in it's place. How to make it create original_mobi?

There are preference orders for conversions.
If a conversion has been previously done, bulk uses those settings (implies it uses the original source)
Original_<format> only gets made on the first conversion of the SAME format Mobi-> Mobi, EPUB ->EPUB, from then on Same conversions use Original_xxx to make the new xx If the Tweak "save_original_format = True"

Noughty · 02-01-2012, 10:20 AM

That setting is turned on. I had forgotten,there is an answer here:
https://www.mobileread.com/forums/sho...d.php?t=161135

01-28-2012, 10:33 PM	#1
saxondawg Connoisseur Posts: 65 Karma: 50952 Join Date: Mar 2010 Device: kindle paperwhite	Reconversion: multiplying metadata? At times I have reconverted some or all of my books, for various reasons (such as improvements in the program). Recently, with a new Kindle Fire, I discovered that I needed to go through and re-convert, taking out a certain pdoc code, so that the Fire would place my personal books in the books section rather than docs. (I'm persnickety about things like that, going to "Books" to find all my books.) I've now noticed that a great number of my books have the metadata three times at the beginning of the book, one occurrence after the other. Now, if this is my biggest problem, I should be counting my blessings. But persnickety people rarely count blessings. They persnicket. So I can actually live with this, but for one thing, I'm surprised this happened because it does suggest that when the books were reconverted, they didn't work from the original source file (very often an .epub with me). If they had, they wouldn't have re-added the metadata, right? Maybe I have this wrong, but that's my logic. I would think that in reconversion, the metadata should not be added on top of the OLD metadata. First, does anyone know why this might have happened? Second, is there some non-nightmarish way to run a macro or simple plug-in that will check each file and make sure there is only one metadata file, eliminating dupes? Again--it's a small thing, and I can live with it as is. But you know us perfectionists. I can't really go through a 1,000-book collection and individually re-edit all these files, so I'm stuck with multiple metas unless someone knows a batch way to fix it Last edited by saxondawg; 01-28-2012 at 10:36 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Reconversion File	Sassapphras	Conversion	9	01-05-2012 10:20 PM
Multiplying calendar entries -- a PE thing or an android thing	Tunney	enTourage eDGe	5	10-21-2011 07:27 PM
[Metadata Download Plugin] Goodreads Metadata Deprecated	kiwidude	Plugins	30	04-23-2011 02:10 PM
Metadata and reconversion	apastuszak	Conversion	2	02-17-2011 02:19 PM
Adding metadata page (without reconversion)?	thrawn_aj	Calibre	2	12-19-2010 08:06 AM

01-28-2012, 10:59 PM	#2
kovidgoyal creator of calibre Posts: 45,160 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	When you reconvert a mobi file, metadata is multiplied. There is no way to identify and replace metadata from a MOBI file. Simple delete all the MOBI format from all books that also have epub, (formats:mobi and formats:epub in the sarch bar) then run the conversion.

01-29-2012, 07:03 PM	#3
saxondawg Connoisseur Posts: 65 Karma: 50952 Join Date: Mar 2010 Device: kindle paperwhite	Thanks, Kovid. I would have assumed that a reconvert would have worked from the source file (epub or whatever). I guess the converted calibre book will be considered the source file, once it exists. Well, as I said, it's not a big deal.

01-29-2012, 11:24 PM	#5
saxondawg Connoisseur Posts: 65 Karma: 50952 Join Date: Mar 2010 Device: kindle paperwhite	That's extremely helpful, CWatkins. I hadn't thought to actually check the conversion window for some reason. Of course Calibre does save the original source file, and I do, too. When I reconvert, I will make it a point to select the desired source file.

01-29-2012, 11:52 PM	#7
saxondawg Connoisseur Posts: 65 Karma: 50952 Join Date: Mar 2010 Device: kindle paperwhite	UPDATE: Just for anyone still listening--I don't want to give out bad info. Calibre does indeed use the original source file. There is the option to use whatever ones are available, but the default seem to be the original. I checked the input option in the conversion dialogue on several files, and saw that when an epub was the source, or, say, a .zip--that was the default for a new conversion. In my case, myolder books, when reconverted, multiplied those metadata headers, because at some point I lost my old Calibre library folder (can't even remember why) and reconverted from the file copies I had--all of which were .mobi files, of course. I had forgotten this until I reviewed. Mark another one up for "user error." Calibre was doing what was most logical all along. I had simply forgotten I no longer had a lot of my old source files from epub days.

01-30-2012, 02:35 AM	#8
speakingtohe Wizard Posts: 4,812 Karma: 26912940 Join Date: Apr 2010 Device: sony PRS-T1 and T3, Kobo Mini and Aura HD, Tablet	I wonder if converting to epub and then converting back to mobi could fix the problem. I don't completely understand the issue so it is probably a silly suggestion, but it never hurts to mention. Helen

01-31-2012, 05:25 PM	#9
Noughty Addict Posts: 352 Karma: 103850 Join Date: Apr 2011 Device: Kindle NT	I have the same problem. Mainly because I converted a bunch of books to mobi (even from mobi format) so I would have metadata at the beginning since kindle doesn't show metadata in book details. And I didn't mark the ones I already converted so I converted some multiple times. I wish there was only one metadata, but I'd rather have too many than no metadata. Is where a way to know if the format was converted/modified? Is there some log or something like that? A column like "last modified" etc...

01-31-2012, 06:20 PM	#10
speakingtohe Wizard Posts: 4,812 Karma: 26912940 Join Date: Apr 2010 Device: sony PRS-T1 and T3, Kobo Mini and Aura HD, Tablet	There is a column called modified but it is affected by other things such as global tag changes. What worked for me is to have the original format turned on. Then when you convert mobi to mobi the original file extension is renamed to original_mobi. This file is then used for conversions if you convert again. You can delete it of course, but I don't as calibre also saves the conversion settings. Takes up disk space of course, but I like it. Helen

01-31-2012, 07:52 PM	#11
Noughty Addict Posts: 352 Karma: 103850 Join Date: Apr 2011 Device: Kindle NT	Original_mobi usually fails to me. Since I do converts in bulk and you cannot chose mobi format as input in that case. If a book has any other format it chooses that one and original mobi is just replaced. So I lose the original mobi and do not have it in formats field.

01-31-2012, 08:31 PM	#12
speakingtohe Wizard Posts: 4,812 Karma: 26912940 Join Date: Apr 2010 Device: sony PRS-T1 and T3, Kobo Mini and Aura HD, Tablet	AFAIK original_mobi is never replaced. You cannot convert to that format. The original mobi file can be replaced You can choose mobi as your preferred input for conversions and delete saved conversion settings when bulk converting. Then calibre will always choose mobi as its input source, unless an original_mobi file exists. If file does not exist it will then create one. Of course you may be using an older version of the software or have the tweak turned of, in which case I am probably confusing you. But I assure you it does work. Helen

01-31-2012, 09:34 PM	#13
Noughty Addict Posts: 352 Karma: 103850 Join Date: Apr 2011 Device: Kindle NT	My calibre version isn't old. Could you explain how to make it work? For example I have two books 1 epub, mobi, pdf 2 epub, mobi I choose them and press c. It doesn't allow to choose the input, only output. So it uses epub for converting and not mobi. mobi file is deleted and new one made in it's place. How to make it create original_mobi?

Advert

Advert

02-01-2012, 10:20 AM	#15
Noughty Addict Posts: 352 Karma: 103850 Join Date: Apr 2011 Device: Kindle NT	That setting is turned on. I had forgotten,there is an answer here: https://www.mobileread.com/forums/sho...d.php?t=161135