Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 02-15-2011, 03:11 AM   #1
cybmole
Wizard
cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.
 
Posts: 2,967
Karma: 1280000
Join Date: Sep 2010
Device: Kobo aura HD, Kobo Arc, Kindle Fire HDX 8.9 , Kindle for PC
metadata download - overwrite vs add to...

a metadata search / download will overwrite most things - author, title, cover... but it adds to summary text rather than overwrites.

so it's easy to get long summaries with duplicate text. would it not be more logical to overwrite this data

e.g. I download metadata, decide I don't really care for the cover, or the summary, so I delete ISBN, and download again, this time choosing a different match from the screen of matches. ... summary gets added to....

I'm not a fan of tags & social data so dunno if they overwrite or accumulate.

it also seems possible to add metadata to 1st page of book twice, as the book progresses through various conversions., I have seen it several times, though I cannot as yet define the process which causes it to happen.
cybmole is offline   Reply With Quote
Old 02-15-2011, 03:30 AM   #2
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 8,888
Karma: 12755553
Join Date: Feb 2009
Location: North Carolina
Device: Nexus 7
Quote:
Originally Posted by cybmole View Post
it also seems possible to add metadata to 1st page of book twice, as the book progresses through various conversions., I have seen it several times, though I cannot as yet define the process which causes it to happen.
This happens when doing a mobi to mobi conversion. If you already have a Book Jacket and leave the option to insert metadata then a second book Jacket will be inserted. Apparently the book jacket is inserted into the existing html in a mobi book.

This doesn't happen in ePubs because the book jacket is a separate html inside the epub and replaced each time a conversion is run.
DoctorOhh is offline   Reply With Quote
 
Advertisement
Old 02-15-2011, 03:48 AM   #3
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,230
Karma: 1345754
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Quote:
Originally Posted by cybmole View Post
a metadata search / download will overwrite most things - author, title, cover... but it adds to summary text rather than overwrites.

so it's easy to get long summaries with duplicate text. would it not be more logical to overwrite this data

e.g. I download metadata, decide I don't really care for the cover, or the summary, so I delete ISBN, and download again, this time choosing a different match from the screen of matches. ... summary gets added to....
I've had this debate with Starson17 in the past on a ticket in the bug tracker. I think he may have made a few minor tweaks to it but basically we had problems reliably replicating the "exact doubling up". Though like you I had records which showed the same result of that. In some cases I found the duplicates were not quite exact - it is possible that I had added a missing space to end of a sentence, but then downloading again says "you are not exact" and doubles up...

I'm in your camp - I don't want summaries "appended" to under any circumstance. However the existing behaviour is to append if the comments differ in any way. The justification given that people may want additional reviews. I think when Kovid's new metadata download stuff comes in as a user the intent is to have more control over what gets overwritten etc.

In the meantime I just patched my local source code so it never overwrites if I have an existing value
Quote:
I'm not a fan of tags & social data so dunno if they overwrite or accumulate.
Tags accumulate. Everything else overwrites if it has a value from memory like series, rating etc. Some of this you can turn off if you don't want it at all in the configuration for the metadata download plugins. Personally I again "tweaked" the source code, such that it only puts in values if I don't have them and never appends.

Last edited by kiwidude; 02-15-2011 at 04:05 AM.
kiwidude is offline   Reply With Quote
Old 02-15-2011, 04:32 AM   #4
cybmole
Wizard
cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.
 
Posts: 2,967
Karma: 1280000
Join Date: Sep 2010
Device: Kobo aura HD, Kobo Arc, Kindle Fire HDX 8.9 , Kindle for PC
Quote:
Originally Posted by dwanthny View Post
This happens when doing a mobi to mobi conversion. If you already have a Book Jacket and leave the option to insert metadata then a second book Jacket will be inserted. Apparently the book jacket is inserted into the existing html in a mobi book.

This doesn't happen in ePubs because the book jacket is a separate html inside the epub and replaced each time a conversion is run.
yes, that could explain what I have been seeing , assuming it also happens with epub to mobi conversions ( I do not usually have any reason for doing mobi to mobi but I do a lot of epub to mobi

- is that a bug or a feature ?

it would be nice, someday to be able to set conversion prefs by type, so my default for epub output could be add metadata, & my default for mobi output could be do not add...
cybmole is offline   Reply With Quote
Old 02-15-2011, 04:49 AM   #5
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 8,888
Karma: 12755553
Join Date: Feb 2009
Location: North Carolina
Device: Nexus 7
Quote:
Originally Posted by cybmole View Post
yes, that could explain what I have been seeing , assuming it also happens with epub to mobi conversions ( I do not usually have any reason for doing mobi to mobi but I do a lot of epub to mobi
If the ePub had the metadata page inserted prior to conversion to mobi and you added another I guess it might double up.

Quote:
Originally Posted by cybmole View Post
is that a bug or a feature ?
Yes, it is part of an expanding set of features that might bug some folks who don't pay attention.

Before calibre 0.6.50 ePub to ePub conversions would end up with duplicate book jackets too. Any book that the metadata page was inserted after that version can now be converted again without the book jacket being duplicated. In epubs it is easy enough to identify and replace but in a Mobi book jacket isn't its own separate html, thus you have to be more careful in the settings when converting books where the book jacket is already inserted.

Quote:
Originally Posted by cybmole View Post
it would be nice, someday to be able to set conversion prefs by type, so my default for epub output could be add metadata, & my default for mobi output could be do not add...
That idea definitely has merit.
DoctorOhh is offline   Reply With Quote
Old 02-15-2011, 11:07 AM   #6
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by kiwidude View Post
I've had this debate with Starson17 in the past on a ticket in the bug tracker. I think he may have made a few minor tweaks to it but basically we had problems reliably replicating the "exact doubling up".
Yes - although we were talking about record merging as well as metadata fetching. I added the "don't overwrite author/title" option for metadata fetching, but finer control over metadata fetching overwrite is on the ToDo list IIRC.

Quote:
I'm in your camp - I don't want summaries "appended" to under any circumstance.
I'm in the other camp. I use summaries for searching. I want them full of stuff to be found in searching, and often add several summaries from different records and different online metadata databases specifically to get more info in them.
Starson17 is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Can i add a metadata source? freytjepreitje Calibre 6 01-13-2013 07:35 AM
How to add metadata in HTML to have it included when converting to EPUB? richieadler Conversion 2 02-05-2011 11:20 AM
[?] Add downloaded tags not overwrite existing? random43743 Calibre 7 01-11-2011 01:34 AM
add more sites to download news VICTORSJG Calibre 1 01-10-2010 03:29 PM
Can I add a cover in multiple metadata edit? Sassyinkpen Calibre 1 09-23-2009 12:55 AM


All times are GMT -4. The time now is 11:44 PM.


MobileRead.com is a privately owned, operated and funded community.