Duplicates found! - Page 2

kovidgoyal · 02-23-2009, 08:54 PM

Quote:

Originally Posted by ilovejedd

Hmm, true. How about modifying the prompt to include more information?

For example, instead of displaying just the title of the duplicate match, you can show:

Code:

Existing Entries								Pending Additions
Foundation - Isaac Asimov (epub, 53KB)			Foundation - Mercedes Lackey (epub, 68KB)
Macbeth - William Shakespeare (epub, 92KB)			Macbeth (txt, 47KB)

Maybe an option to save the list to a txt/csv file can be added, too?

In principle, sure, but doing that would mean rather a lot of work for me, so unless you submit a patch...

ilovejedd · 02-23-2009, 09:29 PM

I haven't done any programming in a while and I'm not at all familiar with Python but I might give this a try after I finish my little PHP project.

Checked out the source code. Is '/src/calibre/gui2/add.py' the only affected module? At least just for making the warning more verbose? I don't think I can tackle adding a button for txt/csv export. I haven't even set-up a Calibre/Python development environment.

:

kovidgoyal · 02-23-2009, 09:35 PM

You'd need to change add.py and database2.py (databas2.py actually contains the duplicate checking code and you'd have to change it to return more information about duplicates than just the titles).

ilovejedd · 02-23-2009, 10:18 PM

Okay, thanks. The add.py, I could have modified. The database2.py looks a wee bit (or a lot) complicated at the moment.

Xenophon · 02-24-2009, 11:09 AM

ilovejedd's idea is a good one. Being notified of possible matches would be great. Especially since I have a number of books with identical titles -- it's really not so unusual as you think.

Sadly, I'm short on programming time a.t.m., as I have several paper deadlines coming up. If it's not done yet in late spring, perhaps I'll have a look...

Xenophon

Amalthia · 02-24-2009, 01:12 PM

Quote:

Originally Posted by kovidgoyal

I've found the bug, will be fixed in the next release. calibre uses the title to check for duplicates. It does not compare authors, since the case of books having the same title by different authors is rare and you can simply manually add them in that case.

in fan fiction it seems like authors across different fandoms do end up recycling titles....I'm glad the program still allows you to add duplicate titles.

ThePage · 02-24-2009, 09:03 PM

Actually, I currently have as many as 3 books w/same Title & different Authors. I've added -a,b,c by age, since the file names were identical (author not shown).

mdibella · 02-26-2009, 08:57 AM

Would it be a good idea at this point to rethink the way Calibre handles duplicate adds?

At this time, if I add a book which already exists, it is treated as a new book. This was fine when Calibre only handled one type of ebook...but that's not the case now. If I add my Kindle library (most of which are in MOBI format) to Calibre, most of the books are already in Calibre's database, in Sony format. I'm not adding new books, I'm simply adding new files in additional formats. I would hope that Calibre would simply move the new MOBI copies into each existing book's folder.

This adds the question of metadata...how should Calibre handle this situation when the book title matches but the rest of the metadata in the newly added file is different? I would hope/expect that Calibre's metadata would trump anything that's already in the newly added file. Most likely, any differences are simply issues of spelling variations, etc. That's why I am using Calibre in the first place, so I can have one place to store my EBooks that ensures consistent information.

Anyone else have any thoughts on this?

(And Kovid, you really need to start charging for this software. I've sent you money a couple of times already and I'm glad to do so, but really it's not fair for you to have to count on the goodwill of your users to reward your efforts)

itimpi · 02-26-2009, 10:54 AM

Interesting point. Calibre already allows you to add different formats of an existing book via the metadta diloag, so maybe adding it outside that dialog should remain as a new book entry.

mdibella · 02-26-2009, 11:13 AM

Isn't that a one-at-a-time deal, using the metadata dialog? I'm wanting to move all of my Kindle books into Calibre and merge them into the collection I already have.

pilotbob · 02-26-2009, 12:14 PM

Quote:

Originally Posted by mdibella

Isn't that a one-at-a-time deal, using the metadata dialog? I'm wanting to move all of my Kindle books into Calibre and merge them into the collection I already have.

No, you can open the Metadata dialog and add as many formats of the books as you want at any time.

You can also delete various formats for a book if you want.

BOb

pilotbob · 02-26-2009, 12:15 PM

Also, it is possible to add books in bulk this way to. If you have a folder for each book with multiple formats there is an import option that will consider all the files in that folder as 1 book with many formats.

BOb

kovidgoyal · 02-26-2009, 01:11 PM

When you add a new format, the existing metadata in calibre is used in preference to any metadata in the new format. A good idea would be to add an option to to the Add menu that would automatically cause all duplicates to be added to their existing library entries.

Xenophon · 02-26-2009, 01:17 PM

Quote:

Originally Posted by kovidgoyal

When you add a new format, the existing metadata in calibre is used in preference to any metadata in the new format. A good idea would be to add an option to to the Add menu that would automatically cause all duplicates to be added to their existing library entries.

Even better would be to present me with a dialog listing the duplicates with a set of check-boxes for each. I'd like the options:

Add to existing entry
Add as new book

at least. But with a dialog w/ check-boxes I could decide on a per-book basis, all at once, and then have Calibre do whatever I told it.

Xenophon

kovidgoyal · 02-26-2009, 01:33 PM

Quote:

Originally Posted by Xenophon

Even better would be to present me with a dialog listing the duplicates with a set of check-boxes for each. I'd like the options:

Add to existing entry
Add as new book

at least. But with a dialog w/ check-boxes I could decide on a per-book basis, all at once, and then have Calibre do whatever I told it.

Xenophon

A better idea!

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Possible Bug on Duplicates	Giuseppe Chillem	Calibre	3	05-06-2010 07:26 PM
Duplicates	pauldadams	Calibre	17	05-04-2010 11:57 PM
Duplicates...	jaxx6166	Sony Reader	5	07-09-2009 09:13 PM
duplicates in database	RJA	Calibre	3	06-22-2009 09:06 AM
Cybook not found in linux, found in win XP	fjf	Bookeen	15	01-18-2008 06:57 PM

02-23-2009, 09:29 PM	#17
ilovejedd hopeless n00b Posts: 5,110 Karma: 19597086 Join Date: Jan 2009 Location: in the middle of nowhere Device: PW4, PW3, Libra H2O, iPad 10.5, iPad 11, iPad 12.9	I haven't done any programming in a while and I'm not at all familiar with Python but I might give this a try after I finish my little PHP project. Checked out the source code. Is '/src/calibre/gui2/add.py' the only affected module? At least just for making the warning more verbose? I don't think I can tackle adding a button for txt/csv export. I haven't even set-up a Calibre/Python development environment. :

02-23-2009, 09:35 PM	#18
kovidgoyal creator of calibre Posts: 45,251 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	You'd need to change add.py and database2.py (databas2.py actually contains the duplicate checking code and you'd have to change it to return more information about duplicates than just the titles).

02-23-2009, 10:18 PM	#19
ilovejedd hopeless n00b Posts: 5,110 Karma: 19597086 Join Date: Jan 2009 Location: in the middle of nowhere Device: PW4, PW3, Libra H2O, iPad 10.5, iPad 11, iPad 12.9	Okay, thanks. The add.py, I could have modified. The database2.py looks a wee bit (or a lot) complicated at the moment.

02-24-2009, 11:09 AM	#20
Xenophon curmudgeon Posts: 1,487 Karma: 5748190 Join Date: Jun 2006 Location: Redwood City, CA USA Device: Kobo Aura HD, (ex)nook, (ex)PRS-700, (ex)PRS-500	ilovejedd's idea is a good one. Being notified of possible matches would be great. Especially since I have a number of books with identical titles -- it's really not so unusual as you think. Sadly, I'm short on programming time a.t.m., as I have several paper deadlines coming up. If it's not done yet in late spring, perhaps I'll have a look... Xenophon

02-24-2009, 09:03 PM	#22
ThePage Connoisseur Posts: 76 Karma: 4430 Join Date: Jan 2009 Location: Chicagoland Device: Kindle 4, eBookwise & Literati	Actually, I currently have as many as 3 books w/same Title & different Authors. I've added -a,b,c by age, since the file names were identical (author not shown).

02-26-2009, 08:57 AM	#23
mdibella Groupie Posts: 193 Karma: 1107 Join Date: Oct 2007 Device: Infinite Kindles, Occasional Sony's	Would it be a good idea at this point to rethink the way Calibre handles duplicate adds? At this time, if I add a book which already exists, it is treated as a new book. This was fine when Calibre only handled one type of ebook...but that's not the case now. If I add my Kindle library (most of which are in MOBI format) to Calibre, most of the books are already in Calibre's database, in Sony format. I'm not adding new books, I'm simply adding new files in additional formats. I would hope that Calibre would simply move the new MOBI copies into each existing book's folder. This adds the question of metadata...how should Calibre handle this situation when the book title matches but the rest of the metadata in the newly added file is different? I would hope/expect that Calibre's metadata would trump anything that's already in the newly added file. Most likely, any differences are simply issues of spelling variations, etc. That's why I am using Calibre in the first place, so I can have one place to store my EBooks that ensures consistent information. Anyone else have any thoughts on this? (And Kovid, you really need to start charging for this software. I've sent you money a couple of times already and I'm glad to do so, but really it's not fair for you to have to count on the goodwill of your users to reward your efforts)

02-26-2009, 10:54 AM	#24
itimpi Wizard Posts: 4,553 Karma: 950151 Join Date: Nov 2008 Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)	Interesting point. Calibre already allows you to add different formats of an existing book via the metadta diloag, so maybe adding it outside that dialog should remain as a new book entry.

02-26-2009, 11:13 AM	#25
mdibella Groupie Posts: 193 Karma: 1107 Join Date: Oct 2007 Device: Infinite Kindles, Occasional Sony's	Isn't that a one-at-a-time deal, using the metadata dialog? I'm wanting to move all of my Kindle books into Calibre and merge them into the collection I already have.

02-26-2009, 12:15 PM	#27
pilotbob Grand Sorcerer Posts: 19,832 Karma: 11844413 Join Date: Jan 2007 Location: Tampa, FL USA Device: Kindle Touch	Also, it is possible to add books in bulk this way to. If you have a folder for each book with multiple formats there is an import option that will consider all the files in that folder as 1 book with many formats. BOb

02-26-2009, 01:11 PM	#28
kovidgoyal creator of calibre Posts: 45,251 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	When you add a new format, the existing metadata in calibre is used in preference to any metadata in the new format. A good idea would be to add an option to to the Add menu that would automatically cause all duplicates to be added to their existing library entries.

Advert

Advert