Add files is not recognizing duplicates

tarisea · 09-09-2015, 04:28 PM

Hi:

I have a fairly extensive collection of books from Amazon.com. The way I manage them is fairly simple: I open the kindle software and download any new books to my computer (Kindle_Library) . I have a piece of software that runs in the background that automatically copies anything new in my Kindle Library to a separate directory - Kindle_Connect (this keeps me from actually loosing anything that I downloaded with Kindle Unlimited). I then go into Calibre and import all the books in my Kindle_Connect directory. I have Add Books set to automerge duplicate books and ignore duplicate incoming formats.

The problem is that because the file name of a Kindle book looks something like B00P1GQP34.azw it isn't recognizing books as duplicates and adding them all as new books.

Is there something I can do to correct this, it is seriously driving me nuts.

Thanks

tarisea

eschwartz · 09-09-2015, 05:00 PM

Do you have metadata set to be read from the filename rather than the file contents?

Duplicate books should be automerged based on title - author after the book has been analyzed and prepared for adding.

tarisea · 09-09-2015, 05:38 PM

I have "Read metadata from file contents rather than file name" checked. Is that correct?

theducks · 09-09-2015, 08:07 PM

Quote:

Originally Posted by tarisea

I have "Read metadata from file contents rather than file name" checked. Is that correct?

That is usually correct. It does assume

the book was coded with decent metadata.
It may be that the metadata is just enough different that the DUP detector is confused.
Jon Public vs John Q Public ...

eschwartz · 09-09-2015, 08:31 PM

What does the metadata for the two books (original and newly-imported) look like?

tarisea · 09-13-2015, 11:59 AM

Ok so I have figured out the problem. The metadata. If I leave the Amazon metadata which often includes series information in the title then it recognizes the duplicates. so now how do i create a custom column with only the title that strips all of the series info?

eschwartz · 09-13-2015, 12:23 PM

This is why I'd prefer to use K4PC solely to download books into calibre. No need for background sync, just let K4PC download all new books by default (primary device when purchasing), all books will be added to calibre and deleted, they won't be redownloaded so no duplicates.

Find Duplicates PI can help you clean up.

Alternatively, leave the title alone and use a custom column to write the name of the title, use that going forward.
But that is a really awkward workaround for keeping old copies of everything, ever, in your auto-add directory. Also, calibre has to read and import all those files, then delete them again!

WHY????

09-09-2015, 04:28 PM	#1
tarisea Zealot Posts: 114 Karma: 6288 Join Date: Dec 2012 Device: iphone	Add files is not recognizing duplicates Hi: I have a fairly extensive collection of books from Amazon.com. The way I manage them is fairly simple: I open the kindle software and download any new books to my computer (Kindle_Library) . I have a piece of software that runs in the background that automatically copies anything new in my Kindle Library to a separate directory - Kindle_Connect (this keeps me from actually loosing anything that I downloaded with Kindle Unlimited). I then go into Calibre and import all the books in my Kindle_Connect directory. I have Add Books set to automerge duplicate books and ignore duplicate incoming formats. The problem is that because the file name of a Kindle book looks something like B00P1GQP34.azw it isn't recognizing books as duplicates and adding them all as new books. Is there something I can do to correct this, it is seriously driving me nuts. Thanks tarisea Last edited by BetterRed; 09-13-2015 at 04:34 PM. Reason: Change thread title case - All Caps is irritating, please desist

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Calibre removes files when I add new files	coffee792	Library Management	2	03-18-2015 07:18 PM
Duplicates handling with Find Duplicates plugin	erfjr	Calibre	0	03-05-2013 02:52 PM
Calibre duplicates some files when adding, doesn't add others.	feelalittlelove	Library Management	4	09-08-2011 09:12 PM
iLiad stopped recognizing folders and only shows garbled files in internal memory	lorisgirl	iRex	18	05-27-2009 12:12 AM

09-09-2015, 05:00 PM	#2
eschwartz Ex-Helpdesk Junkie Posts: 19,421 Karma: 85400180 Join Date: Nov 2012 Location: The Beaten Path, USA, Roundworld, This Side of Infinity Device: Kindle Touch fw5.3.7 (Wifi only)	Do you have metadata set to be read from the filename rather than the file contents? Duplicate books should be automerged based on title - author after the book has been analyzed and prepared for adding.

09-09-2015, 05:38 PM	#3
tarisea Zealot Posts: 114 Karma: 6288 Join Date: Dec 2012 Device: iphone	I have "Read metadata from file contents rather than file name" checked. Is that correct?

09-09-2015, 08:31 PM	#5
eschwartz Ex-Helpdesk Junkie Posts: 19,421 Karma: 85400180 Join Date: Nov 2012 Location: The Beaten Path, USA, Roundworld, This Side of Infinity Device: Kindle Touch fw5.3.7 (Wifi only)	What does the metadata for the two books (original and newly-imported) look like?

09-13-2015, 11:59 AM	#6
tarisea Zealot Posts: 114 Karma: 6288 Join Date: Dec 2012 Device: iphone	Ok so I have figured out the problem. The metadata. If I leave the Amazon metadata which often includes series information in the title then it recognizes the duplicates. so now how do i create a custom column with only the title that strips all of the series info?

09-13-2015, 12:23 PM	#7
eschwartz Ex-Helpdesk Junkie Posts: 19,421 Karma: 85400180 Join Date: Nov 2012 Location: The Beaten Path, USA, Roundworld, This Side of Infinity Device: Kindle Touch fw5.3.7 (Wifi only)	This is why I'd prefer to use K4PC solely to download books into calibre. No need for background sync, just let K4PC download all new books by default (primary device when purchasing), all books will be added to calibre and deleted, they won't be redownloaded so no duplicates. Find Duplicates PI can help you clean up. Alternatively, leave the title alone and use a custom column to write the name of the title, use that going forward. But that is a really awkward workaround for keeping old copies of everything, ever, in your auto-add directory. Also, calibre has to read and import all those files, then delete them again! WHY????

Advert

Advert