First Requestes and POV of a Newcomer

[Starson17]

Originally Posted by Giuseppe Chillem

Calibre crashes during inport. Part of files have been inported. Some of these files have metadata equal to other (I have found some CHM having the same "Generated by Unregistered Version"). If you discard duplicates, you discard false duplicates too. It does actually happen, I have ecnountered this problem just the first time I have used Calibre.

I assume you saw "Generated by Unregistered Version" multiple times when you tried to add. Clearly that's not the actual title of those books, so I conclude you did not have good internal metadata in those files, and did not have "Read metadata only from filenames turned on." I would have told Calibre to not add them, then gone back and reconfigured Calibre to get the metadata from the filename. Presumably the title of the file contains or is the title of the book.

Even with your proposed options, I think it would be a mistake to add any of these books. Note that Calibre is asking you whether you want to add the duplicates or not. Presumably your 3 categories are mutually exclusive, so you have to answer 3 times. Think about how you would answer each question. Would you let it add books entitled "Generated by Unregistered Version" when the hash did not match? Why? You'd have many books with the identical wrong title! Even if they are different books, you'd still have to fix all those wrong titles manually. You'd be better off deleting them all and adding them with the correct setting in Calibre to get the correct title/metadata from the filename.

[kovidgoyal]

Actually, importing large collections is complicated enough that it deserves it's own wizard where you can easily customize the algorithm used to suit your existing collection, instead of scattered settings throughout calibre.

However, I don't have much incentive to write such wizard, as all my books are already imported, still, I'll add it to my TODO list.

[Giuseppe Chillem]

Originally Posted by kovidgoyal

However, I don't have much incentive to write such wizard, as all my books are already imported, still, I'll add it to my TODO list.

Thank you and congratulation for the nice work you have put on Calibre.
As soon as I can I'll make a decent donation.

Giuseppe Chillemi

[DoctorOhh]

Originally Posted by Giuseppe Chillem

However, if you are in the early stage of book importing (for example, merging book collections), and you have not changed metadata, with CRC32 + SIZE you have a 100% hit.

A two round check, the first is CRC32 + SIZE, the second is the actual mechanism. This would give you 3 lists: 1) physical duplicates

I appreciate you wanting to add a physical check to the process of importing. You mentioned Clone Spy, my question is could I accomplish the same thing by running Clone Spy on my library before import?

[Giuseppe Chillem]

Originally Posted by dwanthny

I appreciate you wanting to add a physical check to the process of importing. You mentioned Clone Spy, my question is could I accomplish the same thing by running Clone Spy on my library before import?

Yes, you can !
I have taken a look at the latest version of CSPY. It is declared compatible up to Vista, I have not checked Windows7 so I don't know if the missing OS in intentional or not.

There are 2 way to accomplish the task of removing duplicates:

1) Files your are going to import are checked against themself. 1 "Pool" working.

2) Files you are going to import are checked against your current library or another import set (2 pools working).

There is also the opportunity to save list of files with CRC32 to check imported files against.

Donwload the program and feel free to experiment but remember: never tell the program to delete files in the pool corresponding to your library otherwise you will destroy it !

Here is the link: http://www.clonespy.com/

Giuseppe Chillemi