09-09-2012, 08:10 PM | #316 | |
Well trained by Cats
Posts: 29,836
Karma: 54837878
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
Are the the same format or different (and a candidate to be merged)? +IF+ you have the list show all at once (grouped), you can Multi-select (select the first to delete, then hold the Ctrl key and select more) lines, then tap Del |
|
09-09-2012, 08:16 PM | #317 |
Member
Posts: 21
Karma: 10
Join Date: Jul 2011
Device: Sony PRS 650
|
all same format etc but now I have the duplicates marked but I cannot sort them to top...
so now group selecting right now it is book: A A B B C C D D now how do I remove 1 a/b/c/d etc ??? Last edited by BelgarionNL; 09-09-2012 at 09:00 PM. |
Advert | |
|
09-09-2012, 09:06 PM | #318 |
Well trained by Cats
Posts: 29,836
Karma: 54837878
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
|
09-09-2012, 09:12 PM | #319 | |
Well trained by Cats
Posts: 29,836
Karma: 54837878
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
Moderator Notice
Don't start a new thread on this subject. Stay in the same thread and/or request it be moved to another section. I deleted the New one you just started |
|
09-09-2012, 10:07 PM | #320 |
Resident Curmudgeon
Posts: 74,182
Karma: 129333564
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
Can this plugin be made such that it does a CRC compare so we know that the duplicates are the exact same version?
|
Advert | |
|
09-09-2012, 10:38 PM | #321 |
US Navy, Retired
Posts: 9,863
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
|
|
09-10-2012, 03:10 AM | #322 |
Calibre Plugins Developer
Posts: 4,637
Karma: 2162064
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
@BelgarionNL - you said you created the duplicates by moving them from another library. Are these the exact same books, or slight variations (e.g. different formats, different versions of the same epub etc).
If they are binary identical, then you can use the Binary Compare search, and tick the box which automatically removes duplicates. That will remove the book format files, but still leave you with the book rows in calibre. If indeed those rows were created purely from identical copies of the book then one of each of those duplicate pairs will now have no book formats associated with it. So you can do a search for formats:false and then delete those to finish the cleanup operation. The plugin does not automatically do this because there might be metadata on those rows (like a better cover) that you may want to keep by manually merging them. However if the books you merged in are not binary identical, then it is entirely up to you to go through one by one and decide which version of a format you want to keep. There is no tool on the planet that can make that decision for you - only a human eyeballing them can decide which one is of better quality since it is so subjective. |
09-10-2012, 07:35 AM | #323 |
Member
Posts: 21
Karma: 10
Join Date: Jul 2011
Device: Sony PRS 650
|
yes they were 100 procent duplicates! So I did what you said! thx!
still I would prefer to have auto delete then to go through 3000 books... |
09-10-2012, 08:12 AM | #324 |
Calibre Plugins Developer
Posts: 4,637
Karma: 2162064
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
@BelgarionNL - I don't see this plugin won't be changing to cater for such an extremely rare (and silly) thing to do .
I explained above the reasons why the plugin does not auto-delete book records. It would have to compare every single field and custom column of the book record, and compare image contents to be 100% sure that two records are identical, it is such a minor edge case I cannot be bothered trying to write the code for it. Any thing less than that strict, and deleting becomes an arbitrary decision which may result in someone losing their perfect retail ePub copy and being left with some corrupted calibre conversion or whatever. It is not a responsibility I have any intention of taking any possibility of blame for. As I mentioned several times on the original development thread for this plugin I always envisaged there would perhaps be one day a more intelligent "Smart Merge" plugin that would partner this one. So having identified the duplicates, you can use Smart Merge to help figure out how to resolve them and do auto-merging where safe etc. But no-one has written it yet, and it isn't on my todo list in the forseeable future either. By being more intelligent with your workflow of adding books to your library you can minimise the likelihood of duplicates occurring in the first place, and then just periodically scan with this plugin to catch any failures in that process. |
09-14-2012, 01:20 AM | #325 |
Junior Member
Posts: 5
Karma: 10
Join Date: Jul 2012
Device: Kindle Touch
|
@BelgarionNL - I think your issue now is that while Find Duplicates can automatically remove binary duplicate formats, you're left with all the book entries with no book formats (ie. book files) attached. You'd like to delete all those empty book entries because they're duplicates of their matching book entry. If that is your problem, I have a solution.
Add a custom field "format". It's a standard custom field so real easy to add. Choose to display that new field in your book list. Now you can see which books have book formats and which don't (because FindDuplicates nicely removed them for you). Sort by format. Now you can select and delete all the book entries with no formats real simply. |
09-14-2012, 01:28 AM | #326 | |
Junior Member
Posts: 5
Karma: 10
Join Date: Jul 2012
Device: Kindle Touch
|
Quote:
Having this feature is very useful when you have a lot of variable authors and will work through them on several occasions. I can just work through the authors from top each time, not having to remember that I've already thought about some of them and put them aside to fix further down the list. |
|
10-15-2012, 06:26 AM | #327 |
Connoisseur
Posts: 87
Karma: 1234
Join Date: Sep 2012
Device: Onyx Boox M92
|
Dear Sirs,
I have noticed that many e-books files of mine only differ for a very few bytes. Is it possibile to use the plugin so that it finds file binary search in a adjustable fuzzy way? Thanks for the attention. |
10-16-2012, 10:56 PM | #328 |
hopeless n00b
Posts: 5,111
Karma: 19597086
Join Date: Jan 2009
Location: in the middle of nowhere
Device: PW4, PW3, Libra H2O, iPad 10.5, iPad 11, iPad 12.9
|
Assuming you're dealing with epub or similarly compressed files, those few bytes in file size can mean quite a big difference in the actual binary content. For any meaningful comparison to be made, you'd need to decompress/unpack the ebooks which I reckon, would take too much time unless you've got a tiny library.
Last edited by ilovejedd; 10-16-2012 at 10:59 PM. |
10-18-2012, 03:24 AM | #329 |
Connoisseur
Posts: 87
Karma: 1234
Join Date: Sep 2012
Device: Onyx Boox M92
|
thank you for your answer, ilovejedd, but maybe I did not let myself understood. When I wrote "only differ for a very few bytes" I did not mean differences in length, but typical, minimal differences in actual bytes.
However, I ignore the way by which that comparison is performed in the plug in. |
10-20-2012, 04:40 AM | #330 |
Connoisseur
Posts: 87
Karma: 1234
Join Date: Sep 2012
Device: Onyx Boox M92
|
Anyway, changing the duplicate binary comparison algorithm, so that it can also provide some bits of fuzzy logic would be a cool thing.
|
Tags |
cross library duplicates, in library duplicates |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
[GUI Plugin] Quality Check | kiwidude | Plugins | 1184 | 04-17-2024 06:17 PM |
[GUI Plugin] View Manager | kiwidude | Plugins | 414 | 04-13-2024 01:41 PM |
[GUI Plugin] Open With | kiwidude | Plugins | 403 | 04-01-2024 08:39 AM |
[GUI Plugin] Generate Cover | kiwidude | Plugins | 811 | 03-16-2024 11:31 PM |
[GUI Plugin] Plugin Updater **Deprecated** | kiwidude | Plugins | 159 | 06-19-2011 12:27 PM |