[GUI Plugin] Find Duplicates

[BetterRed]

Originally Posted by taratears

Nope, no hardware. or system issues [. . .]

Must have been one of them hobgoblins.

Originally Posted by taratears

As for the second library, I figured out a way to get done what I needed to. This plugin is brilliant, thank you.

- the man to thank is Kiwidude

BR

[JSWolf]

Did you maybe unmark instead of delete?

[Tanjamuse]

I know Kiwidude is no longer active, but if anyone wants to look at this problem I'll be grateful.

When I search for duplicates in another library using the identifier set as URL it doesn't find anything even though I know there should be multiple duplicates. It says:

calibre, version 3.6.0
Library Duplicates: Found <b>0 books</b> with potential duplicates using <b>matching 'url' identifier</b> against the library ...

Can anyone help?

[NeveraN]

Thank You. It is great. I have some question, is it possible to use binary comparison by adding books to Calibre ?

Thanks

[Nevera]

Is there some posibility to use binary compare for adding books to avoid to add duplicity ?

Thanks for answer

[JSWolf]

Originally Posted by Nevera

Is there some posibility to use binary compare for adding books to avoid to add duplicity ?

Thanks for answer

You cannot check for a binary duplicate on adding books to the library. You have to run the plugin after you've added the books.

[HMonk]

Installed Dupe Finder plug-in from within Calibre "Get new plug-ins." Installation successful, restart, plug-in is listed as enabled in plug-in repository, and drop-down menu appears in Calibre main menu. However, about five seconds after Calibre starts, the main Calibre menu clears and repopulates without the find duplicate drop-down menu. The same thing happens if I install the plug-in from the ZIP file.

I attempted to active the plug-in by creating a hot-key shortcut - didn't work. AV
program is Comodo Suite but Comodo is not blocking the plug-in or its installation.

So, the question is: if the plug-in is reported as enabled and its drop-down menu appears in Calibre's main menu, what causes the main menu to repopulate without the dupe finder drop-down-menu? The debug report follows:

******************
calibre Debug log
calibre 3.7 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.15063-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.15063')
Python 2.7.12+
Windows: ('10', '10.0.15063', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: DeDRM (6, 3, 4) && Find Duplicates (1, 6, 3)
calibre 3.7 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.15063-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.15063')
Python 2.7.12+
Windows: ('10', '10.0.15063', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: DeDRM (6, 3, 4) && Find Duplicates (1, 6, 3)
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 87.0857142857 x 83.34375
Using calibre Qt style: True
Starting up...
Failed to get storage number for drive: A with error: [Error 1] Incorrect function.
Storage number map:
{(7L, 0L): [(1L, 'L')],
(7L, 1L): [(1L, 'O'), (2L, 'C')],
(7L, 2L): [(1L, 'E'), (2L, 'I')],
(7L, 3L): [(1L, 'M')],
(7L, 4L): [(1L, 'D'), (2L, 'K'), (3L, 'G')],
(7L, 5L): [(1L, 'F')],
(7L, 6L): [(1L, 'R')],
(7L, 8L): [(1L, 'N')]}
Storage number for USBSTOR\DISK&VEN_KINDLE&PROD_INTERNAL_STORAGE&REV_ 0100\B006D0B113441D1R&0: StorageDeviceNumber(type=7L, number=8L, partition_number=0L)
Drive letters for USBDevice(vendor_id=0x1949 product_id=0x4 bcd=0x100 devid=usb\vid_1949&pid_0004&rev_0100 devinst=6)
{u'drive_letters': ['N'],
u'pnp_id_map': {'N': u'\\\\?\\usbstor#disk&ven_kindle&prod_internal_sto rage&rev_0100#b006d0b113441d1r&0#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}'},
u'readonly_drives': set([]),
u'sort_map': {'N': (8L, 1L)}}
Started up in 7.30 seconds with 1618 books
Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
DeviceJob: 1 Get device information callback returned
Job: 2 Set library information started
DeviceJob: 2 Set library information done, calling callback
DeviceJob: 2 Set library information callback returned
Job: 3 Get list of books on device started
DEBUG: 0.0 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= None
DEBUG: 0.0 USBMS: dirs are: N:\ documents
DEBUG: 0.3 USBMS: scan from root False N:\documents
DEBUG: 0.4 USBMS: count found in cache: 461, count of files in metadata: 461, need_sync: False
DEBUG: 0.4 USBMS: Finished fetching list of books from device. oncard= None
DEBUG: 0.4 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= carda
DEBUG: 0.4 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= cardb
DeviceJob: 3 Get list of books on device done, calling callback
DeviceJob: metadata_downloaded: Starting set_books_in_library
DeviceJob: set_books_in_library: books to process= 461
Job: 1 Get device information finished
No details available.
Job: 3 Get list of books on device finished
No details available.
Job: 2 Set library information finished
No details available.
DeviceJob: set_books_in_library finished: time= 0.0510001182556
DeviceJob: metadata_downloaded: updating views
DeviceJob: metadata_downloaded: syncing
DeviceJob: metadata_downloaded: refreshing ondevice
DeviceJob: metadata_downloaded: sending metadata_available signal
DeviceJob: 3 Get list of books on device callback returned
Job: 3 Get list of books on device finished
No details available.

Any suggestions would be appreciated.

Monk

.

[BetterRed]

@HMonk - You have connected a device, when you do that calibre uses the The main toolbar when a device is connected toolbar. If you want this PI to be available in that toolbar you may need to add it to that toolbar via Preferences->Toolbars.

BR

[HMonk]

@BetterRed

Your advice was spot on! I DL all my Kindle eBooks to my Kindle Keyboard (so much easier working with its "documents" directory) and then import them to Calibre, benefited by Alf's tools. When I installed the Find Duplicates plug-in, the Keyboard was still connected to my PC.

After reading your advice, I restarted Calibre without the Keyboard connected and voilà, the Find Duplicates drop-down menu was present - and the Calibre menu did not repopulate.

Thanks for your help and speedy reply.

Monk

[Rellwood]

An idea...

Being able to use the id (I can't remember the name, but is the long one that shows up when in debug mode) to check for duplicates.

Being able to use other custom columns instead of just tags to look for variations.

[jony08]

Please make it possible to translate Find Duplicates.

[jony08]

I have duplicates but some have better metadata than others. Could it be possible to search for binary duplicates and remove the one that e.g. is missing a cover? It would save me a lot of time.

[theducks]

Originally Posted by jony08

I have duplicates but some have better metadata than others. Could it be possible to search for binary duplicates and remove the one that e.g. is missing a cover? It would save me a lot of time.

Use the Quality check plugin to find books without covers, bulk add a tag
no run find dups, which will mark (the push pin) dups
then filter with

marked:true and tags:,your no cover tag

those would be your candidates to delete

[compurandom]

When I find dups, I usually merge them. Then I don't have to figure out which one to keep, as long as author and title metadata looks ok.

[jony08]

@theducks Thanks!

Originally Posted by compurandom

When I find dups, I usually merge them. Then I don't have to figure out which one to keep, as long as author and title metadata looks ok.

Is it possible to merge them automatically with Find Duplicates? That would be great!