Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 03-25-2012, 06:54 PM   #226
SassyDragonfly
Junior Member
SassyDragonfly began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Mar 2012
Device: Kindle
Question

Hi kiwidude,
first off - I really like your plugins. Great work. ^^

I have a question about your 'Find duplicates' plugin. Is there a possibility to auto delete all the binary duplicates save one? Just the actual binary duplicates and not the whole book entry?

Cause I have quite a few books, a lot with differnt formats in one entry, but as well duplicates of those.

A lil example:
I have several entries of the same book. Call it 'Book A'. Then there are several formats of said book. And to mix it up a bit more there are differnt versions of those formats (mobi version1 & mobi version2...)

Book A: mobi v1, lit v1, pdf v1
Book A Copy: mobi v1, lit v2, pdf v1
Book A 2nd Copy: epub v1, mobi v2, lit v2, txt v1
and so on

So when I get the results I can't just delete all the mobi formats save one or all the pdf duplicats. I know that one or the other is the exact same file, but I can't see the differnce without opening up every single file when I have a result like the example up there.

If auto delete is not an option, maybe highlighting the formats which are a binary duplicate would be possible?

Book A: mobi v1, lit v1, pdf v1
Book A Copy: mobi v1, lit v2, pdf v1
Book A 2nd Copy: epub v1, mobi v2, lit v2, txt v1

or something along that line?

Ahh - when I already have your attention: Is there somewhere in calibre a 'Back' button? I was really looking for one more then once already

Sassy
SassyDragonfly is offline   Reply With Quote
Old 03-25-2012, 09:10 PM   #227
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 8,737
Karma: 12488297
Join Date: Feb 2009
Location: North Carolina
Device: Nexus 7
Quote:
Originally Posted by SassyDragonfly View Post
Cause I have quite a few books, a lot with differnt formats in one entry, but as well duplicates of those.

A lil example:
I have several entries of the same book. Call it 'Book A'. Then there are several formats of said book. And to mix it up a bit more there are differnt versions of those formats (mobi version1 & mobi version2...)

Book A: mobi v1, lit v1, pdf v1
Book A Copy: mobi v1, lit v2, pdf v1
Book A 2nd Copy: epub v1, mobi v2, lit v2, txt v1
and so on
I don't know about adding this feature to this plugin, but if you have any more books to add to calibre it would be easier to find and automatically delete binary duplicates prior to adding the books to calibre.
DoctorOhh is offline   Reply With Quote
 
Enthusiast
Old 03-26-2012, 05:34 AM   #228
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,223
Karma: 1333994
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@SassyDragonfly - welcome to MobileRead...

Firstly re the "Back" button equivalent - do you mean something specific to this plugin (as in going backwards through the Find Duplicates result groups) or backwards through your search queries in Calibre? If the former then the functionality exists in the plugin and you can assign to a keyboard shortcut. If the latter then take a look at the Walk Search History plugin, which I assign Alt+Left and Alt+Right to go back/fwd through your search queries...

Now for your queries concerning binary duplicate deletion.

Unfortunately there is no way to colour highlight like you suggest exactly which format is in conflict, for a number of reasons I won't bore you with, just trust me! I always anticipated there might one day be a "Smart Merge" UI plugin that could incorporate such functionality but I don't have the time/motivation to write that so it remains vapourware.

So I might be more amenable to a change to this plugin along the lines of your suggestion (since it does not involve trying to merge the book records automatically, instead *just* removing duplicated formats). Off the top of my head it would most probably be by adding a checkbox option to the Find Duplicates screen rather than yet another interactive prompt. It would have to decide which book record in the group should have its format kept of course (perhaps oldest by Date column would usually make most sense).

The rest of the duplicates process would remain unchanged - the user would still be presented with a list of the duplicate groups, it just might be the case that some of those book records now have no attached formats (if the duplicate was the only format it had). So all the normal merging stuff would still apply, leaving it manually to the user to either delete such records or manually merge them.
kiwidude is offline   Reply With Quote
Old 04-06-2012, 09:13 PM   #229
Lancor
Junior Member
Lancor began at the beginning.
 
Posts: 2
Karma: 10
Join Date: Apr 2012
Device: kobo touch
Where is duplicate button????

Please help. I'm entirely new to this and I installed the duplicate finder plugin and restarted but the button was nowhere to be found. I looked it up in the User plugin under the filter of installed and showed as being installed but it is nowhere to be found on menu bar or in any of the dropdowns...


Can anyone help and thanks?
Lancor is offline   Reply With Quote
Old 04-06-2012, 09:25 PM   #230
PeterT
Taking a break; Fed up
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
PeterT's Avatar
 
Posts: 6,453
Karma: 42483084
Join Date: Nov 2007
Location: Toronto
Device: Wife: Touch, Arc, Vox Me: Nexus 7, Glo
Go to Preferences | Toolbar ; then select which toolbar you want to add the button too, and then finally, add the button from the left hand to the right hand side.
PeterT is online now   Reply With Quote
Old 04-07-2012, 12:27 AM   #231
Lancor
Junior Member
Lancor began at the beginning.
 
Posts: 2
Karma: 10
Join Date: Apr 2012
Device: kobo touch
Thanks PeterT...that got me in the right direction. I clicked on the Preferences tab and under the "Interface" section I clicked "Toolbar" and than under the dropdown I chose to edit the "Main toolbar" and there it was on the left side.

Thanks again
Lancor is offline   Reply With Quote
Old 04-16-2012, 03:20 PM   #232
P.K.Dick
Member
P.K.Dick began at the beginning.
 
Posts: 10
Karma: 10
Join Date: Aug 2011
Device: none
Hello,

I found a problem with the binay comparison, as the epub reader of calibre modify the epub to store the last page read (option on by default), I have a lot of book which are not detected duplicate.
is it possible to have an option of comparing also specified column (ie age or word-count);
So I could compare with the actual options on author and editor, and make a restriction to see only books with the same information on the choosen columns in my case, wordcount.

Hope I am clear

thank you for all your plugins
P.K.Dick is offline   Reply With Quote
Old 04-16-2012, 03:29 PM   #233
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,223
Karma: 1333994
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@P.K.Dick - what you found is the very good reason why some of us turn off that feature of the ebook viewer. You can do that by bringing up the ebook viewer, clicking the preferences icon and unticking the "Remember the current page when quitting" option. That will at least stop any more "damage" being done.

To answer your other question, no it isn't something I am interested in adding (it has been discussed previously on this thread). Apart from introducing dependencies between plugins (standard calibre has no page count or word count feature) it also won't work for books with multiple formats associated with them.
kiwidude is offline   Reply With Quote
Old 04-16-2012, 03:35 PM   #234
P.K.Dick
Member
P.K.Dick began at the beginning.
 
Posts: 10
Karma: 10
Join Date: Aug 2011
Device: none
okay

and yes I have turned off that feature,
P.K.Dick is offline   Reply With Quote
Old 06-22-2012, 03:58 PM   #235
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,223
Karma: 1333994
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
v1.3.0 Released

Changes in this release:
  • Now requires calibre 0.8.57
  • Store configuration in the calibre library database rather than a json file, to allow reuse from different computers (not simultaneously!)
  • Add a support option to the configuration dialog allowing viewing the plugin data stored in the database
  • Add an option to allow automatic removal of binary duplicates (does not delete books records, only the newest copies of that format).

I've got a number of plugin updates that will be released today based around calibre 0.8.57, taking advantage of a new feature to store plugin settings inside the calibre library. The benefit of this is for users that store their library in a shared network location and use calibre from multiple machines (though never at the same time - that limitation hasn't changed!). Your plugin configuration settings which are specific to each library (such as custom column names, book exemptions, reading lists etc) will be automatically kept in sync when calibre is next opened on each machine.

Specifically for this plugin it means any duplicate exemptions you configure for books and authors do not have to be repeated on each machine you open the library on.

The other addition to this plugin is a feature that has been requested a number of times over the last x months. When you do a Binary Compare using this plugin, it is not possible to see in the calibre gui which of the formats actually are duplicates of each other in the situation where each of the books in the group have multiple formats associated. So if Book A has EPUB, MOBI, PDF and book 2 has EPUB and MOBI, you couldn't tell if it was the EPUB, MOBI or both that were found as binary identical in that group (without opening each folder and comparing file sizes manually).

You now have a checkbox on the plugin dialog which allows the plugin to automatically remove the duplicate format(s) for you. Note this does not delete the book records in your database - just all but one of the duplicate formats and physical files. It chooses the book record that is the oldest in your library within that group to keep the format for.

So with this option enabled and the example above, if the EPUB was a binary duplicate and book 1 was the first copy created in your library, then the results will leave you with book 1 having the EPUB, MOBI and PDF formats, and book 2 having just the MOBI. If the MOBI was also a binary duplicate of book 1, then it would be left with no formats.

You can then resolve the duplicate groups in the usual manner - either merging the records, or deleting the books with no formats.

Some of you may ask why not completely delete the book if it has no formats? The answer is because you might have other metadata on that book record which you want to keep. There is no guarantee that the "oldest" version of a book duplicate is the one that should be kept - for instance you might have added a "Read" tag/custom column and it happened to be set on the newer record. Or perhaps you downloaded metadata and a nice cover for the newer record, not realising your older one existed. The approach I have taken ensures no important data is lost if you enable this option, and leaves the decisions about whether to merge/which direction or delete entirely up to you.
kiwidude is offline   Reply With Quote
Old 06-30-2012, 10:08 AM   #236
MartyTX
Dedicated
MartyTX ought to be getting tired of karma fortunes by now.MartyTX ought to be getting tired of karma fortunes by now.MartyTX ought to be getting tired of karma fortunes by now.MartyTX ought to be getting tired of karma fortunes by now.MartyTX ought to be getting tired of karma fortunes by now.MartyTX ought to be getting tired of karma fortunes by now.MartyTX ought to be getting tired of karma fortunes by now.MartyTX ought to be getting tired of karma fortunes by now.MartyTX ought to be getting tired of karma fortunes by now.MartyTX ought to be getting tired of karma fortunes by now.MartyTX ought to be getting tired of karma fortunes by now.
 
MartyTX's Avatar
 
Posts: 186
Karma: 578712
Join Date: Jun 2012
Location: Amarillo, TX
Device: Nook ST, iPad Mini
Great Plugin

kiwidude,

Thanks for "Find Duplicates". It's a great plugin ... many useful features and easy for a novice to use.

I have over 600 books in Calibre. Yesterday, after loading some books, I noticed that my book-count and title-count were different. I sorted by title and after a long and tedious search, I discovered that 3 of the books I had just added were duplicate titles with different authors. Never had a duplicate before ... then 3 in one day! (Last Man Standing, Relentless, Split Second).

Did some searching on MobileRead and learned about your MANY Calibre plugins. Sincere thanks for all your time and effort.

Marty
MartyTX is offline   Reply With Quote
Old 06-30-2012, 11:02 AM   #237
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,223
Karma: 1333994
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@Marty, thanks, always like to hear positive stuff, makes a change from feature requests or bug reports

I'm working on the next version of this plugin at the moment, which has a new screen that allows searching for author, series, publisher and tag variations and renaming them in a convenient way. It should be out in a week or so...
kiwidude is offline   Reply With Quote
Old 07-05-2012, 08:14 PM   #238
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 2,756
Karma: 1676604
Join Date: Mar 2012
Location: NSW Australia
Device: none
Is there a way to run author/title compare over multiple libraries ?
BetterRed is offline   Reply With Quote
Old 07-06-2012, 03:05 AM   #239
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,223
Karma: 1333994
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
No there isn't. The problem is how to present the results - you can't display them as groups together in the library view since you can only show books from one library. So it would either have to be a report, or a completely new screen.
kiwidude is offline   Reply With Quote
Old 07-06-2012, 04:49 AM   #240
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 2,756
Karma: 1676604
Join Date: Mar 2012
Location: NSW Australia
Device: none
Quote:
Originally Posted by kiwidude View Post
No there isn't. The problem is how to present the results - you can't display them as groups together in the library view since you can only show books from one library. So it would either have to be a report, or a completely new screen.
I'd be happy with a report - but don't break a leg. It wasn't much more than an idle thought, I won't die for it's lack - promise

BR
BetterRed is offline   Reply With Quote
Reply

Tags
cross library duplicates, in library duplicates

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Generate Cover kiwidude Plugins 479 07-10-2014 07:35 PM
[GUI Plugin] Quality Check kiwidude Plugins 729 07-10-2014 06:35 PM
[GUI Plugin] View Manager kiwidude Plugins 77 07-09-2014 07:40 PM
[GUI Plugin] Open With kiwidude Plugins 223 07-09-2014 02:42 AM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 04:48 PM.


MobileRead.com is a privately owned, operated and funded community.