Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 08-24-2011, 05:22 PM   #136
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
The User Category when clicked on is a search, so you can use that as the basis for a restriction. However you still need to do that extra step of clicking on the "Restrict to" dropdown so that any searches that plugins like Find Duplicates and Quality Check do are restricted to just those books in that "search".
kiwidude is offline   Reply With Quote
Old 08-25-2011, 03:29 PM   #137
Philosopher
Enthusiast
Philosopher began at the beginning.
 
Philosopher's Avatar
 
Posts: 43
Karma: 12
Join Date: Jun 2010
Device: Kindle
Ah yes - now I see.

Thanks so much. Works like a charm.
Philosopher is offline   Reply With Quote
 
Enthusiast
Old 08-26-2011, 05:00 AM   #138
drMerry
Addict
drMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmos
 
drMerry's Avatar
 
Posts: 293
Karma: 21022
Join Date: Mar 2011
Location: NL
Device: Sony PRS-650
Just another request.
I'd like to show all duplicates with a restriction on group-level

I'd like to find duplicate books with VARIOUS formats.

At this moment I do a duplicate search, restrict to all duplicates and search for:
Code:
(formats:pdf and not formats:epub) or (formats:epub and not formats:pdf)
This gives me all books that do have an epub and no pdf (or vise versa).
I than can merge all duplicates without loosing books.

The problem is, I have to do this on all my duplicates, so this search will also show the duplicates that only contain pdf or only epub.

Is there a way to show all duplicates and add a search-restriction on the group/duplicate-level
(in that case I can also look for books with explicit title differences e.g.
Code:
title:- or not title:-
)

All these restrictions are restrictions that do not make sense in advance, but can be very use-full to select some specific duplicates.
drMerry is offline   Reply With Quote
Old 08-26-2011, 07:31 AM   #139
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@drMerry - you are back to discussing merging again, aka "filters" and any other number of times you have sneakily tried to broach this topic...

I'm going to have to modify this plugin at some point soon to address the keyboard shortcut changes that need to be made after Kovid's (welcome) additions in Calibre aroung that. I'm not promising anything about the above but I will take a look into it.
kiwidude is offline   Reply With Quote
Old 08-26-2011, 08:56 AM   #140
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by drMerry View Post
At this moment I do a duplicate search, restrict to all duplicates and search for:
Code:
(formats:pdf and not formats:epub) or (formats:epub and not formats:pdf)
This gives me all books that do have an epub and no pdf (or vise versa).
I than can merge all duplicates without loosing books.[/CODE])

All these restrictions are restrictions that do not make sense in advance, but can be very use-full to select some specific duplicates.
I'm not sure I fully understand what you are trying to do here, but if you want to merge without losing books, are you aware of this type of search:
Code:
formats:#1
It will find all book records that have a single format. I use it often with
Code:
formats:pdf
to find all entries that have only a single pdf entry, etc.
Starson17 is offline   Reply With Quote
Old 08-26-2011, 09:27 AM   #141
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@Starson17 - I was going to suggest that but it would still only be a subset of what he wants.

What he wants to do is find duplicate pairs that he can immediately merge without thinking. So a book that has PDF and a book that has EPUB can be merged.

However two books which both have EPUB cannot be merged without figuring out which wins. So the formats:#1 would not work for him in this situation

Also it would not catch say a book with RTF, PDF and a book with EPUB - these can be safely merged as well, even though the count of their formats differ.
kiwidude is offline   Reply With Quote
Old 08-26-2011, 09:57 AM   #142
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by kiwidude View Post
What he wants to do is find duplicate pairs that he can immediately merge without thinking. So a book that has PDF and a book that has EPUB can be merged.
Unless one has good metadata and one has bad metadata

I understand the issue. He has the same problem with using:
Code:
(formats:pdf and not formats:epub) or (formats:epub and not formats:pdf)
Two books with only a pdf format and no others will both show up and can't be merged without closer inspection. I was just commenting on the form of his search, which would get pretty long if he starts adding more formats. I wasn't sure if he was familiar with the "#" search for is_multiple fields which can be useful for searches like that.

I wasn't suggesting a solution, as there currently isn't one AFAIK. To find books that don't have overlapping formats, you have to use a search that simultaneously knows about the formats in multiple book records (select "A" if this is true of "B"), but the search system only looks at one book record ("A") at a time.
Starson17 is offline   Reply With Quote
Old 08-26-2011, 11:51 AM   #143
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Indeed, so given that the search system cannot meet his needs, he really only has two options I can see:
(1) Extend the Find Duplicates plugin to filter the results
(2) Give up on the idea of trying to filter the results, and instead write a plugin that does more intelligent merging.

And I totally agree that merging formats just because they are of different types regardless of their source is a recipe for a library mess. Still, some users really don't care that much. It isn't the way I personally manage my library which is why I am only lukewarm to the idea, but there are people out there who don't share my philosophy on content quality. Which is completely fair enough given how time consuming it can be.
kiwidude is offline   Reply With Quote
Old 08-26-2011, 02:23 PM   #144
Starson17
Wizard
Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.Starson17 can program the VCR without an owner's manual.
 
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
Quote:
Originally Posted by kiwidude View Post
Indeed, so given that the search system cannot meet his needs, he really only has two options I can see:
(1) Extend the Find Duplicates plugin to filter the results
(2) Give up on the idea of trying to filter the results, and instead write a plugin that does more intelligent merging.
Or (3) Extend the search system.

I've occasionally resorted to full SQL searching in the metadata.db file to solve tricky search problems.

With respect to 1), the Find Duplicates plugin takes a large group of records, and breaks it into multiple sub groups, some of which may overlap. A "filter" option would preferably be able to do the same thing - break one of the first groups down into one or more additional subgroups that may overlap. (It's not really "filtering" at this point, but finding matching groups within the results.) If there are four books that have fuzzy matched author-titles from a FD search, a) may have only a PDF, b) may have an EPUB and a MOBI, c) may have an EPUB and a TXT and d) may have only a MOBI. One subgroup is a), b). Another is a), c), d). Either could be merged without format loss. Add in a fifth with only an EPUB and the number of groups escalates.

With respect to 2) and 3), one needs the FD output anyway. Both provide advantages beyond the Find Dupes merger situation.
Starson17 is offline   Reply With Quote
Old 08-26-2011, 06:15 PM   #145
drMerry
Addict
drMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmos
 
drMerry's Avatar
 
Posts: 293
Karma: 21022
Join Date: Mar 2011
Location: NL
Device: Sony PRS-650
Quote:
Originally Posted by kiwidude View Post
@drMerry - you are back to discussing merging again, aka "filters" and any other number of times you have sneakily tried to broach this topic...
Hmm,

maybe I need to look better to earlier requests I did myself and the reactions before I request for more

@ all other reactions.
Thank you all for thinking about this.

The case of content merging is no point, because I have own created identifiers (I have a 'procedure' to add this info to the title when scanning for duplicate titles and remove them afterwards.) to separate the content. So, if a book is said to be duplicated on title, I know it is also on content base.

While the plugin-creation is just volunteer work, and time-consuming, take your time or even don't implement it at all.
It are just suggestions I would use often if available. But I still love the current functionality.
drMerry is offline   Reply With Quote
Old 09-03-2011, 10:41 AM   #146
drMerry
Addict
drMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmos
 
drMerry's Avatar
 
Posts: 293
Karma: 21022
Join Date: Mar 2011
Location: NL
Device: Sony PRS-650
Exclamation

Got a nice bug.

I selected show all at once
highlight authors in tag browser
unchecked sort by number of dups (it was checked, so really UNCHECKED it)
Changed search mode from similar title+identical author to ignore title + similar author.

This last step was done by selecting ignore title (similar author is automatically selected at that moment).

My results are in the screenshot????

No duplicates searching ignore title and identical author????? I'm sure this should give results in the first place, but I asked similar authors, no identical....
Attached Thumbnails
Click image for larger version

Name:	duperror.png
Views:	89
Size:	11.7 KB
ID:	76047  
drMerry is offline   Reply With Quote
Old 09-03-2011, 12:17 PM   #147
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@drMerry - nice spot. I've made the fix, but the release can wait until I figure out the keyboard shortcut changes.
kiwidude is offline   Reply With Quote
Old 09-03-2011, 05:15 PM   #148
drMerry
Addict
drMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmosdrMerry has become one with the cosmos
 
drMerry's Avatar
 
Posts: 293
Karma: 21022
Join Date: Mar 2011
Location: NL
Device: Sony PRS-650
Quote:
Originally Posted by kiwidude View Post
@drMerry - nice spot. I've made the fix, but the release can wait until I figure out the keyboard shortcut changes.
Quickly done
It's not a critical bug. If the next release also contains the shortcut changes, it makes a nice update at once. (new major number?)
drMerry is offline   Reply With Quote
Old 09-11-2011, 08:54 AM   #149
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
v1.2.0 Released

Changes in this release:
  • Fix bug for when switching to an ignore title search where author search was previously set to ignore.
  • Remove customisation of shortcuts on tab, to use Calibre's centrally managed shortcuts instead.

Requires Calibre 0.8.18. If you have previously assigned shortcuts for features in this plugin you will have to reassign them after upgrading.
kiwidude is offline   Reply With Quote
Old 10-08-2011, 03:53 PM   #150
ElMiko
Addict
ElMiko actually enjoys Vogon poetry.ElMiko actually enjoys Vogon poetry.ElMiko actually enjoys Vogon poetry.ElMiko actually enjoys Vogon poetry.ElMiko actually enjoys Vogon poetry.ElMiko actually enjoys Vogon poetry.ElMiko actually enjoys Vogon poetry.ElMiko actually enjoys Vogon poetry.ElMiko actually enjoys Vogon poetry.ElMiko actually enjoys Vogon poetry.ElMiko actually enjoys Vogon poetry.
 
ElMiko's Avatar
 
Posts: 299
Karma: 56788
Join Date: Jun 2011
Device: Kindle
What are the search parameters that I should be using (if this is even possible) for Find Duplicates to flag the following duplicates:

Code:
title:                                        author:
Cotton Malone 06 - The Emperor's Tomb         Berry, Steve
The Emperor's Tomb                            Steve Berry
As always, thanks!
ElMiko is offline   Reply With Quote
Reply

Tags
cross library duplicates, in library duplicates

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Quality Check kiwidude Plugins 746 Today 11:22 AM
[GUI Plugin] Generate Cover kiwidude Plugins 489 08-15-2014 09:39 AM
[GUI Plugin] View Manager kiwidude Plugins 82 08-01-2014 12:37 PM
[GUI Plugin] Open With kiwidude Plugins 228 07-31-2014 01:06 AM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 02:01 PM.


MobileRead.com is a privately owned, operated and funded community.