Show Duplicate Titles

[NoBiscuit]

Hi
Is there anyway I can get Calibre to display all books with duplicate titles?
Thanks
NoBiscuit

[Bilbo1967]

If you sort by Title then any duplicates will be all together. Is that enough for your purposes?

[NoBiscuit]

Originally Posted by Bilbo1967

If you sort by Title then any duplicates will be all together. Is that enough for your purposes?

That works, it is just awkward and clumsy when you have 9000+ books in the database. I just wondered if there was a quick way to do it that I had missed.
Thanks anyway.

[Bilbo1967]

Ah - OK, sorry. I'm a kind of 'lowest common denominator' kind of guy. Hopefully somebody a bit more sophisticated in usage of Calibre will be along shortly.

[theducks]

Just to make your automatic problem more difficult:
1 character difference makes it a different title:
Blue Moon
vs
Blue moon
vs
Blue_Moon

Eyball Mk 1 is a wonderful thing.


The other Gotcha
is I have 2 different books with the same title..Different Authors
Ouch!


Btw sort Authors first, then sort Titles
Calibre seems to bias the sort by the previous sort. (is this a Bubble sort?)

[Starson17]

Originally Posted by NoBiscuit

Is there anyway I can get Calibre to display all books with duplicate titles?

I'm not aware of any way inside calibre. I do it by opening up the metadata.db file in sqlitespy and using an sql query.

This will also do it:

calibre-debug -c "from calibre.library.database2 import LibraryDatabase2; db = LibraryDatabase2('/path/to/library/folder');dupes = db.conn.get('select title from books group by title having count(*) > 1;');print dupes;">dupes.txt

Copy that long line, change the path to point to your library folder and paste it into a command window (terminal window, dos box, whatever you call it) and it will produce a file in the current directory called dupes.txt with all your duplicate titles in it. It's a list of dupe titles in unicode format.

[NoBiscuit]

Originally Posted by theducks

Just to make your automatic problem more difficult:
1 character difference makes it a different title:
Blue Moon
vs
Blue moon
vs
Blue_Moon

Eyball Mk 1 is a wonderful thing.


The other Gotcha
is I have 2 different books with the same title..Different Authors
Ouch!

That is all part of my pain.

[NoBiscuit]

Originally Posted by Starson17

I'm not aware of any way inside calibre. I do it by opening up the metadata.db file in sqlitespy and using an sql query.

This will also do it:

calibre-debug -c "from calibre.library.database2 import LibraryDatabase2; db = LibraryDatabase2('/path/to/library/folder');dupes = db.conn.get('select title from books group by title having count(*) > 1;');print dupes;">dupes.txt

Copy that long line, change the path to point to your library folder and paste it into a command window (terminal window, dos box, whatever you call it) and it will produce a file in the current directory called dupes.txt with all your duplicate titles in it. It's a list of dupe titles in unicode format.

Your a Hero, Many Thanks

[Starson17]

Originally Posted by NoBiscuit

Your a Hero, Many Thanks

You're welcome, but as usual, thanks go to Kovid. Not only did he write calibre and make it open source, he's made a special effort to make the power of calibre accessible to us.

[NoBiscuit]

Originally Posted by Starson17

You're welcome, but as usual, thanks go to Kovid. Not only did he write calibre and make it open source, he's made a special effort to make the power of calibre accessible to us.

Indeed. Great program, thanks Kovid.

[zenrhino]

Hi,

Does this method still work with 0.7.19?

When I ran the query from bash, it gave me a blank result in dupes.txt.

I tried to run a simple 'get * from books' and it threw me a couple paragraphs worth of errors, none of which seemed to be permission-based (I ran the query as SU).

Thanks,

ZR

[Starson17]

Originally Posted by zenrhino

Does this method still work with 0.7.19?

Yes.

When I ran the query from bash, it gave me a blank result in dupes.txt.

Is your Library path correct?

[ctwaley]

Originally Posted by Starson17

...This will also do it:

calibre-debug -c "from calibre.library.database2 import LibraryDatabase2; db = LibraryDatabase2('/path/to/library/folder');dupes = db.conn.get('select title from books group by title having count(*) > 1;');print dupes;">dupes.txt

Copy that long line, change the path to point to your library folder and paste it into a command window (terminal window, dos box, whatever you call it) and it will produce a file in the current directory called dupes.txt with all your duplicate titles in it. It's a list of dupe titles in unicode format.

Hi ppl, new kid on the block here.

FWIW: judging from the command line code Starson17 has shown, it looks like it would work well in a 'nix environment, but for the windows users this would be more appropriate. Create a batch file using the following code:

@echo off

"%PROGRAMFILES%\Calibre2\calibre-debug" -c "from calibre.library.database2 import LibraryDatabase2; db = LibraryDatabase2('X:\Path\To\CalibreLibrary');dupes = db.conn.get('select title from books group by title having count(*) > 1;');print dupes;" > C:\dupe-titles.txt

This will create a comma-delimited "dupes-titles.txt" file of titles (enclosed in square brackets []) in the base of drive C:. Just copy and paste the code into notepad and name it something like "dupe-titles.cmd". Be sure to change "X:\Path\To\CalibreLibrary" to your actual library path.

And for those using a 64-bit Windows machine, substitute "%PROGRAMFILES(X86)%" for the "%PROGRAMFILES%" path. Also be sure to include the quotes I have shown for the "%PROGRAMFILES%" path at the beginning.

---Cole

[itimpi]

The easiest way to find duplicates is to install and use the "Find Duplicates" plugin.