Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 03-21-2012, 07:58 AM   #1
Erromanski
Junior Member
Erromanski began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Apr 2011
Device: Kindle 3G
Compare 2 calibre libraries

My friend and I both have a large calibre library. Probably with a lot of books the same, but also books that we don't have both. We could have the same books with different formatted titles, authors etc. How can we compare our libraries to find unique books?
Erromanski is offline   Reply With Quote
Old 03-21-2012, 08:11 AM   #2
brewjono
Zealot
brewjono ought to be getting tired of karma fortunes by now.brewjono ought to be getting tired of karma fortunes by now.brewjono ought to be getting tired of karma fortunes by now.brewjono ought to be getting tired of karma fortunes by now.brewjono ought to be getting tired of karma fortunes by now.brewjono ought to be getting tired of karma fortunes by now.brewjono ought to be getting tired of karma fortunes by now.brewjono ought to be getting tired of karma fortunes by now.brewjono ought to be getting tired of karma fortunes by now.brewjono ought to be getting tired of karma fortunes by now.brewjono ought to be getting tired of karma fortunes by now.
 
brewjono's Avatar
 
Posts: 106
Karma: 501816
Join Date: Jan 2010
Location: Australia
Device: K3, K4, KPW
I have wanted to do this same thing myself so am keen to hear if there are any suggestions.
brewjono is offline   Reply With Quote
Old 03-21-2012, 08:43 AM   #3
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,866
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Take the metadata.db files from the two libraries and sue them to create two empty libraries with no actual book files. Then use copy to library in calibre to merge the two. Then use the duplicate finder plugin to check for duplicates in the merged libraries.

Or output the list of books as an XML or CSV catalog and use any tool you like to compare it like a spreadsheet program or a diff tool.
kovidgoyal is online now   Reply With Quote
Old 10-31-2012, 05:29 PM   #4
eltrkbrd
Junior Member
eltrkbrd began at the beginning.
 
Posts: 6
Karma: 28
Join Date: Sep 2012
Device: none
Lightbulb How to merge libraries & remove duplicates in calibre

After recently experimenting with calibre portable and figuring out how to merge libraries & remove duplicates, I've decided to share my experience with other calibre neophytes out there in hopes that it may simplify things a bit...

The calibre "convert books" | "create a catalog" | export to CSV (w/ title field only) option works nice just for a simple book list comparison. For this task I used Notepad++ (Windows) with the built in "compare" plugin along with the TextFX plugin to sort lines (unique).

Another option as Kovid suggested is to simply copy the calibre metadata.db file for each existing library without the books into separate directories, then merge and compare with Kiwidude's "Find Duplicates" plugin.

I found it easier to first click calibre "Add books" | then "control the adding of books" | select the "automerge added books" and choose "ignore duplicate" from the drop down list options & finally select the "check for duplicates" under "automatic adding" tab on that same window.

After changing the above options in calibre, click the library (books) icon in the toolbar and select "switch/create library" | "use the previously existing library (default option)" | browse to the folder you saved the metadata.db file to; say library1 for example | then click ok to open library1 in calibre. Then browse again to the folder you saved the metadata.db file for say library2 in and click ok to open that in calibre.

Note that you can now easily switch libraries using the "quick switch" option by clicking the small black down arrow icon to the right of the library icon in calibre.

Once you are in say library #2, select all ebooks (ctrl + a) | then right click and select the option "copy to library" library1. Now quick switch to library1 and you will notice all the book entries from library2 will have been merged with libary1 and the duplicates ignored.

Some other tips I picked up searching the forums here is to use the "Duplicate Finder" plugin's "binary compare" feature to remove binary identical books. Then search for “formats:false” to delete empty book entries from calibre without any ebook formats (book entries withouth any pdf,epub,mobi files, etc.). Alternatively, you can add the "formats" custom column in calibre and sort by that column to delete the empty book entries from calibre (binary compare doesn't automatically delete the book entries from calibre because of metadata that you may want to retain/merge).

For more tips on using Duplicate Finder, see:
https://www.mobileread.com/forums/sho...d.php?t=131017
http://blog.calibre-ebook.com/2011/1...te-finder.html

Lastly, my personal thanks to Kovid Goyal and the many others in the calibre community for making this open source project such an inspiration...

Enjoy!

Last edited by eltrkbrd; 10-31-2012 at 05:45 PM.
eltrkbrd is offline   Reply With Quote
Old 01-27-2014, 07:13 AM   #5
Richs
Junior Member
Richs began at the beginning.
 
Posts: 9
Karma: 10
Join Date: Jan 2014
Device: ipad
Great post!!! thanks for simplifying that.
Richs is offline   Reply With Quote
Old 04-13-2014, 07:03 AM   #6
joalmoju
Junior Member
joalmoju began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Apr 2014
Device: ipad2
I use the connect to option, it let you use a folder (for example an USB storage with a calibre library). It let me compare which books are in both libraries and copy them.
joalmoju is offline   Reply With Quote
Old 05-03-2014, 02:59 PM   #7
Tanjamuse
Wizard
Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!Tanjamuse , Klaatu Barada Niktu!
 
Posts: 1,327
Karma: 5306
Join Date: Jan 2014
Device: none
What about overwriting if you have updated the metadata in one library? Or keeping the newest?
Tanjamuse is offline   Reply With Quote
Old 05-12-2015, 08:11 PM   #8
allowingtoo
Bibliophile
allowingtoo began at the beginning.
 
Posts: 154
Karma: 10
Join Date: Sep 2010
Device: Amazon
Quote:
Originally Posted by eltrkbrd View Post
After recently experimenting with calibre portable and figuring out how to merge libraries & remove duplicates, I've decided to share my experience with other calibre neophytes out there in hopes that it may simplify things a bit...

I found it easier to first click calibre "Add books" | then "control the adding of books" | select the "automerge added books" and choose "ignore duplicate" from the drop down list options & finally select the "check for duplicates" under "automatic adding" tab on that same window.

Lastly, my personal thanks to Kovid Goyal and the many others in the calibre community for making this open source project such an inspiration...

Enjoy!
I know this is a VERY old post but FINALLY!! Something that worked for me. I tried the old tried and true way via the Calibre manual importing my books from my old computer to my new computer and ended up with some errors for some reason and all my books did not get imported. So I kept searching and ran across this and it worked.

Last edited by allowingtoo; 05-12-2015 at 08:14 PM.
allowingtoo is offline   Reply With Quote
Reply


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
How to merge 2 Calibre Libraries? Tolkamp Library Management 17 03-27-2019 09:36 PM
Calibre Libraries burbleburble Calibre 7 12-05-2011 01:57 PM
Calibre Portable and Libraries atjnjk Related Tools 13 12-15-2010 06:16 AM
Compare calibre library with ereader library Danthier Calibre 3 06-15-2010 11:58 PM


All times are GMT -4. The time now is 09:13 AM.


MobileRead.com is a privately owned, operated and funded community.