Thread: Library Merging
View Single Post
Old 11-21-2015, 10:26 AM   #1
Krazykiwi
Zealot
Krazykiwi ought to be getting tired of karma fortunes by now.Krazykiwi ought to be getting tired of karma fortunes by now.Krazykiwi ought to be getting tired of karma fortunes by now.Krazykiwi ought to be getting tired of karma fortunes by now.Krazykiwi ought to be getting tired of karma fortunes by now.Krazykiwi ought to be getting tired of karma fortunes by now.Krazykiwi ought to be getting tired of karma fortunes by now.Krazykiwi ought to be getting tired of karma fortunes by now.Krazykiwi ought to be getting tired of karma fortunes by now.Krazykiwi ought to be getting tired of karma fortunes by now.Krazykiwi ought to be getting tired of karma fortunes by now.
 
Posts: 137
Karma: 2156958
Join Date: Jan 2013
Device: Too many random androids to list
Library Merging

Not the usual question, I know how to merge two libraries, but I'm wondering if anyone can give me a guesstimate how long this will take, so I can figure out if I should set this going overnight, or wait until I have a whole weekend.

I have two libraries, one consisting of 69k "books" and one consisting of 27k. I'd guesstimate there's about 20% duplication (that is, about 20% of the books in the smaller library are in the larger already).

I did a trial run of about 1000 books, and... well I got sick of waiting, but I think it took most of the night.

Is that the kind of speed I can expect (in which case, I will need to do this piecemeal over a few days so as to not interrupt the work too much). Or does that indicate something's dodgy with my databases and I need to do some cleanup?

Will it be faster to try to pull the dupes out first with the duplication plugin, in order to make the merge run faster, or would the duplicates

As an aside, Yes I know these are enormous numbers for Calibre libraries, no they're not pirated commercial books, this is not my personal Calibre library it's a text corpus for a research project. BTW Calibre's been doing a fabulous job managing this mountain of data. Ironically the much maligned "black box" nature, once I got it through everyone's heads, has been a godsend, being able to search effectively and dump out subsets of the texts to disk for data mining purposes works beautifully, and we can safely use destructive tools to chop 'em up and do stuff(TM) to them.
Krazykiwi is offline   Reply With Quote