View Single Post
Old 04-28-2011, 01:04 PM   #183
kiwidude
Calibre Plugins Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,731
Karma: 2197770
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
That is what I am doing currently (well except with sha256). I just tried it with sha512 and that made no difference on my smaller test library anyways in terms of the false positives.

I ran a third party product (Duplicate Cleaner) to see what it's performance was like. Maybe 4.5 minutes isn't so bad after all.

Perhaps I now just need to add a third pass to compare file streams - is there an efficient way of doing that?
kiwidude is offline   Reply With Quote