[kovidgoyal]

I doubt filesystem access times are the limiting factor. When adding, the entire existing library has to be searched for duplicates, which is likely the biggest thing slowing down adds as library size grows.