I think processing 200GB worh of information is the real problem, that is never going to be fast.
plaintext will not make for a very fast database either.
I'd recommend writing a script to determine when and where articles have been updated/added, then importing the changes into calibre. After the first import, the new material will not be as much, and will take less time.
|