[sealbeater]

So, I'm a somewhat new user of calibre and I'm currently using the command line to add books. I have quite a few and I understand that it isn't a good idea apparently to use tools like parallel to write multiple entries to the calibre db. I'm currently using a for loop that does a find on the available formats that calibre can import and after importing, deletes the file.

for I in `find . -type f -name "*.azw" -o -name "*.azw3" -o -name "*.azw4" -o -name "*.chm" -o -name "*.djvu" -o -name "*.rb" -o -name "*.snb" -o -name "*.tcr" -o -name "*.epub" -o -name "*.lit" -o -name "*.lrf" -o -name "*.mobi" -o -name "*.pdf" -o -name "*.rtf" -o -name "*.prc" -o -name "*.pdb" -o -name "*.txt" -o -name "*.doc"` ; do calibredb add --duplicates "$I" && rm -v "$I"; done


So, this works fine but I was wondering if anyone had done anything interesting to either speed up the process or multithread it somehow. I had a friend who used a hadoop cluster to speed up jobs, I was wondering if anyone had done something similar with calibre.