when you terminate a program, temporary files will not be cleaned up
The problem is- the "magick-" temporary files seem to be NEVER removed, whether the program terminates abnormally or normally. Also, the files should really be removed and memory released AFTER EACH BOOK. Do you think it is normal that the system uses up 20GB of space to just import about 40 books?
Are you using regular expressions to read meta-data from PDF's? If yes- that's the worst way to go. Searching within huge binary files with reg ex is HORRIBLY slow and resource consuming. On my reasonably fast quad core with 8 GB ram it takes sometimes 5 (!) minutes per PDF to search for meta-data. And if the data is absent- in all likeliness regular expression algorithm will run our of resources, just like it happens in my case. Just a thought from reg ex specialist
There are other much faster and less resource consuming possibilities to read pdf meta-data. For example, here is a very fast program that you can run from command line to get PDF meta data. Tested and works great- it even detects if PDF is password-protected:
http://www.becyhome.de/download_ger.htm#becypdfmetaedit
Let me know what you think. Thanks for a great program and keep up the good work!