Quote:
Originally Posted by Adoby
One thing that may be a limiting factor is disc speed combined with disc cache. This is why 32 bit calibre on 64 bit windows isn't all that bad. Unused memory will go to disc cache. You may be able to compensate quite a bit for slow discs by having plenty of memory for disc cache. This might even mean that 64 bit calibre could sometimes be slower than 32 bit calibre on computers with slow discs and limited memory (less than 8GB?)?
I have a quad core AMD 2.90 MHZ, 16 G Kingston HyperX Ram. My HD is a 7200 RPM Hitachi with 32 MB Buffer, SATA II , 3.0 Bb/s. Just processed 10 AZW>MOBI ebooks, and all 4 processors max-ed out at 100%, RAM usage peaked at 3.4% of 16 G, 14G available. I know the 'puter isn't a sure 'nuff screamer, but it's not a hunk of junk, either.
When doing very large bulk conversions the disc cache may currently be poorly utilized?
I don't know exactly how Calibre handles large bulk jobs, but it seems that when you transfer to device or convert, all the books are read and copied to the temp folder, and modified there. Only when all books have been converted or updated, and are ready in temp, does the transfer to device or back to the library start. If there are many books the cache may have discarded the first books in temp before this happens. Perhaps Calibre would be perceived as being much faster if the books were processed fully one by one. Copied to temp, modified, copied to destination, deleted in temp, and repeat for next book. Then it would be more likely that the cache can be utilized fully, and if temp and the library are on different discs, more of the file transfer may be done in parallel. But perhaps this would increase the risk of corrupt books or metadata?
|
All of the conversions were accomplished properly, and as the processes were eliminated to 3 cores processing, the fan speed slowed some, but 3 cores continued at 100%. RAM usage didn't change. It's the RAM usage that I need to improve, but I don't know how.
This must not be a problem with anyone else, for no one seems to have voiced a problem. However, I'd like, if possible, to improve this process. I just ordered an aftermarket cooler for the system that should keep the processors cool during the conversions, but, still.....DAD GUMMIT, I'd like to take advantage of all that extra RAM not doing anything!