MobileRead Forums - View Single Post

clockmaker · 10-05-2010, 04:25 PM

Thank you dwanthny for your attention.

Version is 0.7.22
Number of books in the library: 32469
Authors: 8185
Series: 6795
Formats: 23
Tags: 6113
Publishers: 1576
News: 0
Formats: 23
Size of the metadata.db file: 31.052 Mega bytes

I have checked the first thread and I believe I am doing what all is recommended.
The error crops up at about the same place each time, whether tags are used or not. It is always memoryerror. It appears after more than 2 hours of processing and after the log message "Flattening CSS and remapping font sizes...". There is a fairly long time span (15 min. or so between this message and the error.

When it stops with error, the 4 GB memory is not fully used and the pagefile.sys 6.2 GB) is hardly touched. Commit in the task manager shows 4/10. The memory taken by the Calibre process is around 1.6 GB.

Does the catalog do all the catalog work within the ram without using the pagefile.sys? Is there any limit due to Python?

Is there a way to combine two Catalogs (with split and smaller databases) to one without going through the HTML route? Through the combining route, I am afraid the cross referencing in the catalog would be lost.

10-05-2010, 04:25 PM	#323
clockmaker Member Posts: 18 Karma: 10 Join Date: Jul 2010 Device: Kindle 2	Thank you dwanthny for your attention. Version is 0.7.22 Number of books in the library: 32469 Authors: 8185 Series: 6795 Formats: 23 Tags: 6113 Publishers: 1576 News: 0 Formats: 23 Size of the metadata.db file: 31.052 Mega bytes I have checked the first thread and I believe I am doing what all is recommended. The error crops up at about the same place each time, whether tags are used or not. It is always memoryerror. It appears after more than 2 hours of processing and after the log message "Flattening CSS and remapping font sizes...". There is a fairly long time span (15 min. or so between this message and the error. When it stops with error, the 4 GB memory is not fully used and the pagefile.sys 6.2 GB) is hardly touched. Commit in the task manager shows 4/10. The memory taken by the Calibre process is around 1.6 GB. Does the catalog do all the catalog work within the ram without using the pagefile.sys? Is there any limit due to Python? Is there a way to combine two Catalogs (with split and smaller databases) to one without going through the HTML route? Through the combining route, I am afraid the cross referencing in the catalog would be lost.