Input file = 409MB
Memory usage
before:
Quote:
|
datalst = [datain[0:secstart], secdata, datain[secend:]]
|
420.35546875
After that line:
819.8828125
And it crash line later on:
Quote:
|
datalst = b''.join(datalst)
|
On 64bit Python memory usage after that line is around 1225.
Using
append don't impact memory usage.
EDIT:
Well after spending another 6h on tests now I'm quite sure that is not an error. It just use too much memory.
All these anomalies were caused by fact that standalone program was running very close to memory limit and success depended on the number of imports (lol!).
Both of headers are on beginning on the file? Why we loading entire file?