Quote:
Originally Posted by kovidgoyal
I think that will depend on your kernel. For example, historically linux kernels were configured so that user space processes (like python) could not address more than 2GB memory. IIRC the same is true of WinXP. More recent linux kernels are usually configured with higher mem limits and I'm note sure what the situation is in modern windows land.
Basically, python has no particular memory limits, it will happily consume all the memory the OS hosting ti will allow it to.
|
Oh, so it's more likely (certain?) to be an OS imposed memory limit.
I guess I should just rewrite things a bit to process one chunk at a time.
Thanks!
- Ahi