|
What the purpose of this limit? It seems kind of arbitrary.
I removed the line "limit = min(limit, cpu_count())" from server.py and my news downloading is much faster now because the entire queue doesn't block when once news source stalls.
Even with 10 parallel downloads the average CPU load is under 5% because most time is spent waiting for server responses.
Last edited by drwowe; 12-14-2009 at 11:38 AM.
|