|
Definitely looks like resource exhaustion. Presumably you are forking workers in each worker of which there are itself N copies running in parallel giving N * N processes. Many OSes have ridicuolusly low limits on how many open file handles and so on by default. I suggest you run one job per worker and let the jobs system handle queueing the work for you.
|