|
Coming to the question of pipes: It seems to me that what we really need is some kind of proxy object that allows the calling of methods from the db API in one process from another process. Jobs running in child processes can then pretty much do anything to the db by calling the appropriate API.
The multiprocessing module has the necessary IPC plumbing to implement this, I believe.
|