Multiple calibre-parallel.exe processes?

[Phssthpok]

I find that as I edit books, my system gets slower and slower. Usually I find that there are many processes running callibre-parallel.exe. At the moment, after a reboot, I have imported a couple of books, viewed them, deleted one, and edited one, and am now editing the other. I saved it yesterday, closed the lid of my laptop and went to bed. Today I've opened up the system and have been dealing with mail and so on, but the system is already starting to thrash a bit. I find that currently have 5 calibre-parallel.exe processes with the following command lines:

1. "C:\Program Files (x86)\Calibre2\calibre-parallel.exe" --pipe-worker "from calibre.utils.recycle_bin import recycler_main; recycler_main()"
2. "C:\Program Files (x86)\Calibre2\calibre-parallel.exe" --pipe-worker "from calibre.utils.ipc.pool import run_main, worker_main; run_main(worker_main)"
3. "C:\Program Files (x86)\Calibre2\calibre-parallel.exe"
4. "C:\Program Files (x86)\Calibre2\calibre-parallel.exe" --pipe-worker "from calibre.gui2.tweak_book.completion.worker import run_main, main; run_main(main)"
5. "C:\Program Files (x86)\Calibre2\calibre-parallel.exe"

The 3rd process is the parent of the last 2.

I don't know if this is strictly an editor issue, but can anyone explain why these processes seem to just just hang around and increase in number as time goes on?

[theducks]

Preferences: Miscellaneous: (first line)

also
Preferences: Behavior: Job Priority

[Phssthpok]

Thanks for answering, but your answer doesn't help me much...

Originally Posted by theducks

Preferences: Miscellaneous: (first line)

also
Preferences: Behavior: Job Priority

Preferences: Miscellaneous: Max. simultaneous conversion/news download jobs: 3
... except I wasn't converting or downloading news.

Preferences: Behavior: Job Priority: Normal
... so why are these processes still there after many many hours?

I left the editor open all day while I did other things. All 5 processes were still running just prior to coming here to post this reply. I closed the editor, leaving only the main Calibre window open, and that got rid of (3) and its two children, (4) and (5). Processes (1) and (2) are still there, and from past experience will stay there until I kill them manually. And gradually, if left to themselves, more and more processes will accumulate...

[eschwartz]

It is entirely natural that calibre components currently running will take up memory, but they shouldn't be left behind after you close calibre.

I don' know what precisely they may be doing (calibre-parallel is the calibre worker processes that carry out miscellaneous "stuff") but they are most likely doing something. To put it in perspective -- I don't think I've ever seen calibre running and NOT seen at least one calibre-parallel process as well.

Is it slowing down your system?

[theducks]

I use Priority LOW

Some Worker Processes are Polling FOR work to be done:
Content Server is one

Wireless Device connection? (I don't see a process without a device)

[kovidgoyal]

Worker processes are used for many things in calibre, but they are always killed when quitting calibre. If that is not happening on your system there is something wrong with your system. And note that worker processes are all designed to sleep unless they are actually doing something, so they dont use any resources. For example, the calibre GUI will keep a single worker process in standby so as to to be able to add/save books fast without waiting for worker startup (which is slow in python). Similarly, the editor will keep two standby processes per instance, used for rendering the preview panel and auto-complete. Neither of these processes actually run unless there is work to be done.

In your list below, 1. look suspicious, that is a short lived worker process used to move books to the recycle bin when deleting books. If it is hanging around then it is likely that something is wrong witht he recycle bin on your system.

[Phssthpok]

Originally Posted by kovidgoyal

In your list below, 1. look suspicious, that is a short lived worker process used to move books to the recycle bin when deleting books. If it is hanging around then it is likely that something is wrong witht he recycle bin on your system.

Thanks, I'll look into this. Typically I leave Calibre often for days at a time when I'm organising things so I don't have to find my way back to where I was each time, but I find I have to close Calibre completely every so often, otherwise the system starts slowing down and eventually after a few days it thrashes its way to a complete standstill.