Either you want calibre to connect with a device, or not. You can disable a device driver, or blacklist Android devices -- surely that is enough.
As Kovid said -- calibre is still usable even while
background processes scan the device, and any other program which locks up is obviously down to mysterious incompatibilities.
Not sure why that would be the fault of the device connection per se.