This issue is an old one as I have seen this behavior since the 1.x series.
I remedy it by starting calibre at the very first opportunity right after starting-up my machine (win7 x64). Most of the time the delay then is just a couple of seconds without any freeze.
When I miss the sweet spot, then even the cursor seems to be frozen for some time

.