see attached screenshot:
FTS (Full text search) indexing, even in slow speed, can cause a general slow response, depending on the system. IIRC, FTS indexing is on by default in Calibre recent versions. (edit:
it isn't)
So you could try this: disable FTS indexing. (it's the FT icon on the left side of the gear icon in the search bar)