I didn't see it here, but has anyone suggested that he exclude the Calibre library from his antivirus? That will sometimes do wonders for Calibre speed problems.
My library is 17K books. My experience is just like chaley's. It's fast and responsive and I've never seen a corrupted database despite running from source and bleeding edge for the last 1.5 years.