The only limit is that of your budget
Calibre does start getting a little sluggish when you get into the tens of thousands of books but it is still usable, well on a relatively recent PC anyways. Anything up to a few thousand and it doesn't lose a beat.