I don't know about "scare," but too many people around definitely makes me uncomfortable.
Unless, oddly enough, I'm giving a lecture or presentation. You'd think that would be worse, because then they're all looking at me, but no, that doesn't bother me at all. Go figure.