What is the statistic again? The average American reads 1.something books a year and (some really high percentage) of American adults never read a book again post High School?
That's an awful lot of people I'd have to knock away from my social contact list if I refused to have anything to do with them because they don't share my hobby.
My husband doesn't read anymore except for required technical journals and stuff for work. He has several Master's Degrees, is actually a published writer of said technical articles, and makes a ton more in salary than I do. He also comes home every night and gorms out on Pawn Stars and American Pickers on the tv .... which I personally think is a strong argument for that "reduced intellectual capacity of non-readers argument" I see presented here and yet I suspect our High School IQ tests might prove otherwise.
No current plans to banish him from my presence but I'll keep it in mind.