I read at all heat levels, though not as much toward the really erotic end of the spectrum.
I've had people (family and strangers) comment on what I'm reading as I'm sure most of us have. When I was younger I used to launch into a defense of the genre. Nowadays if someone makes a snide comment, I just say "That's right. And the next time I read a mystery I'm going to use the plot to plan a perfect murder." One time I asked a lady if she wanted to be the victim
I think you just reach a stage in life where you really don't care what anyone else thinks, at least about stuff like what you watch or read. It can be a hard road to get there, but very liberating once you do.