I've solved the whole problem by never discussing the books I read with anyone whose opinions I want to continue giving a damn about.
But seriously... it usually just doesn't even occur to me to care about what someone else might think of my reading preferences. Reading's always been a "hurrah for me and f*** you" type of event anyway. I'm perfectly content to have my favorites all to myself.