I sometimes think people are afraid to admit they don't like a book that most people have given great reviews. I'll admit that I've felt strange about it myself, but being honest always wins out.
I'm always suspicious of a book with less than ten reviews that are all five stars. I feel like those are either from people who know the author or maybe "traded" reviews with other authors.
Don't feel bad and waste your money on an author you didn't enjoy the first time around. It's okay to be yourself and we all have different taste. There is nothing wrong with you, you are just you.