It might not hurt to remember two things: 1) Much of what you hear about an author is coming second or third hand (from people with their own agendas), and even what you may find out first hand does not always include the full context. (As is the case with much written correspondence, including this forum.) And 2) Anything actually true you learn about a particular author may simply because they choose to be open about their opinions. You might like to ask yourself about all those authors you are "financially supporting", about whom you know nothing.
Oh ... and a third thought. If I refused to credit powerful ideas from any person that sometimes made mistakes, then I'd still be looking for someone to credit.