I think charging racism is a bit strong. No one I heard was saying anything against you personally about downloading whatever you want. Just because people don't agree with you I do not believe it should descend to claiming personal attacks.
The people who generate the books would like to have some control over their work, which is considerable. It seems to me that the idea of massdownloading causes a lack of control. They will no longer feel that they can understand and be appreciated for the work but the work just becomes another number in hoarding hundreds or thousands of books. The system works today with every download representing a vote of confidence in the person doing the work and shows interest in the types of books being worked on. While the claim is that there may be a way to statistically figure out what books are being downloaded with additional effort the idea of mass downloading means that many may not ever read the eBooks so whats the point?