As a recent Kindle newbie (mine is just under 2 weeks old), I don't regret my decision one iota. I have almost 40 books on it, not one of which I've paid a dime for. Some are from my local library (downloaded and coverted via the
Visual Kindle Guide wiki here on Mobileread), some free .pdfs converted through Calibre, and many more downloaded from Amazon (Random House free e-books) and the current "Read an eBook Week" promotions. There are lots of free book announcements here up in the Deals, Freebies and Resources forum.
I'm not against purchasing books I want and can't find otherwise, and will be doing so soon, but it's become a bit of an easter egg hunt for me to see how many books I *don't* have to purchase but still enjoy. I'm reading authors I never would have found before, genres I wouldn't purchase, but still enjoy, and generally feeling very satisfied with myself.
When I made up my mind to order the Kindle, I thought I'd be doing all my reading of purchased Amazon books. I now know I am not limited in any way to that, but still have their tremendous catalogue also at my disposal. This was an excellent purchase.