I also keep it, and while I've not been as good about backing it up to various places, I need to do that.
I don't really have many books I wouldn't want to keep. I don't buy them if I wouldn't want to keep them (or even download free books I wouldn't want to keep). If I'm not sure of a book, I get it from the library the old fashioned way.