I keep them... no reason not to. I especially keep the original format in the event that I may need them for something else. I may not use a Kindle forever and I may need to convert to another format.
Not only that, I dont buy all my book from Amazon