Honestly, if I were to start my ebook collection all over again, I'd buy fewer books. I'd go for a lot more on demand purchases and a lot fewer for inventory.
Other than that, and absent the coupons and deals that drove so much of my buying, I'd probably get whatever public domain edition of a work seemed to be the best formatted and for purchases, I'd go to Amazon, as most likely to be around for the long haul. But that wouldn't be important when buying on demand.