Yeah, I guess if you were adding files often, that could be a problem...
I only add downloaded books once a month or so, if even that. I have several hundred already on my Kindle and of course the books that I order from Amazon transfer via 3G. So I didn't consider the 2 minutes or so for a restart as a big deal.