Don't click on the buttons that take you there and the things you don't like will never intrude on your reading experience. I really don't understand why having all these things a click away bother people so much.
I have found one excellent reason to have the store accessible from the device. I use it to reload books that are I have bought from Kobo that are not on my device. I am one of those read it and delete it kind of people.