I've owned both. I think you'll prefer the Nook, for just the reasons you say. Now that I've used touchscreen devices, D-pads seem barbaric.
Make sure to get Calibre to convert your Kobo books before you sideload them, though. (You'll have to remove DRM and do an epub-to-epub conversion to get the covers to show up. Only drawback, really.)