This happens to me, too. My current theory is that my finger makes a tiny right-ward motion (as suggested by ZodWallop) and the Nook thinks I deliberately swiped right. I just use the buttons when that happens. The buttons do work correctly.
I think I said that correctly this time.