[kovidgoyal]

If you want to swipe to turn pages, you swipe horizontally, not vertically. And swiping up/down to move between chapters is not confusing, it is pretty standard, for instance, all Kindles use it.