You are spot on!
I contacted the customer service (they have an email contact which makes this much more convenient for me than by phone), and they replied that they recommend a formatting of the internal memory.
In the meantime I've gotten hold of an SD card so I'll store by books on it in the future.