The issue with remembering bookmarks and the last page was resolved when I replaced the SD card delivered by Bookeen with one from SanDisk. The same has been reported from others.
I have started on a
wiki entry for page numbers, that could need further contributions.