calibre always remembers last used sizes, if you want to clear out previously remembered values you can go into the calibre config directory and remove the file tweak_book_gui.json which is where they are saved (but be-aware that contains other settings as well, so best to make a backup first)
|