Here is what I have now. This one avoids having buttons that change labels and positions.
When you go into book details you see something like this:

"Set date read" is broken onto two lines because the emulator I am using is a very small screen.
When you tap "Change" you see this:
I will release this to beta in a day or so.