Ah, thanks!
I couldn't quite understand why I'd never had this problem when I've had Kindles for years and I've always sideloaded my books, but that's because I always have my Kindles in airplane mode. Except for now since I was hoping it would update on its own since the manual firmware can't be downloaded at the moment.
Put it in airplane mode again and the issue is fixed.