I noticed this starting after I upgraded to Mac OS Ventura. These files are called "AppleDouble" files and they are created by Mac OS. I don't know why Mac OS suddenly started creating them on Kindles after Ventura, but it did.
Anyway, the answer is to run the dot_clean tool on the Kindle volume before unmounting it:
$ dot_clean -m /Volumes/Kindle
|