I think I've seen this in azw3 books bought from Amazon. The only way I know to fix it is with Search/Replace. Probably not the slick ingenious solution you were looking for
I use the calibre Editor which, I seem to remember, flags all these "rem" font-sizes as errors in Check Book.