Welcome to mobileread ....
Perhaps you should have posted this question into the Calibre thread .... [ask a mod to shift it accordingly]
In the Calibre Convert panel for "Look & Feel" there is a check box for "Disable font size rescaling" - But I do not know what it does to the output ....