My bad, looks like this is the pdf's problem. I was using the default reader from the device and the font was fine, so I was thinking that's KOReader’s fault, but I just found out that the default reader was reading a different pdf without this font issue. I am just stupid