That's because the line height at the leftmost has something like a value of 1.3, which is still fairly large. I just use the 120% default in calibre, which is slightly less than that.