Thanks for the HTML suggestion. I actually have a few websites for which I do the HTML myself using NoteTab Light so I'd be fine editing the font tags but actually I think I got it to work with Calibre!
Maybe this will save the next person a few hours worth of work. In Calibre conversion I clicked the Wizard button and picked these settings: