Another alternative is to open them with LibreOffice Calc, pretty sure it will handle UTF-8 directly.
But, I would probably open the CSV with Nirsoft's CSVFileView program, it doesn't have the mathematical functions of Excel, but it has enough for simple table operations, and it has a neat save as HTML feature.
BR
|