It's indeed real close to the UTF-8 byte order mark.
Wikipedia BOM says that one is EF BB BF.
Still, all other errors are gone now that I opened and closed all files with specified encodings both in Perl and LaTeX. So unless I run into other problems, I'll just have to filter the codepoints out.