Do you have Acrobat Pro or similar program that allows you to print to PDF? Have you tried doing it that way rather than converting through Word? Does it make a difference?
If your file would survive exporting to HTML from Word, I might try doing that, and then using
PrinceXML to convert to PDF... at least just to compare the resulting size.