I always specify the cover using the Calibre Editor once the files are imported, both text and images
Under Tools, Add Cover and just pick the correct image to automatically have the Editor insert a new xhtml file with the image referenced, and the semantics set
http://manual.calibre-ebook.com/edit.html#add-a-cover