calibre will make copes for its own internal use, much like iTunes and its "consolidate files" option, except with calibre it is mandatory.
Simply delete all the old copies, and rely on calibre to manage things, and if you need the old folder structure for some reason, you can use Save to Disk.
See
the detailed explanation for why you might prefer calibre's way.
