Pick a book ENTRY in Calibre: Tap 'O'
Do you see a 'cover.jpg. ? (Change nothing. Just close that explorer window)
That was where Calibre puts the covers it uses for metadata, so the others are safe to delete.
(Another reason I don't want W11. Unwanted help.

)
Do you use Edge to download? change the setting in Edge: (see image)