Originally Posted by HarryT
That's why I only ever add and remove books using Calibre. That way all the folders and auxiliary files are also removed.
The O.P. also mentioned "would like to do it on the Kindle if possible".
And it might indeed be possible, since we could **presume** that the user knows if the book is "local only".
Note: Purchases from Amazon are never "local only" even if side-loaded via a PC since Amazon delivers the purchases to the device's cloud(let).
In which case, the local generated files should not be deleted.
But the Kindles have that "purchased" logic (somewhere) to control the display of the "personal" banner on the cover thumb-nails.
all-in-all, a tough to "get it right" sort of management operation.
but with more feedback from the O.P. - call it a "maybe we can".