If this is Amazon and Kindle devices, then you need to delete them from the
MYK page, and also delete them from your device(s). They will, then, eventually disappear from the All view on your Kindle.
As for having to add items back after you reset your device? That's what Calibre is for.