I think that is expected behaviour, but, not something that most people notice. You should be able to fix this with
USBDeview. Run that and uninstall all the references to Kindle devices. I don't know if rebooting is needed, but I would. After that, it should be OK.