You know that when you are buying a new gadget you shouldn't talk about it in front of the old one. Usually they die of a broken-heart, but it sounds like yours has run away from home
Changing the password should be enough. There is key stored on the device so that it doesn't have to prompt for the password. But it should need to change with the password. And as meera said, remove the credit card details until you are sure.