How about trying the Nintendo DS stylus ? I lost my original sony stylus too, and my NDS stylus fits. It never came loose despite much shaking and remains tight inside the slot. Plus it's dirt cheap and you can get it
anywhere. The only downside is that it's made of poorer material than the original sony one. Cheap plastic basically.