I find it rather incredible that Google's maps would misplace your current location. The GPS data used by both apps is identical, which means that Google's graphical overlay would have to be off by 5 blocks. Unlikely, IMO. Can you show us this in action?
I am not in Japan, but I have heard from several people that Apple's maps are (were?) particularly weak there.