What you are really trying to remove (I believe) is stored location history. See: http://support.google.com/nexus/bin/...answer=2667502
There is a lot more under the link, but this part may be what you are looking for:
Delete location history details
Even if you turn off both location reporting and location history, your previously recorded history is still available to Google services such as Google Now.
To delete location history details follow these steps from a desktop computer:
Open a web browser and make sure you’re signed in with the account whose location history you want to manage.
Visit location history.
A page appears that allows you to view your location history for any date.
To delete all your recorded location history, click Delete all history.
Alternatively, from this screen you can delete a portion of your location history starting from a date you choose in the calendar.