Settings>Applications>Manage Applications

Tap the application you'd like to remove, then tap "Uninstall".

Maybe someone else can tell you if this removes all of the data or if there's any residual info you'd need to delete.