Yep, once they're installed you can delete the APK with no problems (unless you need to reinstall for some reason--I've found that they're handy to keep around and they're pretty small).