Long-press one of them, then drag to the grey "pull tab" thing that normally opens the app menu. It will remove the icon, but have no effect on the app.