An app is an application. A widget is typically a shortcut to an application (like a shortcut in Windows terminology). However, some widgets are "active", like the sidebar gadgets on a Windows Vista/7 desktop.

To add widgets, tap-and-hold on the home screen and go from there.