The Color of Magic and
The Light Fantastic are parts one and two of the first book, practically speaking.
DO NOT start them on those! They are his weakest books. I have accidentally turned several people off him, permanently, like this.
My favorite is
Small Gods, but I think
Going Postal and
Making Money are also excellent starting books.
EDIT: Ninjaed! I quite agree.