Here's my standard list of free ebook sources that I post for newbies:
Public Domain
MobileRead - best formatting, limited selection (hand-built by MobileRead members)
ManyBooks - PG scraper, but sometimes has books from other sources, good formatting
Feedbooks - mostly scrapes PG, improves formatting
Project Gutenberg - the granddaddy of them all, phenomenal selection
Munseys - painful to use, but has books nobody else does
the Internet Archive - generally only the scans are readable
Google Books - most of the time, what's good isn't free, and what's free isn't good
Free non-PD
Baen Free Library - amazing selection; also, they
will tempt you into buying books
5th Imperium - Baen CD collections
Other Things
Search:
Inkmesh. Sadly, it's not a very comprehensive search engine, at least when it comes to free ebooks - it misses a lot of them - but as far as I know, it's the only ebook-specific one out there.
If you're using free ebooks, it's only right to give something back: proofread a page a day at the
Distributed Proofreading Project.
P.S.
I almost forgot: get
calibre. Its support forum is a few boards down from here.