You should be fine riding year-round in Georgia, with proper gear. I did it when I lived in SC (Aiken/Augusta area) and I don't regard myself as a particularly hardy soul. It's perfect riding country, as already mentioned.
An electric vest and some extra leg covering (overpants or chaps) are handy on the coldest days (in addition to the usual boots, gloves, and helmet of course!). On a bike, hypothermia can occur in weather that wouldn't bother you on foot, and it will affect your mental acuity, so be careful.
I second the recommendation for the Motorcycle Safety Foundation training course. Your local bike shop can tell you times and locations. It's a great deal, since you get to practice and form the right habits on somebody else's bike.
