I sympathize. I'm a fairly casual and sporadic gamer these days--especially when compared to the gaming junkie I used to be who blew through Baldur's Gate in so little time that one of the two founders of the company e-mailed me for my thoughts.
I probably only turn my Xbox on for a few hours a month these days. Still, it's a good occasional distraction. I'm actually buying my 360 more as a media center extender than a gaming console.