Welcome to the (Reluctant ) iPhone Owners club
Sorry to hear about your poor experience with the Fuze. I've tried out the Unlocked version sold directly by HTC as the Touch Pro, and that one was quiet good, with pretty limited bloatware.
I Admit that the Touchflo was a bit maddening, but some people seem to like it. I was going to get it or the Xperia X1 but lack of availability when I needed it meant that I decided to go with the iPhone 3G 16Gb Black.
Its a bit of a culture shock, at first as I've been using WM Smartphones for quiet a few years, and have gotten used to how things work on it. WM does allow you to have more control, but at the expense of some ease of use. Oh well!
You'll enjoy
Evernote, I think, as its quiet handy to have the desktop client installed, and be able to edit and modify the notes on a larger screen, and proper keyboard, and be able to access them on the go. The only drawback I've found is that that the iPhone client apparently doesn't cache a local copy, so if you are out of range or on a slower connection, you're out of luck.
You Might also want to try out
Files lite. its a free version of the Files app, and allows you to store your documents on you iPhone. It has suport for most of the popular document formats, so is quiet decent. And getting files on it is easy enough, and it provides a step by step guide on how to set it up.
Fringe is a nice IM client, with support for Skype and other VOIP protocols over Wifi so might be worth checking out.
For the Music,
Shazam is good at identifying music playing, though i've found it a bit Hit and miss with some somewhat obscure tracks. Still, it should probably be fine with anything playing on TV or on the Radio.
Another good music app is
Midomi, which allows you to either just say the name, or by singing or humming part of the song or by grabbing it like Shazam from the TV or radio.
There are a ton of useful and free apps, but the drawback is that a lot of them tend to not work that well. Still its a lot of fun trying them out.