Yes, I think they did screen rotation but I never bothered. Ditto with Linux.
I had the Star Trek-style flip-up hard cover so portrait worked best.
Plus I *loved* the side-mounted rocker switch for paging. Beautiful ergonomics.
The Firmware was PPC 2002/3 which is still supported by a lot of apps.
Battery life was decent, for the time.
Hmm, here's one review:
http://www.thenakedpc.com/al/jornada560.html
I think I saw one on ebay for under $60.