@SwimmingTiger
I like it!
It looks a little like the setup I had a year ago. I used a simple web page that shows my desktop (a printscreen image, segmented in multiple small images), and the webpage would just refresh the images that changed. So I was able to interact with my desktop like that.
But it kept krashing. Yours is better.