For pure CLI stuff, tmux + SSH +
https://github.com/llandsmeer/inkvt definitely works.
(As in, start inkvt, ssh to desktop, create tmux session. Switch to desktop, resume tmux session. profit).
Probably works the other way around, too, but my brain is shot, and I ship tmux and OpenSSH w/ KoboStuff anyway ;p.