HP 95LX and used a Nokia Communicator as a modem - to remote access some of our servers
I did it too!
Back to 2000, I used a PalmV with a keyboard to remote access my server over an IRDA link.
The PalmV only has one serial, and it was already used for the keybord, the IR port was the only possible solution.
Hald duplex, with the physical serial line of the CPU shared between the keyboard and the IR module.
Not optimal, but with a large buffer and special interrupt handling, it somehow worked.
I wrote an application with the Palm SDK for PalmOS to emulate a sort of vt100.
Although writing UNIX commands was possible, it only worked if you didn't use pipes and the commands were very short.
This is because the screen has a resolution of 160x160 pixels.
VIM never worked for me. I used SED, and not without tons of frustration.
In short, it was very limited.
Nowadays, we have larger LCDs, and a tiny 160x160pixels LCD is fine on a router.
However, even at 800x600, a 5" LCD is a terrible idea to write a C program, or bash/lua scripts.
The minimal setup is 80 columns, but your eyes need a certain surface area, and a certain distance from the screen.
So you need screens of at least 10" or 12", anything else simply won't work.
Now, a cyberdesk is supposed to be used for that: programming/scripting/hacking.
So, every implementation with similar small LCDs are simply not adequate.