I appreciate the replies, guys. Yeah, the HP manual can be little confusing with the D-Sub connectors since they try to cover the 54657A, '58A, and '59B in a single manual. It threw me for a loop too, TK. Elecman14, thanks for linking in the ke5fx software--I was trying for the life of me to remember the name of that package!
Well, I managed to find the problem. As I expected, it was both simple
and stupid, although at least it didn't have anything to do with me! You guys are going to love this one...
I took the scope into work today to test out some other RS-232 hardware and see if I could isolate the problem. The results were the same as before: no connection sending or receiving, weird behavior with the hardware handshaking pins, etc. My colleague suggested that we try to probe some pins and attack the problem from the hardware level, since nothing on the software side was helping. Per the 54659B manual, the DCD, DSR, and CTS lines are all held high by the scope via pull-up resistors. At the very least, those pins should be high... and only the DSR pin was.
Suspecting that maybe the RS-232 driver was blown or the pull-up resistors were fried, we took apart the controller to check things out. Can you find the problem in the picture below?
It only took a moment to figure out what was wrong. The damn DE-9 connector wasn't soldered in! This is a genuine HP expansion module that completely missed its quality control checks. In the close-up shot, it's clear that this wasn't a failed repair by an end user--those pads look freshly plated with no hint of solder or flux reside.
Needless to say, I'm glad this was an easy fix, but I'm amazed that this was the cause of the issue. I know these things happen from time to time on any production line, but more interesting is the "Instrument Tested" sticker on the back of the board. This thing was clearly a Friday afternoon job that slipped through the cracks.
At any rate, all is well now. I can verify that the plotter function does actually output serial data, I can control the scope remotely with the various programming commands, and I was even able to get an old version of Agilent IntuiLink to work under VirtualBox running Windows 2000. Sometimes the simplest of problems have the stupidest of solutions!