I think I have found the culprit. One of the lines in my cable is carrying a control line to powering an LED (typical green LED that indicates the equipment is ON). I disconnected this line and voila, noise gone.
This is a typical LED circuit, anode is connected to 3.3V, and I control the LED state via the cathode. Something ODD is going on.