@WillieFleete: You know, I have been scratching my head at why the amp does not have a ground included. I have a Yamaha receiver in the living room that does require the third ground pin. I guess they figured it was not needed back in 1989? I am wondering now if maybe I should ground the amp case to fix the problem. It is metal so I am assuming that the amp boards ground themselves in one way or another to the amp's case. Off to Google I go to check out your idea.
All of the PCs however are properly grounded. All of the PCs use Antec ATX standard supplies and all supplies are no older than 3-4 years old. They are are properly grounded. Some of the peripherals, however are not, such as the switch, kvm, router, etc. Those devices should not matter directly as they are not part of the audio system.