Well, start with the basics. Is the switch actually ok? Because many a PC engineer has been caught out with bad case switches. (Me included!)
Second, you say it improved moving USB stuff about. It could be to do with which USB's get powered with what. A PC PSU is actually TWO PSUs, there is an always on one when AC is supplied +5Vsb, and then there is your main one with all the major rails, +12V +5V +3.3V and -5V (I think, or -12V, one was removed in the revised ATX 2.1 spec).
Now, some motherboards will power some USB ports from the +5Vsb, some only power from the +5V, some boards let you choose where some ports are powered from. The +5Vsb supply is limited, it can be anywhere from 1A - 3A (higher on better supplies) but it is possible if you have high draw USB devices to overload the +5Vsb, and in some cases it'll prevent starting cos it sags or trips out on protect. Though you usually need to remove the AC and restart the PSU if it's in protect.
Anyway, its a long winded way of saying, make sure you know which USB ports are being supplied by which power rail (I should be in the manual), and figure out how much the +5Vsb can supply (PSU manual), and how much your USB devices are drawing. (RGB keyboard by any chance?)
Hopefully that gives you a place to start.