You could try disconnecting the signal path somewhere just before the power amp - e.g. that 1uF/50V cap, or the 1K resistor, whatever is convenient. If it's still noisy, suspect IC3 or the supplies (less likely, the rails would have to be horrendously noisy to feed through the IC3). If no more noise, reconnect that 1uF and check earlier - maybe remove the two 10K between the OPL and IC4.
I was going to suggest to rule out the speakers and try with headphones, but that is a very large signal on the output and you risk causing damage. That 2V 50kHz tone has no business on the output...