You need to use the ground of your circuit. Ideally the closest ground point to the signal you are measuring, but for low frequency designs it is not that important, any ground connection will work,
And by no means use water pipes. That's a way to fry stuff.