With a 10 or 12 bits ADC and a 2-3 V FS range there is no need to worry about the amplifier.

I was thinking this too.
The voltage that you want to measure comes from the wiper of a potentiometer. What is the source of the voltage that is connected to the top of the pot?
I used a Sorensen lab power supply. Then I started using batteries. The battery's voltages were clean when I read voltages from the stack. Though the voltages off a POT were noisy. So what could I do about this? I am seeing numbers between 670-685 out of 1023. Average of ten of these numbers is 676.92.
You may want to look at a ratiometric design.
Interesting, I may do this.