With a 10k pot, depending on the position of the wiper you can seen an equivalent of
- 5V with 0 ohms in series (i.e. the wiper at the 5V end),
- 3.75V with 1.875k in seres ((i.e. the wiper at 75% , 2.5k Ohm to +5V and 7.5K Ohm to 0V).
- 2.5V with 2.5k in series (i.e. the wiper in the middle, 5k Ohm to +5V and 5K Ohm to 0V).
- 1.25V with 1.875k in seres ((i.e. the wiper at 75% , 7.5k Ohm to +5V and 2.5K Ohm to 0V).
- 0V with 0 ohms in series (i.e. the wiper at the 0V end)
If you want to stay within 1% of the wiper setting (e.g. so 50% gives 2.5V +/- 25mV) you don't want to be sourcing/sinking more than 0.01 mA from the wiper.
If you are sourcing 70mA, you will be off by about 10% with the wiper in the middle position (around 2.26V vs what should be 2.5V).
Easiest solution is to use a potentiometer with lower resistance (maybe go 1k)