TDR isn't especially hard and can work well.
Thanks for the swift and comprehensive reply!
I was attracted by the TDR idea, and perhaps I'm simply lacking confidence. But I have never designed or built anything to operate above a few tens of MHz, and for TDR (thanks to necessarily quite short transmission lines), I think we're talking GHz. I don't think I'd know where to start! Back when I first learned about electronics, VHF was pretty esoteric and UHF about the limit (for a hobbyist at any rate). For GHz work one was looking at waveguide rather than wire.
Weighing it is a pretty good idea as just mentioned as long as you do the right kinds of averaging to look for gain/loss due to moisture and not transients like wind / vibration and not long term changes like seasonal growth / shrinkage.
I can imagine that it would work. I just can't quite imagine how I'd implement it, nor operate it without constant recalibration as the plants grow.
If you used larger geometry electrodes at larger spacings you could be more sensitive to the bulk of the material moreso than a small interface layer around a small electrode dominating the measurement.
Yes indeed - for my first resistive experiments, my carbon electrodes were at opposite sides of the tub for that reason. My capacitive sensor was a length of bell wire - twin cable where the two conductors were linked with a very thin sliver of material, so most of the gap between the cables would have been soil rather than PVC or whatever. And that length of wire had to be quite long to get a reasonable capacitance to monitor. But I found large spacings meant more difficulty tracking changes against noise due to the lower capacitance.
You don't have to have an oscillator which is varied by the C of the soil, you can have a fixed oscillator (e.g. output from a MCU through a buffer amplifier) and measure the impedance via an impedance bridge or phase / voltage kind of measurement of the terminals of the oscillator between each other to see what the R, C, L of the soil is compared to a reference resistance.
That was what I tried first - and it did work - but I found it easier to avoid noise and drift if all the sensitive electronics was shielded and buried under the soil (limiting temperature fluctuations as well), with only a DC measurement (current draw) being presented to the remote 'control unit' and pump switch. The variable oscillator approach turned out much simpler in the end.
Altered conductivity due to ionic content is something you'd have to contend with if using most resistance, EM loss, or impedance based measurements if you expect the conductivity to change substantially. Depending on the soil's degree of pH buffering and stability the pH and conductivity of the moist soil may be pretty stable or not and I guess the optimum depends on the fruit / vegetables you're trying to grow.
Yes - that is the big problem - all the others I can overcome. The variability turns out to be quite high. And I really want to avoid the need for frequent recalibration.
Since you probably only would be needing to take measurements a few times a day your power consumption shouldn't be a big problem since even if you used 100 Watts during a measurement (arbitrary large number) if the measurement only lasts a millisecond that's still only 100mJ and 12*daily that'd be 1.2J or 1.2 Watts for 1 second, so nothing problematic for solar power. Lots of impedance bridge or other driven sensors are excited with powerful signals during the measurement but the measurements are pulsed so overall there is low power consumption. Just have a suitable capacitor or small float battery or such available to provide the the peak power and overall the solar would be enough to keep it going for the long term.
yes - that is something I think I'll need to implement with any of the ideas currently on the table - all will use too much power for 24x7 monitoring. I'd like to solve the other problems first though! Looking at the weather here, I worked out that the device should be designed to survive over two weeks of heavy cloud with minimal solar power, on battery only, without discharging a small (1-2 AH) lead acid battery more than (say) 50%, and be able to recharge fully in maybe a week of decent weather. That should give a manageable energy budget with a timer and a small panel.
You could put a bluetooth low energy RF modem on it or Zigbee something similarly low power and intermittent and it'd be fine for energy.
I planned on doing something like that at first (using a Wi-Fi module), but changed my mind when I realised that I didn't want the system dependent on a computer running in the house. The only other reason for linking up would be instrumentation, and I can go out with a multimeter for that, given exposed test points.
If you measure the impedance (phase and voltage amplitude) you'll be able to sort the C from the R component. Even more so if you can measure over a few octaves of frequency so that you can look at the change of impedance vs. frequency at a few discrete frequencies then you'd get a certain set of data that should correlate well to the different components and causes of the loss.
I need to think about separating C from R by looking at phase - something I hadn't thought of before - perhaps it offers a relatively simple solution (thank you

)
I did think about taking measurements at two widely separated frequencies, and worked out the calculations involved. However, I have been trying to do this 'old school' with analog electronics (and through-hole construction), and to set up the calculations that way, while possible, starts to get complicated and finicky to get right. Although I've had a career in IT and am a fluent programmer, I've never attempted using any kind of processor in my electronics. I'm sure the programming would be no problem, but I'm equally sure there'd be quite a learning curve in actually setting everything up for the first time, and I was hoping to design and build this thing in a reasonable time!
I need to stay 'real' - if this gets too involved and expensive, it gets hard to justify doing it instead of just remembering to go outside with a watering can!! This is interesting, but it can't take over my life!!