here most geothermal is not vertical, it is horizontal over a larger area either plowed or digged down to ~1m
I've heard some use a well and circulate ground water, but there is probably lots of regulations because potentially
pumping stuff into the ground water would be bad
Yeah, depends on the soil. Horizontal is great in clay soil. Vertical is the way to go when you are directly on the top of bedrock; thermal conductivity of rock is OK for heat pumping, but it's impractical to drill in any other direction than down. AFAIK, sand is not the greatest soil type for ground source.
At least here, all modern (or at least legal) ground source systems use ethanol-water mix instead of glycol so that the leak does not pollute ground water. Not even propylen glycol is allowed. Another, possibly the actual reason for using ethanol is lower viscosity because pumping losses in such long piping (possibly in excess of a kilometer!) are significant.
Nowadays it's sometimes hard to get permission to build ground source systems here especially in the presence of ground water but I think it's more about politics than any actual reasoning. I.e., ground source companies have not invested in lobbying hard enough, which is what you need to do if you want to run any business in the Not-Allowed-Land.
Having a river or a big lake nearby is really the most optimal case for low-cost high-efficiency ground source heat pumping but few have that luxury available.