Does having a ground wire connected between a 485 to USB adapter matter?
It doesn't matter in a sense 485 works or not during your experiments.
It matters in a sense of emitted disturbances and being sensitive to strong external disturbances.
For the wiring I've done at home, all optoisolated RS485, I don't use a ground because it's running to locations that may have a different idea of what ground is
For optoisolated RS485 I understand the GND connection between them as connecting insulated side GNDs and not what you can have the idea as device ground.
In my opinion....
In optoisolated RS485 you have 2 disturbance sources:
- DCDC converter supplying insulated RS485 driver,
- RS485 driver itself.
When I used DCDC with 4kV trafo with very small capacitance (4.2pF) the DCDC disturbances and disturbances generated by RS485 driver (with about 250kbps limited bandwidth) are effectively suppressed by these small capacitance inserted in ground-loop so practically adding GND connection between RS485 drivers have no effect.
When I used just standard DCDC that needed be blocked by 1nF to limit its emissions at insulated GND side than I lost the suppressing action of 4pF for driver generated disturbances. The disturbance generated by driver (mainly because one line changes voltage little before the other generating common mode pulses) are now traveling in a loop through these 1nF. Adding GND connection (not devices GND but insulated RS485 drivers GND) gives to these disturbances the short way back along the A,B wires making the loop emitting them as small as possible.
The same way you can look at sensitivity to external disturbances. Having two 4pF in series in loop limits their current (flowing through A,B) much better than having there 1nF. When (thanks to 1nF) currents are bigger adding GND connection between insulated RS485 drivers makes these current be flowing through this GND connection making their effect on your A,B signals weaker.