Now that I've looked at this cross-section of a "typical" SMA connection:

IMHO, as long as there is no debris interfering with the leading "ring" edge surrounding the plug's dielectric and the shoulder of the receptacle, finger-tight is all that should be needed to seat this connection.
I think a compact tool similar to a bicycle spoke wrench but with ears like you'd find on a water hose bib made with Delrin that slips over the hex of the SMA connector like a flare nut wrench just to give a better sense of "feel" of the slight leverage/torque that's applied is all that's needed to do the job of seating the fitting 99.999% of the time in a typical office/testing environment

I see no reason to put a scratch on the finish of that beautiful shiny nut with a torque wrench.
No two fittings will ever be the same, nor will any two connections.
The weakest possible link I see in that picture would be if you scored a ring around the copper/gold plating that's around the center conductor of the cable when the dielectric is stripped off.
I'd just make sure the shoulder of the center contact in the plug is flush or slightly under the surface of the dielectric.
If a better connection would need to be made, do away with the fitting and solder the cable directly to the board where it needs to go.
People are spending hundreds of $'s on torque wrenches for this
