Bob, thanks for your reply. Fashioning an antenna to match the frequency sounds like a tedious and imprecise solution. But maybe that's the best that can be achieved for non-contact measurement. Your advice matches what the Amazon reviewer said. No wonder all the examples I see of RF measurement have a direct connection!
So I guess I need to follow industry best practice and make a direct connection to the transmitter. Since my transmitters don't have an RF output plug/jack, can I simply wrap a wire around the transmitter's antenna? Or do I need to make connections to the contact points where the antenna is attached to the transmitter's PCB board?
Update: I just realized that I need to measure the signal strength, which results from both the transmitter's output power and its antenna design. So I'm back to performing a measurement by antenna. I just found this ImmersionRC unit which costs more, ~$150 USD, but has better reviews.
http://www.immersionrc.com/fpv-products/rfpowermeter/