I've used Telit modems, an HE910, 3G, and LE910 LTE Cat 1 - they are 38 and 36 USD in 180 quantity, not sure about single price, that also for the Aus version. They have a serial or USB interface. They can be bought as a BGA or they come as a mini PCIe module (increased price), which has a USB interface. They do also sell a version in a little extruded aluminium case with power and USB.
I've heard good things about ublox devices, I believe they are cheaper than Telit units, not sure about USB though.
Depending on whats running on the logger, what about an off the shelf USB 4G dongle from any of the main telcos?