Funnily enough I just did that recently. It has some significant limitations. Depends on manufacturing tolerances too, of course. And you'll always have a copper gap for solder to bridge (which can be fine for very cost-sensitive applications).
If you really want to install at right-angles (and it would depend on the antenna - you'll need to check the datasheet), then personally, I think you'd be far better off creating a small carrier board, and solder it flat onto that, and then use a right-angle pin header; this would be far more cleaner.