Tough to say, I think the USB VNA is a much better instrument overall, smaller, simpler, more powerful software, more reliable, faster.... but having the other is nice. Do you see yourself working in that 6-10GHz band much? The higher bandwidth does open up some nice potential options, but in addition to the cost of the bench space, the reliability concerns, and the initial cost of the analyzer, you're going to need a full new set of RF plumbing and SOLT calibration kit to really get proper use out of it, so the extra expense can be considerable.
Aside from wanting to have neat equipment and just amassing it (see TEA thread), I see two good reasons to keep the HP for use:
Designing parts above the Tek's 6GHz bandwidth (the obvious one)
Testing high bandwidth rated parts and accessories for potential resale
The extra cost of the cables and calibrators is a two way street, if you can use your new decked out high bandwidth VNA to verify parts for use in those bandwidths, there's probably a good margin available, since few people have equipment with that bandwidth in good nick to actually test them out properly. You'd need a source (or just a big pile as a one off) of such RF goodies, but if you used your VNA to validate high frequency cables, cal kits, attenuators, filters, etc., you could probably justify keeping it around. In the same token, you can use a really wide bandwidth VNA that has the proper accessories to validate anything else RF you're working with to a reasonable degree of certainty, which could potentially be useful.