The big question is what kind of electronics do you want to do?
I'll second Simon, a spectrum analyser is a niche bit of kit, useful for RF development, but not much else besides; if you're doing RF work, most the the usb oscilloscopes won't have the bandwidth to see most RF signals. As for USB equipment, it tends to have compromises in it, in particular the cheaper stuff will have inferior analogue front ends compared to a decent scope. Also, I've used bitscopes, picoscopes and the stingray oscilloscope, and having to use a mouse to change settings always becomes a pain.
Personally, I'd say the times its worth looking into a usb device is if you need to carry it around every day, and have to fit it into a laptop bag or suchlike, or if you're only going to use it occasionally. Beyond that, get a good analogue scope if you're looking at repetitive signals (analog circuits etc), and a DSO is particularly useful if you want to look at digital data, capture single shot events etc.