I'm actually looking at the possibility of implementing a Xen hypervisor on my next PC upgrade, with a unique configuration. The idea is to use the dom0 to run all of my graphically non-intense programs in Xpra screens, and then have them automatically reconnect whenever I launch a domU, thus allowing me to swap userlands immediately, but retain all of my programs. This also allows me to run graphically intensive Windows, Linux, and Android programs, the sorts of things that aren't easily usable on just Linux.
As for insecurity, these are hackers in likely closed environments that are given access to the machines. While these exploits are far from good, my guess is a lot would have to go wrong in a network to have this sorta thing take place, like someone running arbitrary code on your VM, which might as well be game over. VirtualBox has always seemed incredibly limited, and just awful in comparison to options like QEMU/KVM. They might be nice for a quick VM where someone doesn't want to mess with stuff, but right when you get into things like wanting SPICE over the network or the wonder that is libvirt, I've found it to become restrictive.
As for VMWare, it's a nightmare on Linux, and a nightmare on ESXi. That's all I'll say.