I also think that it is good as it is. It makes repairs a lot easier if you route on the outer layers, as tracks are accessible, and you need this for a prototype. Routing is only done on (only) inner layers if the density is so high, that there is no space for the tracks, like a mobile phone. But than you have a 6 layer board at least.
Ground should be next to the power plane, and next to the signal plane having mayority of the tracks. I dont think you will have too much signal integrity issues with this, only take care about the USB. One other thing, is that an antenna on the top left corner? That also requires extra care.