Ahh, "first surface mirror", that's the phrase I was missing.
Doesn't look like they're "easy" to buy (as in I need to order internationally), but if one believes what they read on the net, it shouldn't be hard to remove the back coating off a normal mirror with acetone and use that.
Might try with some cheap acrylic mirror first...