Convert polygon to region,
Change region's layer to overlay.
There's no way to have it update automatically (when repouring the polygon). This must be repeated manually (or via script, I suppose).
Edit:
Specifically, it looks like you can't just convert (Tools / Convert / Create Region from Selected Primitives), because a poly isn't primitive. Try:
Select polygon
CTRL+R, click twice (makes a copy)
Make sure the copy has the same attributes (if auto-repour is on, the poly will be empty)
Tools / Convert / Explode Polygon to Free Primitives (this converts it to a Region)
get Region properties, set layer to Overlay.
Tim