With RF modules and a relay and an external power supply, it's dead easy. Too easy: relay, usb psu, esp8266, hookup wire.
Raise the challenge by using triac and putting the psu on the board. Do multiple channels. Measure current to send an email if the light seems to be burned out.
Don't forget safety, protection, creepage, etc. Imagine doing this not for yourself but to give to a total stranger who your device just might kill.
Raises the project bar significantly, if you're into that sort of thing. :-)