Yeah, CR2032 is not great choice for high momentary power device like remote control. It only works if you do not use it, sort of catch 22 situation
No, they are great for low power devices that never draw more than a couple mA on occasional peaks and a few uA otherwise. In that case, they have a pretty long lifetime compared to alkaline batteries.
A lot of such devices exist. Watches, simple calculators, low power sensors, ...
Another benefit is that they are well sealed. Alkaline batteries, even from the major brands, will end up leaking after only a few years. I don't think I've personally ever seen a lithium coin cell leak even after a couple decades. At worst you'll see some oxidation on the shell.
To each application the appropriate type of battery...