Can you get the job done with a super capacitor? How about a primary battery that you change every few years, because you'll probably be changing your rechargables that often anyway.
I've been strongly considering and looking into just using a supercapacitor. It seems to check the box for reliability and safety. It's easy to predict, and simple to deal with. I'd definitely have to regulate the voltage somehow but that's no biggie. The only trickier part is finding a way to do it without large quiescent currents sucking up useful power.
As for the primary battery that i just recharge every few years, I was initially looking into using i lithium ion cell like an 18650-30q as the main power source. by my math, it'd last just over 2 years in an ideal scenario, but theres a few caveats for me.
1. I'm too lazy to charge a battery ;P /s
2. Since I'm strapping this to the side of my house, I'm not super confident in the safety of a circuit using a lithium ion without an proper battery management system. I don't want to burn my house down.
3. I really love the idea of self sufficiency and autonomy of solar power. It just feels so simple and elegant having it all run on its own.