I suspect you'll need to use a battery - even if it's just a very small one. The solar charge controllers I'm familiar with all require a voltage source to function.
BTW - the included charge controller is just a cheap knock off of a Steca PWM controller