Touch wood - mine has never not powered up, regardless of FW version. Perhaps you should leave the USB plugged in to charge the battery it may be as simple as that.
Also, there is a PCB mod to turn off the red LED when the charge is full so you know when you actually have a full charge.