Yes, even at 20 MHz a current source charging a capacitor is likely going to be your best bet. However, everything needs to move fast, and you're going to have to put a lot of consideration into things like switching (when you switch on/off the current source, you'll couple in charge through the capacitance of the switches...)
There were some old function generators that could take their triangle wave/ramp this fast - not many, but a few. Wavetek made a couple, IIRC. Look for service manuals for ideas.