The problem with tantalum caps, which can bite you if you replace them, is that they can develop microscopic, internal shorts when heated for soldering. At the factory, they bring up the voltage with current limiting, allowing the shorts to build up insulation, without catastrophic damage, solving the problem.
When you do rework on your boards, replacing the caps, you should do the same thing. Put a 100 ohm resistor in series (by whatever means you can), then turn on power. Once it has been on for a few seconds, the cap will have healed any shorts. The trick now, is to remove the series resistor, without heating the cap again!
I use a tantalum cap on a board I build in the thousands. Initially the factory didn't tell me they were seeing lots of failures on this part (which was a bit pricey for a cap at $2 ea). When I found out, in particular, when one failed nearly burning the board, I did my due diligence. Better late than never, eh?
There are lots of app notes on this issue by the cap makers. The universal wisdom is what I've given above. Tantalum caps need to be "broken in" with current limiting. Once that is done, they are very reliable with high MTBF numbers. A 1 uF, 35V tantalum should not be expensive, or large. Mine were 150 uF, 16V in a surface mount package.
I have a test fixture that already had a very small value series resistor to measure the current. I swapped that out with 100 ohms. It also has a jumper to bypass it, so this is a perfect setup. I don't think that will work for you. Maybe make a break in a trace you can solder a resistor over, then solder a bit of wire, when done?
Oh, option 1 is not a bad choice either. I'm from the school of, "If it ain't broke...". Tantalum caps do not develop a high failure rate with time, like electrolytic caps do.