I would say yes for the fact you are shorting the terminals of the capacitor together, you may want to rethink what you have drawn
A capacitor with very little load can remain charged and then added to a circuit, just not in this case,
It also depends on the size and type of capacitor for how fast it would self discharge, as most capacitors have self leakage, its a small amount for most,