If the pad spacing permits, use axial caps side by side, mounted vertically, with the top leads bent over 1/16" from the body and soldered together.
If its too tight spacing to do that then its going to be a bodge job. Post a photo of the PCB top and bottom sides, and of the capacitors to be fitted, and give their dimensions and the distance between holes on the PCB, and we can make some suggestions that may or may not include drilling some extra holes off to one side.
OTOH its probably preferable to get one capacitor of the correct value and voltage rating to replace the series pair, or possibly the next lower preferred value and make up the difference with a capacitor in parallel if the value is critical.