Without knowing more about the setup, I would say, as a general rule:
Include a "bulk" electrolytic capacitor on your PCB, if possible, one per rail. They have ESR, which helps dissipating transients, they provide current when it is needed, they reduce the current spikes, and intermittent voltage drops on cables.