At a glance I would say the main problem will be the DIP-8 IC adaptor PCB. It has very thin PCB trace to connect between the IC and the 8 DIP pins on the breadboard. Secondary problem would be testing such SMPS on breadboard in general instead of layout a proper PCB according to manufacturer's recommendation.
If you are just testing the design as a quick proof of concept only, you could try soldering wires directly to PAM2423 IC pin1 for supply negative and 2,3 for supply positive. This will greatly improve the situation. However, this cannot eliminate the effect of the thin PCB traces between the power inductor connections. The best way is to solder wires also to the inductor and connect them directly to the IC pins.