create a soft start, have an input capacitor, that is connected to the motor rail, via a mosfet
when the capacitor has had a chance to near fully charge then connect the motor
i would imagine a p type mosfet with source to the capacitro and drain to the motor wire, and gate tied to the ground of your circuit
you then find a mosfet that switches full on at 1.5V or slightly less,
this way the capacitor is nice and charged up before you connect the motor, and the nature of the mosfet will even limit its draw as it passes through its linear region acting as a dropping resistor,