You can add a large amount of hysteresis to your comparator, so that after tripping, even zero current will not turn off the output. Then, add a pushbutton to yank the appropriate input of the comparator to the appropriate level to 'reset' it (overriding the effect of the hysteresis).
Even if you are not up to calculating the input and positive feedback resistors, a few minutes of trial and error with a simulator should get you there. Once you have the resistor values, it is a very simple modification to your existing circuit, just adding or changing two or three resistors.