So when Q1 turns on I need other transistor to disconnect the output of the op amp or something like that?
You have two control loops. Disconnect the current loop for now, and debug the voltage control loop to your satisfaction.
Once you have voltage control working, you need to decide what should happen with the current sense limit is reached. Do you want the maximum voltage to top out such that the set current is never exceeded? If yes, then you need to put on your thinking cap, because you cannot just switch off the output (even if the direct connection between Q1 and U2 worked), because doing so would cause an oscillation.
1) Current limit is reached, and Q1 trips, shutting down the output of U1.
2) Input current to U1 is now reduced to close to zero, causing Q1 to stop conducting.
3) Output voltage of U1 races back up to its set value, causing the load to draw too much current again.
4) Goto 1).