You need enough delay to ensure that the "Set" signal passes thru all of logic to the other input of the top NAND gate of the flop.
Among other things, your answer will depend on the loads on the Q and QN outputs. You should probably put buffers on these to make the load a fixed value you can calculate. It also depends on the implementation (wire lengths, capacitance, voltage, temp, ......).
This is not a very good design style, there are edge triggered flip-flops for a reason.