It depends on how long the OCXO has been sitting around unpowered. Right now it'll be undergoing an accelerated aging process of sorts, in which it is likely to be drifting significantly more than usual. There could also be some noticeable frequency jumps during this period. Calibration will largely be a waste of time until it settles down.
24 hours minimum, I'd say. Better to wait at least a week before assuming it will meet its manufacturer's stability specifications. Some of them will take longer than that to stabilize, but can still turn out to be good OCXOs in the long run.
Example -- a 10811-60111 OCXO that I purchased in an eBay lot a couple of years ago had been sitting on the shelf unpowered until I needed to replace a bad 10811-60109 in a 5061A Cs standard. I thought it made a pretty good demonstration of what can be expected when an older OCXO is first put into service.
After an initial 48-hour burn-in period (not shown), this is how it behaved over the next 10 days:

Drift falls below the 5E-10/day spec within a few days and ultimately ends up close to 1.5E-10/day, but it's still not quite done settling down. There would be little point in calibrating it during the first week of operation after long-term storage.

This shows how the OCXO's ADEV evolves over time, one trace per day, from lightest=earliest to darkest=most recent. For the first 24-48 hours it drifted so much that the ADEV was meaningless. As the first plot suggests, it's still slightly jumpy towards the end of the run, but the overall trend is improving.