... however, if you use a DLL, the minimum input is 5MHz, so as log as you use the DLL you should be OK.
The DLL can only generate a single frequency, Maybe first use a DLL to generate the 184,32 MHz, then use a PLL after that to generate the clocks you really want.