If you haven't removed the rubber cap from the potentiometer, you can safely do so. If there isn't any grub screw holding the cap to the shaft it's almost always simply press fitted. At that point, you can see if there's a panel fixing nut. By loosening the nut, the potentiometer will be free and you can pull it out from the inside of the case.