If you have a lot of little bits left, I'm doubtful about how useful a solvent will be.
You could try mineral turpentine----it doesn't dissolve anything, but penetrates into whatever gaps there are
& breaks the adhesive bond .
It is horribly messy & smelly, though.
Another possibility is baby oil, which seems to have similar characteristics.
It will lift, in an instant, wound dressings which seem to resist any other type of encouragement to come off.