How do I remove adhesive on my skin left over from medical tape?

Due to an eye problem, I have to tape goggles to my face at night when I sleep. In the morning when I pull them off, some of the adhesive residue is left on my skin. I have tried alcohol and make-up remover, but it isn't doing the job. Since it is on my face, I don't want an irritant. I have checked with a couple of local pharmacies and they don't have anything. Go any ideas!