How do you remove return address labels from acetate sheet protectors?

It depends on the type of adhesive that is used for the labels. The following solvents may work, (you'll need to verify that they won't attack the acetate): isopropyl alcohol (rubbing alcohol), mineral spirits, xylene (paint solvent).