For stamps I add to my collection, all of the self-adhesive material is removed. My experience is that these adhesives are unstable and will change over time. The longer that stamps are left on the clippings, the less likely that they will be able to be effectively/safely removed.
If the self-adhesive material is left on the stamp, existing evidence seems to indicate that it will eventually migrate into the stamp paper.
