My recommendation is to go to a craft store (AC Moore, Hobby Lobby, Michael's, etc.) armed with one of their 40% to 60% off coupons you can often find on the internet, and buy a product called:
TOMBOW Mono Adhesive (Removable)
It comes in a cartridge and retails for about $6 or $7 (with a coupon, much less of course). Be sure to get the removable adhesive (as they have a permanent adhesive, too).
The product works great to apply adhesive to the back of stamp mounts for insertion in an album, and when you need or want to relocate the stamp mount, it is easily removable without damaging your album page.
Here's the web page for the product I'm referring to:
https://tombowusa.com/craft/detail/62203