If you get a little adventurous, it is possible to remove these self-adhesives, leaving no sticky residue, but it does take a little practice. I like to do it because the album is less thick if the paper is removed, and I just like the "clean" look better too.
I use pure citrus air freshener spray, that you can find at Home Depot or
Amazon. You can do a search on the forum if you'd like to learn more. I personally spray both sides of the stamp on piece, let it sit for about 30 seconds or so, and then peel the backing paper off the stamp - not the other way around, as this way keeps the stamp itself flat so it doesn't curl. I them spray the gooey back of the stamp again, let it sit for about 15 seconds, and then scrape the goo off with the edge of a credit card in 2 strokes - once from the center of the stamp towards the top, and the next time from the center to the bottom. I wipe the goo off the credit card edge between scrapes.
This results in a stamp with no sticky residue at all, that quickly dries clean, and is ready for mounting.
Matt