That is a plate number. It was used to keep track of what printing plate was used to produce a sheet or panes of stamps. Your four stamps with that extra piece of paper with the number are what is called a "plate block".
Here's a good site to about some of the basics of stamp collecting:
http://www.americanstamphistory.com/