Letterpress, you are at the wonderful beginning stage where one does not know enough to begin to understand what one doesn't know BUT, you want to learn.
Whole mail piece collecting is called cover collecting (as in collecting the item that covers the contents).
When one begins to add the study of rates and fees, that is called postal history. That would include the information about the design and development of services and items you mentioned.
Stamp positioning doesn't really matter, it idea is to get the stamp(s) on the mail piece. Severing the selvage (sheet margins as you called it) from the stamps is just more work, why bother? Most mail is not love letters where a good visual impression is desired. However around the turn of the last century, certain stamp placement carried meaning between folks.
You ask about "express mail" without knowing that phrase can be found written on envelopes in the in the 1830s and even exists in cancellations later in the 19th century as shown below.

This is a trimmed for posting here, copy of the image of Lot 1061, sale 1245 in the Siegel Auction Sale of Nov. 16, 2021.
My educated guess is that since the term "express mail" had been in the public domain for over a century, the USPS recently came up with the name
Priority Express and federally registered it as a trademark to replace "Express mail." As to the 1968 start of Priority, only airmail items 7 ounces or more were mandatory Priority Mail, but no such marking was required. For first class matter a minimum weight was required and one had to specifically request the service. Priority was designed to replace Air Parcel Post which had expanded from regular Parcel Post. Regular parcel post introduce the zone system when parcel post started 1-1-1913. The zones are used for Priority and Priority Express mail. Eight zones and local existed unchanged for over 100 years until "Zone 9" arrived for raising the cost to certain small USA land specks surrounded by Ocean.
Mail handling and requirements also changed for the post office due to external evens such as the Unabomber, who by the way tended to use coil versions of the Eugene O'Neill $1.00 stamps shown on my bright yellow insured special handling mailing tag in an above post. Anthrax mail also caused changes.
The full title of the books John Becker mentioned are:
U.S. Domestic Postal Rates, 1872-XXXX by and Anthony S. Wawrukiewicz Beecher, Henry W. with the "XXXX" date varying by Edition, first second or third. This will explain lots of questions, and I mean a lot.
U.S. International Postal Rates, 1872-1996 by Anthony S. Wawrukiewicz & Henry W. Beecher. This explains both incoming and out going mail rates, well except for the parcel post and air parcel post rates. Those are found in a CD from the American Philatelic Society. The third edition of the domestic rate book includes a section updating many international rates as well.
Lastly, going back to your original question, there is a series of stamps, the Presidential Issue or
Prexies which contained all the dead presidents up to 1938. The first 22 were denominated in the order of office. Washington 1 cent, Adams 2 cent, Lincoln 16 cent, Johnson 17 cent, Cleveland 22 cents (he was both the 22nd and 24th POTUS), then Harrison is 24 cents, with no 23 cent prexie issued. Then set continues with 25, 30, 50 cent values and 1, 2, and 5 dollar values. Franklin at 1/2 cent, Martha Washington at 1.5 cents and the White House at 4.5 cents completed the series.
At the time the series was issued, some denominations had a postal purpose and many did not. This is the basis for what is called "solo" collecting; finding a single denomination stamp exactly paying the postage and fees for the item it is attached to. Some are easy to find some very rare and a solo $5 Coolidge is yet to be found (there is one used with a meter stamp as the closest as well as a single stamp but it does not pay the commercial rate due exactly). The only exception is the 1/2 cent Franklin as there was no fee and rate that cost exactly 1/2 cent. That said it is found as being paper clipped or attached just by the selvage (sheet margin in your words)to a mail piece as 1/2 cent change when the transaction require postage due in the amount of 1/2 cent. You pay the penny, a 1/2 cent due is affixed and you get a 1/2 cent Franklin back as change.
Now I will let another handle your other questions and comments.