Great that you are getting someone younger involved in the hobby - Thank you! Like you, I first collected when I was young but as others are pointing out a lot has changed since then. Growing up you could go to J.J. Newberry's or Woolworth's in my small town in Maine and there was a shelf with starter stamp kits and albums. That world is long gone.
As for where to find information, yes the Internet is where a lot of that gets done now. But I still think there is no substitute for a good catalog. You can find used copies of the Scott Classic Specialized Catalogue of Stamps & Covers 1840–1940 on
ebay for a pretty reasonable price. It only covers stamps in this "classic" period but it will have a lot of the basics on perforations, watermarks, etc. Also, trying to collect all the many issues after the 1940s without focusing will quickly become unmanageable so if he's interested in current issues, maybe think of focusing on a particular country - the US, Canada, etc.
ebay is also a good place to maybe find a used album that is still in good shape and may have some stamps in it. As more and more of us baby boomers are tipping over there's a flood of this material getting disposed of. Maybe better to spend a little money on something like that and see how it goes before spending top dollar on a new album set up. As suggested, using a stock book may be an alternative way to go, though personally I still prefer albums.
The advice above to see if there's a stamp club nearby is good. There will be members who may have a gently used album to spare as well as other help.
Good luck. Don't get discouraged - there's lots to learn and adapt to.