I think it would be difficult not to be confused because there are so many options to consider, ranging from aesthetics to how much money you want to spend.
The good news is that there are hundreds of thousands of worldwide stamps that are inexpensive, interesting, and just begging to be collected. The bad news is there are hundreds of thousands of worldwide stamps.... As the maximum number of stamps that can be practically housed in a single binder is probably around 50-60,000, you will quickly acquire lots of stamps that aren't in your album. Even if that doesn't frustrate you, I am unaware of any single volume albums with even 50K stamps currently available for sale. The one volume H. E. Harris Statesman album has spaces for 25,000 stamps. (There used to be more album options for the worldwide collector and you can often find these out-of-print volumes on
ebay, but then you run into the problem of what do with more recent stamps.)
Since you want to keep your cost below $100, I suggest two possibilities to get you started. The first is stockbooks as has already been suggested. Google 'keijo stamp blog' for lots of ideas on worldwide collecting in general and stockbooks in specific. While I am not as much a fan of stockbooks for housing a collection as some collectors, one great advantage is that even if you switch at a later date to printed albums or albums you create yourself, you can always use your stockbooks for stamps waiting to be mounted, etc.
If you prefer the idea of a printed worldwide album, consider the computer produced pages by William Steiner (Stamp Album Web). A year's membership with unlimited downloads of pages for individual countries is $30. As you acquire stamps, download the pages for the countries involved and then print out only the page(s) for which you have stamps. Acquire more stamps, print out more pages. If you like this idea after visiting Steiner's website, I suggest posting another message here as there are several members who can give suggestions on paper quality, laser vs. ink jet, etc.
I don't mean any of this to discourage you. I'm having a great time with my worldwide collection although I did make it easy on myself by limiting my collection to the first 100 years of postage stamps.