Well, I usually suggest to visit a local coin show for people just starting out. Even though coin shows are specific to coin collectors, you will always find a good amount of bullion coins there too. Unless you're planning to start out by six figure investments, or even up in the millions (we can dream, can't we?), a local coin show should have enough to get you started. What's better is that you can build a relationship with a vendor in your community, or at least near enough that they attend the show, and you don't have to pay shipping expenses. If you want to order online, Blanchard is one of my favorites, their website is at http://www.blanchardonline.com
That is a brilliant advice, for starters you need to look out for those coin shows where you can get variety of coins , and you actually get to compare the prices of the fair with online prices.I did most of my first coin purchases from the Coin fairs.