This is how I take my pics of my coins. For stamps I place them on a flat black background instead of using the screw.
Prepare a black background and mount a screw into it, then add some felt on top to hold the coin in place.

Balance the coin on top, lean the coin to one side slightly if you have to, to save reflection from coin.

Place cut-down juice or milk container over the coin. This not only stops glare but gives you a steady platform for taking the pic. Try different length containers until you find one that you can focus closest with.

I then place an old magnifying glass on top to increase the size of the pic. At this point you could place a piece of paper with a hole cut in it, and shoot through this to stop the glare of LED's.

I then shine light through the side of the container, this stops the glare. You can adjust the height of the light to add or subtract the amount of light on the coin surface. I only have one light, but two might work better.

This is the coin pic after editing in Microsoft Picture Manager.
No colour adjustment, just cropped and darkened a little. All this on fully automatic setting on the camera.

Hope this helps
and like Panda.Bear, this was taken with a 5MP Fujifilm camera.
Oh and a stamp pic...

Steve

