So, still suspicious that the black background was contributing to the problem, I bought myself some transparent Vario pages to see how that might impact things. Here is the rather stunning result. Another advantage of transparent is that I don't have to handle the stamps to scan the backs. Looks like this is my future.
(Both were from full page scans.)

