Stamp Community Family of Web Sites
Thousands of stamps, consistently graded, competitively priced and hundreds of in-depth blog posts to read








Stamp Community Forum
 
Username:
Password:
Save Password
Forgot your Password?

This page may contain links that result in small commissions to keep this free site up and running.

Welcome Guest! Registering and/or logging in will remove the anchor (bottom) ads. It's Free!

Too Smart For My Own Good....

 
To participate in the forum you must log in or register.
Author Previous TopicReplies: 9 / Views: 2,204Next Topic  
Pillar Of The Community
Learn More...
United States
3046 Posts
Posted 12/08/2012   11:33 am  Show Profile Bookmark this topic Add apastuszak to your friends list Get a Link to this Message
So, I decided to get "geeky creative' and try and write a script to crawl the Former Soviet Union New Stamp web site and grab stamp title information, stamp size and possibly even suck down the image.

Well, whoever runs the site doesn't seem to like people doing that and the server automatically banned me from the site.

The ban is at the IP address level usually, but Verizon can't seem to get me a new IP address no matter now many tricks they try on their back end...

I may be stuck using the site through a public proxy.

That's what I get for trying to be sneaky...
Send note to Staff

Valued Member
United States
106 Posts
Posted 12/08/2012   12:50 pm  Show Profile Bookmark this reply Add stampcoder to your friends list  Get a Link to this Reply
Another option is to try google's cache. Just do a search for the URL you're blocked from and click on the cache link.

What lanaguage did you write the script in?

Send note to Staff  Go to Top of Page
Pillar Of The Community
United States
1510 Posts
Posted 12/08/2012   4:09 pm  Show Profile Bookmark this reply Add Timm to your friends list  Get a Link to this Reply
Hear the "CRACK" of the whip!

Now get back to those provisionals !!
Send note to Staff  Go to Top of Page
Pillar Of The Community
Learn More...
United States
3046 Posts
Posted 12/08/2012   5:29 pm  Show Profile Bookmark this reply Add apastuszak to your friends list  Get a Link to this Reply
Python. I've taken quite a liking to it over perl. But I was calling wget, which pulls stuff local.

Provisionals? I'm supposed to make Provisional pages? :-)
Send note to Staff  Go to Top of Page
Valued Member
United States
106 Posts
Posted 12/08/2012   8:03 pm  Show Profile Bookmark this reply Add stampcoder to your friends list  Get a Link to this Reply
Python is nice, I've done some quick stuff in it as well. I prefer C# for serious work though.

If you want, send me the code and I'll try running it. I have a few different IPs I have access to. Maybe by spreading it out over time, I can avoid triggering the server block.
Send note to Staff  Go to Top of Page
Pillar Of The Community
Learn More...
United States
3046 Posts
Posted 12/08/2012   8:30 pm  Show Profile Bookmark this reply Add apastuszak to your friends list  Get a Link to this Reply
It throws a 403 error (forbidden) every time you try and grab an image. I think after so many 403s the site just bans your IP address.
Send note to Staff  Go to Top of Page
Bedrock Of The Community
Australia
38679 Posts
Posted 12/08/2012   8:41 pm  Show Profile Bookmark this reply Add rod222 to your friends list  Get a Link to this Reply
Excuse my ignorance, but is what you are doing, illegal?
or at best, not nice?
I think the webmaster there, was an SCF member at one time.

Send note to Staff  Go to Top of Page
Pillar Of The Community
United States
1510 Posts
Posted 12/08/2012   10:15 pm  Show Profile Bookmark this reply Add Timm to your friends list  Get a Link to this Reply
Like the Moonshiner says "Tain't illegal lessen you's gets caught!"

And you's got caught!"
Send note to Staff  Go to Top of Page
Pillar Of The Community
Learn More...
United States
3046 Posts
Posted 12/09/2012   12:02 am  Show Profile Bookmark this reply Add apastuszak to your friends list  Get a Link to this Reply

Quote:
Excuse my ignorance, but is what you are doing, illegal?
or at best, not nice?
I think the webmaster there, was an SCF member at one time.


Depends on the webmaster. Some don't care. Others are quite possessive of their content. Looking at what I downloaded, all the 403 errors were generated by the picture grab, so it looks like he didn't like me grabbing the photos, which I don't need. I just need the dimensions more than anything else.
Send note to Staff  Go to Top of Page
Edited by apastuszak - 12/09/2012 12:11 am
Pillar Of The Community
Learn More...
United States
3046 Posts
Posted 12/09/2012   10:27 pm  Show Profile Bookmark this reply Add apastuszak to your friends list  Get a Link to this Reply
Seems the ban was temporary. I can get back on again.
Send note to Staff  Go to Top of Page
  Previous TopicReplies: 9 / Views: 2,204Next Topic  
 
To participate in the forum you must log in or register.

Go to Top of Page

Disclaimer: While a tremendous amount of effort goes into ensuring the accuracy of the information contained in this site, Stamp Community assumes no liability for errors. Copyright 2005 - 2026 Stamp Community Family - All rights reserved worldwide. Use of any images or content on this website without prior written permission of Stamp Community or the original lender is strictly prohibited.
Privacy Policy / Terms of Use    Advertise Here
Stamp Community Forum © 2007 - 2026 Stamp Community Forums
It took 0.49 seconds to lick this stamp. Powered By: Snitz Forums 2000 Version 3.4.05