Quote:
Originally Posted by jessie102
I just got banned by the Your Rights Online portion of Slashdot. kinda ironic
i was told to follow robots.txt to become unbanned.
Can the recipe be improved to avoid future bans?  |
I looked at it. It's got this warning in the recipe:
" description = '''Tech news. WARNING: This recipe downloads a lot of content and can result in your IP being banned from slashdot.org'''
"
OTOH, this is the simplest recipe I've ever seen. It has the feeds and it gets them. That's it. Nothing is stripped. My suggestion would be to limit the rate and the number of connections with :
Code:
simultaneous_downloads = 1
delay = 3
It may help, but who knows what they use to decide is wrong.