03-06-2010, 09:53 PM | #1 |
Addict
Posts: 234
Karma: 6720
Join Date: Aug 2008
Device: SONY PRS505
|
slashdot Your Rights Online ban
I just got banned by the Your Rights Online portion of Slashdot. kinda ironic
i was told to follow robots.txt to become unbanned. Can the recipe be improved to avoid future bans? |
03-06-2010, 10:09 PM | #2 | |
Wizard
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
|
Quote:
" description = '''Tech news. WARNING: This recipe downloads a lot of content and can result in your IP being banned from slashdot.org''' " OTOH, this is the simplest recipe I've ever seen. It has the feeds and it gets them. That's it. Nothing is stripped. My suggestion would be to limit the rate and the number of connections with : Code:
simultaneous_downloads = 1 delay = 3 |
|
03-07-2010, 12:31 AM | #3 |
creator of calibre
Posts: 43,856
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
I don't use the slashdot recipe (stopped reading slashdot a while ago) but I suspect they're rather sensitive to loading (can't blame them, they get a lot of traffic), so they probably have something along the lines of too many downloads from a single IP triggers a ban. I don't really see how that can be worked around. Probably, just follow Starson's suggestions and also remove some of the feeds you're not interested in.
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Slashdot: Good Online Sources for Free Books | Alexander Turcic | Deals and Resources (No Self-Promotion or Affiliate Links) | 0 | 04-12-2005 04:12 AM |