![]() |
#1 | |
Recovering Gadget Addict
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 5,381
Karma: 676161
Join Date: May 2004
Location: Pittsburgh, PA
Device: iPad
|
WebCopier for Pocket PC 4.2 Now Available
![]() Quote:
Other products are available for offline browsing with Mac and Windows, but no indication of a PalmOS version. |
|
![]() |
![]() |
#2 |
Technology Mercenary
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 617
Karma: 2561
Join Date: Feb 2003
Location: East Lyme, CT
Device: Direct Neural Implant
|
Great, another spider to block... WebCopier (375 hits so far in this month's logs on my end) didn't request robots.txt once, it just proceeded to pound the server for as much as it would send, as fast as it could.
Nope, sorry... blocked. Next? |
![]() |
Advert | |
|
![]() |
#3 | |
Recovering Gadget Addict
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 5,381
Karma: 676161
Join Date: May 2004
Location: Pittsburgh, PA
Device: iPad
|
Quote:
I'm curious, from a web site admin perspective on things, what sorts of spiders are out there and which ones you'd consider good/bad in their approach. For example, with WebCopier you mention that they didn't request robots.txt. What is that, and why should they request it? Thks! |
|
![]() |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Two pocket questions | Gogool | PocketBook | 7 | 06-22-2010 01:12 AM |
Does anyone have Pocket Pro and Sony Pocket? | Davimee | Astak EZReader | 10 | 05-05-2010 11:20 PM |
Sony pocket | catherine quirk | Introduce Yourself | 1 | 12-17-2009 05:00 PM |