Thread
:
Archive.org
View Single Post
08-23-2015, 04:18 PM
#
17
jgaiser
Omnivorous
Posts: 3,283
Karma: 27978909
Join Date: Feb 2008
Location: Rural NW Oregon
Device: Kindle Voyage, Kindle Fire HD, Kindle 3, KPW1
Quote:
Originally Posted by
thewitt
Don't believe it. All my sites have included exclusions and requested removal. No dice.
Shrug... Every site that I've been involved with has had the robot.txt honored.
jgaiser
View Public Profile
Find More Posts by jgaiser
Track Posts by jgaiser via RSS