Thread: Amazon Kindle and Sony Reader Locked Up: Why Your Books Are No Longer Yours
View Single Post
Old 03-26-2008, 09:09 PM   #131
moz
Addict
moz once ate a cherry pie in a record 7 seconds.moz once ate a cherry pie in a record 7 seconds.moz once ate a cherry pie in a record 7 seconds.moz once ate a cherry pie in a record 7 seconds.moz once ate a cherry pie in a record 7 seconds.moz once ate a cherry pie in a record 7 seconds.moz once ate a cherry pie in a record 7 seconds.moz once ate a cherry pie in a record 7 seconds.moz once ate a cherry pie in a record 7 seconds.moz once ate a cherry pie in a record 7 seconds.moz once ate a cherry pie in a record 7 seconds.
 
moz's Avatar
 
Posts: 370
Karma: 1553
Join Date: Feb 2008
Location: Melbun
Device: Kobo H2O
Quote:
Originally Posted by Taylor514ce View Post
I know about robots.txt. Giving me a "hang this sign on your door and ...
Putting something on the web is much more akin to printing it and displaying out the front of your house. If you don't want all comers to read it, don't put it there for them to see. Your objection to search engines reading it is more like objecting to the local library taking photos of your house and telling people where the house is.

Can you suggest ways that search engines could work that don't involve reading the content of your website with promiscuous copying and caching? From the sound of it you'd prefer that all 20-odd major search engines downloaded everything on your site every day, just in case anything has changed. The alternative, of having a single file that controls that seems obvious to me - whatever is used has to work for the 80% of users who want their site to be searchable but don't want to do anything in particular to make that happen, as well as the other 20% who want the search but also want to be right up the rankings.
moz is offline   Reply With Quote