Quote:
Originally Posted by Amalthia
I think I appreciate Taylor's concerns because I had my entire fan fiction archive of over 500 stories "archived" by a search engine and it was killing my bandwidth. That and many authors want people to come to the site not read the stories via the search engine. I also don't like the idea of someone making profit off of fan fiction even indirectly.
|
a) those must have been really big stories, or you must have very little bandwidth, or you are mistaken in the source of the drain.
b) again, robots.txt, robots.txt, robots,txt.
c) search engines typically provide one or two sentence excerpts, unless you are referring to the google cache, and I don't know anyone who prefers to read the cache while the original site is still alive.
d) somehow I don't think you complain about the people that this search engine sends your way.
Search engines spider publicly-available content on the web, news at 11.