View Single Post
Old 09-04-2008, 02:26 PM   #95
pilotbob
Grand Sorcerer
pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.
 
pilotbob's Avatar
 
Posts: 19,832
Karma: 11844413
Join Date: Jan 2007
Location: Tampa, FL USA
Device: Kindle Touch
Quote:
Originally Posted by Shaggy View Post
How do you think they make the index? They can't index a site without downloading/caching it.
Right, but they only need to store the index data once the page/site has been indexed. There is no need for them to keep the whole page in their cache... which the do if you have ever view google cached pages.

googleguide http://www.googleguide.com/cached_pages.html talks about the fact that Google will remove the cached pages if requested by the site owner. I assume this is done with the no-cache directive in the header. However, removing it from the cache doesn't remove it from the index. So, they do not "need" to retain the cache once the page has been index to provide search results.

BOb
pilotbob is offline   Reply With Quote