In response to the new caching techniques Jennifer reported last week, Matt Cutts posted a more detailed explanation of what is called "crawl caching proxy." In short, Google may use all of its spiders, GoogleBot (Web search spider), AdSense spider, News spider, blog search spider and so on for caching purpose. So when all of these spiders crawl your pages, they are stored in what is called a "crawl caching proxy." The "crawl caching proxy" is then used for retrieving a page's cache. My understanding is that when you conduct a search at Google.com, you may see a cache retrieved by the AdSense bot, from within the "crawl caching proxy."
Introducing... ClickZ Live!
SES Conference & Expo has merged with ClickZ to bring you ClickZ Live! The new global conference series takes on the identity of the industry's premier digital marketing publication, ClickZ.com, and kicks off March 31-April 3 in New York City. Join the industry's leading tech-advertisers in the advertising capital of the world! Find out more ››
*Super Saver Rates expire Jan 24.