Yahoo's web crawler, affectionately known as Yahoo Slurp, is moving. According to the Yahoo Search Blog, Slurp will move from its domain of inktomisearch.com to crawl.yahoo.net. The crawlers will be switched over in phases over the next few weeks, starting immediately.
Identifying Slurp in robots.txt files will not be affected, as the user-agent name will remain the same, as will the IP addresses of the crawlers. However, any reverse DNS checks for the crawler identity or network access rules to allow inktomisearch.com need to be updated to allow for crawl.yahoo.net.
Introducing... ClickZ Live!
SES Conference & Expo has merged with ClickZ to bring you ClickZ Live! The new global conference series takes on the identity of the industry's premier digital marketing publication, ClickZ.com, and kicks off March 31-April 3 in New York City. Join the industry's leading tech-advertisers in the advertising capital of the world! Find out more ››
*Super Saver Rates expire Jan 24.