Slurp's Change of Address

Yahoo's web crawler, affectionately known as Yahoo Slurp, is moving. According to the Yahoo Search Blog, Slurp will move from its domain of inktomisearch.com to crawl.yahoo.net. The crawlers will be switched over in phases over the next few weeks, starting immediately.

Identifying Slurp in robots.txt files will not be affected, as the user-agent name will remain the same, as will the IP addresses of the crawlers. However, any reverse DNS checks for the crawler identity or network access rules to allow inktomisearch.com need to be updated to allow for crawl.yahoo.net.

About the author

Kevin Newcomb joined ClickZ in August 2004, covering search marketing and other online marketing topics. He has been reporting on web-based businesses since 2000.

Before the bubble burst, Kevin was a marketing manager for an online computer reseller, handling copywriting, e-mail marketing, search marketing and running the affiliate program.

With a combination of real-world marketing experience and years of business journalism, Kevin brings to ClickZ a unique ability to deliver news and training materials that help online marketers do their jobs better.