We were set to embark on one of those awkward uncomfortable evenings where you can’t eat your food or slurp your drink fast enough. As search engine optimizers we hear the term "optimization" all the time.
Below is an example of the same command syntax, using Yahoo Slurp (now deprecated in the U.S.but still actively crawling internationally). Some of the biggest problems negatively impacting SEO campaigns can be traced back to technical issues, since...
Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) 208.76.240.226.reverse.crucialx.net 208.76.240.226 Doesn't look like Yahoo's Slurp after all, does it? In an ideal world, these crawlers would be quite open about what they're doing: just...
Slurp crawl analysis from AudetteMedia's logfilt. SEO can be boiled down to three core elements, or functions, in the current era of Google: crawling time (discovery), indexation time (which also includes filtering), and ranking time (algorithmic).
If you want the instructions to apply to all spiders, you can use an asterisk on the first line: User-agent: * You can also identify specific spiders to allow or disallow, such as googlebot, Yahoo's slurp, or Microsoft's MSNbot.
Slurp 3.0 Replaces Yahoo! Slurp Search Engine CrawlerThe big change: Yahoo's recommendation to stop using IP-based recognition and use reverse DNS identification instead. Organic Search Case Sensitive Google Search Results Being FoundChris Silver...
Slurp 3.0 won't change the content Yahoo crawls on your site: the new Yahoo! Slurp 3.0 recognizes the same user-agent and all robots.txt directives for Yahoo! Slurp. The primary difference will be in your log files where you'll see Slurp 3.0.
Yahoo Adds Support for Page-Level Exclusion Tags for Non-HTML DocsYahoo is giving webmasters more control over page-level directives to its Slurp crawler for non-HTML files. We've collected all the search marketing news from selected posts to the...
Yahoo Adds Support for Page-Level Exclusion Tags for Non-HTML DocsYahoo is giving webmasters more control over page-level directives to its Slurp crawler for non-HTML files. Want a snapshot of the day's search marketing news?
Yahoo is giving webmasters more control over page-level directives to its Slurp crawler for non-HTML files. The X-Robots-Tag is a page-level exclusion tag that is used to direct a search engine spider in how it should treat that page.
Slurp's Change of AddressYahoo's web crawler, affectionately known as Yahoo Slurp, will move from its domain of inktomisearch.com to crawl.yahoo.net. From the SEW blog: Organic Search Google Wants Your Spam ReportsThe Google Search Quality Team...
Slurp's Change of AddressYahoo's web crawler, affectionately known as Yahoo Slurp, will move from its domain of inktomisearch.com to crawl.yahoo.net. Want a snapshot of the day's search marketing news?
Yahoo's web crawler, affectionately known as Yahoo Slurp, is moving. According to the Yahoo Search Blog, Slurp will move from its domain of inktomisearch.com to crawl.yahoo.net. Identifying Slurp in robots.txt files will not be affected, as the...
Is Slurp Behaving Badly? The Weather Channel has used Coremetrics' analytics for two years, and less than six months into the relationship, Derek van Nostran, director of marketing, started digging into the search data in the application.
Is Slurp Behaving Badly? A selection of stories posted to the Search Engine Watch Blog, along with today's search-related headlines from around the Web: From the SEW Blog: Former About.com Boss Heads to IACFormer About.com and AllBusiness.com CEO...
The Yahoo Search Blog announced that Yahoo's web crawler, aka Yahoo Slurp, now supports wildcards in the robots.txt file. Yahoo Slurp Adds Wildcard Support For Robots.txt Below, a recap of stories posted today to the Search
The Yahoo Search Blog announced that Yahoo's web crawler, aka Yahoo Slurp, now supports wildcards in the robots.txt file. The two parameters that Yahoo now supports include the "*" and the "$. The * will tell Yahoo to do a "wildcard match a...
Visual search can be found by clicking on the Clothing META NAME="ROBOTS" CONTENT="NOODP" (stops MSN, Google and Yahoo from using ODP directory) or META NAME="Slurp" CONTENT="NOODP (stops just Yahoo from using ODP directory) I reported back on...
Since Google now is able to crawl and index URLs with parameters, i.e.dynamic URLs - they have removed the line that reads "Don't use " META NAME="ROBOTS" CONTENT="NOODP" (stops MSN, Google and Yahoo from using ODP directory) or META NAME="Slurp...
META NAME="Slurp" CONTENT="NOODP (stops just Yahoo from using ODP directory) The Yahoo Search Blog announced that Yahoo has finally added support for the NOODP META tag. You can deploy this two ways; META NAME="ROBOTS" CONTENT="NOODP" (stops MSN...
