SEO News


  1. Giving Links Away

    If you want the instructions to apply to all spiders, you can use an asterisk on the first line: User-agent: * You can also identify specific spiders to allow or disallow, such as googlebot, Yahoo's slurp, or Microsoft's MSNbot.

  2. Highlights from the SEW Blog: April 14-18, 2008

    Slurp 3.0 Replaces Yahoo! Slurp Search Engine CrawlerThe big change: Yahoo's recommendation to stop using IP-based recognition and use reverse DNS identification instead. Organic Search Case Sensitive Google Search Results Being FoundChris Silver...