SEO News

Major Crawlers

RSS
  1. SEO in the Age of Apps: Diversifying Your Mobile SEO Strategy

    Crawler Access: Allow access for all crawlers to both desktop and mobile websites to fully understand page structure and to consolidate signals. Well-formatted content (whether Responsive or mobile-specific) that loads easily, is accessible to all...

  2. Facebook Ads 80% Bot Claim, Examined! Why You Shouldn’t Lose Faith Just Yet

    It is likely that some or many of these are malicious crawlers for various reasons and 2 percent or more are real with JavaScript disabled. Limited Run’s allegations of Facebook ad traffic being 80 percent bots has made major news publications...

  3. SEO Techniques for Large Sites: How to Maximize Product Visibility in Organic Search

    Most solutions around this area focus on "recommendation engines" normally built in JavaScript and invisible to crawlers. The overarching challenge that presents itself here is ensuring sufficient link equity flows down from the home page and major...

  4. Impact of Legal U.S. Online Gambling on Search and the Web

    Forum and blog comment spam will no doubt see a huge increase and endless new content will hit the web, taxing the search engine crawlers. Some major sites, such as Amazon, have denied affiliate members from those states, and work-arounds for this...

  5. Must We Unlock the Deep Web?

    Local information, research documents, mountains of medical data, and otherwise useful information lies buried beyond the reach of GoogleBot and other crawlers. The only major search marketing conference and expo in the Midwest will be packed with...

  6. SEO During E-Commerce Application Development

    Unfortunately, these product-shuffling and category-dealing applications can also wreak havoc for automated search engine crawlers out to index sites leveraging these applications. It's good to see that the bigger programs now have them, because...

  7. Common Problems with 404 Error Pages

    In recent weeks, I've seen several mishandled 404s, but one theme seems to return "200 OK" codes to search engine crawlers for 404 pages. The major corporations are a different story. It may surprise you to learn that the way a Web site handles 404...