SEO News

Robots Txt

RSS
  1. Google Webmaster Tools Now Finds Smartphone Crawl Errors

    Blocked URLs: A blocked URL is when the site's robots.txt explicitly disallows crawling by Googlebot for smartphones. Typically, such smartphone-specific robots.txt disallow directives are erroneous. It can be bit complicated for websites with a...

  2. Why Google Will Reject, Block, or Flag Your Data Feed

    Check out this list for major Google data feed errors and solutions including title warnings, duplicate group IDs, and robots.txt errors. Moreover, Google doesn't always do the best job of communicating why your data feed is getting rejected...