SEO News

Web Crawler

RSS
  1. Dealing With Onsite Duplicate Content Issues

    ScreamingFrog: The ScreamingFrog crawler will crawl up to 500 pages for free for issues including duplicate content. The canonical tag is found in the header of a Web page.Use Meta Tags: Use meta tags to tell search engines which pages you do not...

  2. Panda Has a Smartphone – Here Are 7 Things You Can Do to Test It Now

    You can choose a specific crawler to view how your pages are rendered via desktop, smartphone, and feature phone. The default report will be filtered by Web (for Web search). There are a boatload of user agents you can download from the Web that...

  3. Blog SEO Quiz – Test Your Blog Optimization Knowledge

    SEO is more than crawler-friendly URLs. The people who build blog templates might generate URLs (web addresses) that search engines can crawl. Adapted from "Information Architecture for the World Wide Web" by Peter Morville and Louis Rosenfeld.