SEO News

Robots Txt Search Engine Penalties

RSS
  1. 5 Googley SEO Terms – Do They Mean What You Think They Mean?

    Most people think the robots.txt file is used to block content from the search engines. Robots.txt won't prevent the URL from being indexed, just the page content. To prevent a page or set of pages from having their URL indexed you will want to...

  2. Top Google Website Optimization Resources

    If you're having DNS issues, server connectivity issues, problems reaching the robots.txt file, or a laundry list of 404 errors, you can review them here and begin fixing them. Penalties from Google can be detrimental to your sales if you are...

  3. 2007: A Search Odyssey? Keynote Conversation with Matt Cutts

    It took ten years from robots.txt to nofollow, and it wasn't very long after that that we all agreed on the common Sitemaps protocol, Sitemaps.org. It will alert you to 404 errors, page load slowness, some spam penalties, and integrates application...

  4. 2007: A Search Odyssey? Keynote Conversation with Matt Cutts

    It took ten years from robots.txt to nofollow, and it wasn't very long after that that we all agreed on the common Sitemaps protocol, Sitemaps.org. It will alert you to 404 errors, page load slowness, some spam penalties, and integrates application...

  5. Search Forums Roundup: Dec. 23, 2004

    Robots.txt Issue With Duplicate Content, and more. Today's SearchDay, Search Engine Forums Spotlight, features our weekly links to this week's hot topics from search engine forums across the web: Having Trouble Believing In Crosslinking Penalties...

  6. Search Engine Forums Spotlight

    Robots.txt Issue With Duplicate Content Cre8asite Forums How could I stop them indexing the trackback page without resorting to using anything other than robots.txt? Having Trouble Believing In Crosslinking Penalties Search Engine Watch Forums

  7. How AltaVista Works

    The program can even be used to submit URLs to AltaVista from sites that block search engine crawlers with the robots.txt protocol. AltaVista may impose relevancy penalties or remove pages from its web index altogether, if the pages are found to be...