SEO News

Web Crawling

RSS
  1. Dealing With Onsite Duplicate Content Issues

    The canonical tag is found in the header of a Web page.Use Meta Tags: Use meta tags to tell search engines which pages you do not want to index. Duplicate content issues can lead to a decrease in crawl rate – this happens because Googlebot is busy...

  2. Panda Has a Smartphone – Here Are 7 Things You Can Do to Test It Now

    The default report will be filtered by Web (for Web search). There are a boatload of user agents you can download from the Web that you can import into User Agent Switcher. You might find the word count and file size to be low when crawling as...

  3. Why Yahoo Wants to Move Into Contextual Search and How it Might Work For Them

    Unfortunately, it's not as simple as taking their old search algorithm, start crawling the web again, and expect they can compete against Google. Marissa Mayer, CEO of Yahoo, has been commenting a lot recently about how she wants to get Yahoo back...

  4. Matt Cutts: Facebook, Twitter Social Signals Not Part of Google Search Ranking Algorithms

    We have to crawl the web in order to find pages on those two web properties and we've had at least one experience where we were blocked from crawling for about a month and a half. Cutts also noted a big problem with crawling social profiles: they...