SEO News

Spidering

RSS
  1. Panda Has a Smartphone – Here Are 7 Things You Can Do to Test It Now

    Luckily, some of the most popular spidering tools enable you to do this. They fire up Chrome or Firefox on their desktop computer and start looking around. That’s a smart thing to do, as deep Panda analysis is worth its weight in gold.

  2. 5 Options for Choosing a Country, Region, or Language Selector

    Because there is no opportunity to find the global page, there is obviously no internal linking benefit nor spidering benefit without a selector. Usability: If it isn’t easy to locate, use, or otherwise just unclear, you may be losing a massive...

  3. Is Your Landing Page Relevant?

    Make sure your content is relevant to your target keyword, encourages spidering, and (most importantly) engages the reader. Last time, I asked, "Are Rankings Still Relevant? This week, I pose a more personal question: Is your landing page relevant?

  4. GenieKnows Its Verticals

    Spidering most major media sites as well as medical focused discussion groups, forums and publications, GenieKnows returns a thorough set of results. One of the few remaining independent engines of note, GenieKnows adopted what was considered a...

  5. Giving Links Away

    In the first line you specify what spiders you want to block from spidering your content. However, links don't just go one way. You could, and probably should, occasionally link out to other sites. While you have no control over who links to you...

  6. Google: A Clear & Present Danger to Corporate Data Privacy

    Do not make the robotic querying of Web site forms the default spidering practice for Google. UPDATE: Editors' Note: At the request of Google, we've removed the photo of Google engineer Jayant Madhavan, co-author (with Alon Halevy) of the Google...

  7. Search Wikia Asks Users to Share the Load

    Speaking at the O’Reilly Open Source Convention (OSCON) last week, Wales announced that Wikia has acquired Grub, the distributed search spidering technology previously owned by LookSmart, and will begin using it to build an index for the Search...

  8. Search Wikia Launches Open Source, Distributed Crawler

    Speaking at the O'Reilly Open Source Convention (OSCON), Wales announced that Wikia has acquired Grub, the distributed search spidering technology previously owned by LookSmart, and will begin using it to build an index for the Search Wikia project.