SEO News

Search Engine Crawlers Meta Keywords Tag

  1. SEO Site Structure 101, Part 1

    A search engine sends out agents (a.k.a.spiders, robots, crawlers) to surf the Internet and bring back what they find and deposit that information in the search engine's databases. The meta keywords tag is sometimes useful as a way to reinforce the...

  2. Search Engines And Legal Issues

    Crawlers face another legal roadblock, due to a injunction last month preventing Verio from running a robot to gather potential customer leads from's publicly-accessible WHOIS database. They also operate powerful crawlers.