Articles on Crawler

RSS

Majestic SEO Adds Fresher Index & Free URL Submitter

majestic-url-submitter

Majestic SEO is expanding yet again. Fresh off of announcing the Majestic SEO Fresh Index increased to 90 days, the Majestic SEO Team has just introduced a new URL submission tool open to everyone, not just their paid subscribers. Majestic SEO is expanding yet again. Fresh off of announcing the Majestic SEO Fresh Index increased to 90 days, the Majestic SEO Team has just introduced a new URL submission tool open to everyone, not just their paid subscribers. 0 Comments

Blekko SEO Tool Now Gets More Up-To-Date Info from Search Engine Crawler

blekko-seo-july-2012

Blekko has integrated more recent crawl data from their search engine crawler into their free SEO tools, giving marketers access to link data, duplicate content reports, and more, populated with information that may be just minutes old. Blekko has integrated more recent crawl data from their search engine crawler into their free SEO tools, giving marketers access to link data, duplicate content reports, and more, populated with information that may be just minutes old. 0 Comments

New Signals to Search Engines Revisited

traffic-signals

Search engines have evolved from primitive crawling technology and now have a very powerful combination of signals. This downloadable PDF “thought paper” shows how end user data, social, mobile, and personalization are shaping the future of search. Search engines have evolved from primitive crawling technology and now have a very powerful combination of signals. This downloadable PDF “thought paper” shows how end user data, social, mobile, and personalization are shaping the future of search. 0 Comments

Google News Content Now Crawled via Googlebot

google-news

Due to an infrastructure change, Google News is now using the Googlebot instead of a dedicated crawler to examine web content. While most elements remain the same, webmasters should be aware of some minor differences in indexing and crawling. Due to an infrastructure change, Google News is now using the Googlebot instead of a dedicated crawler to examine web content. While most elements remain the same, webmasters should be aware of some minor differences in indexing and crawling. 0 Comments

How Search Engines Work

google-remarketing-magnifying-glass

How search engines work, including the difference between crawler-based search engines and human-powered directories. Explanation of what a spider is and how it crawls web pages. How search engines work, including the difference between crawler-based search engines and human-powered directories. Explanation of what a spider is and how it crawls web pages. 0 Comments

Yahoo Reawakens The Paid Inclusion Debate

Yahoo drew widespread criticism for new paid inclusion programs launched in March. What is Yahoo doing? How does it impact the advertiser and searcher? Are there changes Yahoo should be making? The first in a series of articles looking at paid inclusion. Yahoo drew widespread criticism for new paid inclusion programs launched in March. What is Yahoo doing? How does it impact the advertiser and searcher? Are there changes Yahoo should be making? The first in a series of articles looking at paid inclusion. 0 Comments

LookSmart To Buy WiseNut

LookSmart announced last month its intention to purchase the WiseNut search engine, which it hopes will turn LookSmart into an all-in-one solution for portals, internet service providers and others who need a search solution. LookSmart announced last month its intention to purchase the WiseNut search engine, which it hopes will turn LookSmart into an all-in-one solution for portals, internet service providers and others who need a search solution. 0 Comments

Lycos Redeems Itself With Relaunch

It's been some time since I would have suggested that anyone turn to Lycos to search for anything, but today's relaunch of Lycos is a surprising reversal of the service's decline. If you gave up on Lycos in the past, it is well worth revisiting the improved service. It's been some time since I would have suggested that anyone turn to Lycos to search for anything, but today's relaunch of Lycos is a surprising reversal of the service's decline. If you gave up on Lycos in the past, it is well worth revisiting the improved service. 0 Comments

Inktomi Launches New Paid Inclusion Program, Search Improvements

Inktomi has rolled out a new paid inclusion program for those wishing to list 1,000 pages or more with the service. In addition, Inktomi also unveiled yesterday new changes to how the service indexes and ranks web pages. I'll be bringing more detailed articles on both of these developments next issue, but here is a summary of key points: Inktomi has rolled out a new paid inclusion program for those wishing to list 1,000 pages or more with the service. In addition, Inktomi also unveiled yesterday new changes to how the service indexes and ranks web pages. I'll be bringing more detailed articles on both of these developments next issue, but here is a summary of key points: 0 Comments

Inktomi Debuts Self-Serve Paid Inclusion

In a landmark move, Inktomi announced a new partnership with PositionTechnologies this week that allows site owners to pay for guaranteed inclusion in theInktomiindex. While paid submission (or "pay for consideration") systems have operated at human-powered Yahoo andLookSmart for some time, we've never had a major crawler-based service offersomething similar. In addition, paid inclusion means that pages willabsolutely be guaranteed to be listed, while in paid submission systems, nosuch assurances are offered In a landmark move, Inktomi announced a new partnership with PositionTechnologies this week that allows site owners to pay for guaranteed inclusion in theInktomiindex. While paid submission (or "pay for consideration") systems have operated at human-powered Yahoo andLookSmart for some time, we've never had a major crawler-based service offersomething similar. In addition, paid inclusion means that pages willabsolutely be guaranteed to be listed, while in paid submission systems, nosuch assurances are offered 0 Comments

New Go Site Goes Up

Having given up its goal of being a portal to please all people, the new Gosite was formally unveiled last month. While you may have heard talk about thesite being transformed into a starting point for those seeking "freetime"information such as entertainment, leisure and lifestyle content, so far itinstead retains features that may appeal to general searchers.Specialized freetime information may come in the future, but for now, even Goadmits that the big push is to emphasize search Having given up its goal of being a portal to please all people, the new Gosite was formally unveiled last month. While you may have heard talk about thesite being transformed into a starting point for those seeking "freetime"information such as entertainment, leisure and lifestyle content, so far itinstead retains features that may appeal to general searchers.Specialized freetime information may come in the future, but for now, even Goadmits that the big push is to emphasize search 0 Comments

Submitting For Free

Now that all of LookSmart's major partners are offering the paid LookSmart ExpressSubmit program on their own Add URL pages, a number of people believe that they mustalso pay a fee to be listed in the non LookSmart-powered portions of these search engines. Huh? What? Don't worry. Justcome along with me on a little tour, where I hope to make more sense out of the whole submissionmess that has developed.LookSmarthttp://www.looksmart Now that all of LookSmart's major partners are offering the paid LookSmart ExpressSubmit program on their own Add URL pages, a number of people believe that they mustalso pay a fee to be listed in the non LookSmart-powered portions of these search engines. Huh? What? Don't worry. Justcome along with me on a little tour, where I hope to make more sense out of the whole submissionmess that has developed.LookSmarthttp://www.looksmart 0 Comments