How Search Engines Look at Links

A special report from the Search Engine Strategies 2002 Conference, March 4-5, Boston, MA.

A longer, more detailed version of this article is
available to Search Engine Watch members.
Click here to learn more about becoming a member

Representatives of Google, Fast, and Ask Jeeves/Teoma shared inside information about page ranking and linking analysis at the Search Engine Strategies Conference in Boston, March 4th.

The panel, featuring Ask Jeeves Vice President of Search Paul Gardi, FAST Software Engineering Manager Rolf Michelsen, and Google's Director of Technology Craig Silverstein, offered candid views on how their search engines evaluate web sites to determine relevancy and ranking.

Craig Silverstein said Google from the outset wanted to use a more human process to determine if a site had value related to particular keyword phrases. Looking at meta data, he said "We began developing a mathematical way to determine if others think your site has value."

Google evaluates the number of incoming and outgoing links to a site, the circular associations of linking around the Web and data related to communities of Web sites, trying to identify local areas with unique themes in common.

According to Silverstein, it's relatively easy to get good ranking in Google. "If you make it easier for us we like you," he said. He stressed that you should be associated with reputable sites, making sure those sites have keywords related to yours. It's also crucial to use targeted keywords throughout your site, and have relevant explanatory text around your keywords and links.

Paul Gardi from Teoma/AskJeeves said, "We begin with text analysis." Next, Teoma considers "general popularity," comparing sites, for example, with one link coming in vs. a site with three links coming in.

Gardi stressed that link popularity alone wasn't enough. "Spamming techniques can create problems so we also look at status," he said. What is status? Higher status sites have a number of quality sites linking to them. You want these high-status sites linking to you.

"Using Direct Hit ['s now defunct search engine”, we add click popularity to help us form Local Subject Communities," said Gardi. This means that Teoma evaluates a whole community of sites to see if there are common themes that unite them and if there are "authority sites" in that mix. Teoma is constantly "...looking at members of the community to see who they have chosen as authorities," said Gardi.

For good ranking, he added that you need to make sure there are some strong "authority" sites in your community of links, sites within a common thematic mix, and sites with a significant number of links in to them.

Rolf Michelson from FAST (which powers Lycos Search in addition to its own search engine), said FAST first looks at the network of linking within a site and for a consistent theme. He described the process of link evaluation as looking for "content ranking" or "content classification." FAST is "...forming a bubble, a statistical structure..." within which they can evaluate the kind of company you are keeping.

Ask/Teoma's Gardi summed up the session for all participants, suggesting that for best results, you should optimize all pages, don't mix with bad company, and make sure link text says something important.




Terry Plank is co-owner of the Academy of Web Specialists and Director of Marketing. A search engine marketing professional since 1996, he is also co-owner of a local ISP in the San Francisco Bay Area.

A longer, more detailed version of this article is
available to Search Engine Watch members.
Click here to learn more about becoming a member

Search Headlines

NOTE: Article links often change. In case of a bad link, use the publication's search facility, which most have, and search for the headline.

Online access news
Microsoft patches flaw in MSN and Gopher... Jun 13 2002 1:04PM GMT
Online portals news
Public services through a portal... Jun 13 2002 10:42AM GMT
Domain name news
Senators Weigh ICANN's Future...
Wired News Jun 13 2002 9:50AM GMT
ITAA Calls for Private Reform of ICANN...
Internet News Jun 13 2002 9:08AM GMT
Online search engines news
The Search-Engine Getaway...
New York Times Jun 13 2002 2:12AM GMT
Online content news
Hoaxer strikes online news service again...
USA Today Jun 13 2002 2:02AM GMT
Top internet stories
Web group pushes XML testing...
CNET Jun 12 2002 8:06PM GMT
Online portals news
Bbc Radio & Music New Media Launches Music Portal...
Variety prem Jun 12 2002 3:50PM GMT
Yahoo's Yang transfers 3 million shares...
ZDNet Jun 12 2002 1:44PM GMT
XML and metadata news
Government seeks accord on XML...
CNET Jun 12 2002 11:46AM GMT
Online portals news
Overture Signs Lycos Europe... Jun 12 2002 11:20AM GMT
Online marketing news
The Solution to Spam - Reverse Filtering...
osOpnion Jun 12 2002 7:01AM GMT
Online search engines news
The Power Of Search Engines...
Internet News Jun 11 2002 6:18PM GMT
powered by

About the author

Chris Sherman is a frequent contributor to several information industry journals. He's written several books, including The McGraw-Hill CD ROM Handbook and The Invisible Web: Uncovering Information Sources Search Engines Can't See, co-authored with Gary Price. Chris has written about search and search engines since 1994, when he developed online searching tutorials for several clients. From 1998 to 2001, he was's Web Search Guide.