The Search Engine Update, Nov. 4, 1998, Number 40

Search Engine Watch

November 4, 1998 - Number 40

By Danny Sullivan
Editor, Search Engine Watch

About The Update

The Search Engine Update is a twice-monthly update of search engine news. It is available only to those people who have subscribed to Search Engine Watch,

Please note that long URLs may break into two lines in some mail readers. Cut and paste, should this occur.

In This Issue

+ General Notes
+ AltaVista Debuts New Search Features
+ AltaVista Photo Finder Has Artists Concerned
+ Ask Jeeves: Asking Questions To Give You Answers
+ Lycos Buys Wired, Gets Facelift
+ Direct Hit Begins Netscape Trial, Has New Partners
+ AltaVista Northern Europe Looks Gone For Good
+ Search Engine Notes
+ Subscribing/Unsubscribing Info

General Notes

Hello Everyone-

It's been a busy month, especially with the huge changes at AltaVista. Consequently, many site updates I had meant to do have been pushed back. I expect to be very busy this month adding links and integrating material from past newsletters into the site. Changes will be noted on the What's New page as they happen. And, if you've sent me submissions recently -- relax, I did get them, and now I'm actually looking through them in more detail.

I have added a new section to the Subscribers-Only Area: the Search Engine Gallery. Search engines have been remaking their home pages and result pages significantly over the past year. I've made snapshots at different points, and I think you will find visually reviewing the changes to be interesting.

This is definitely a Project in Progress. There are lots of gaps, and I haven't annotated the pages yet. Also, be aware that the pages take time to load -- this is definitely a graphic intensive area.

Search Engine Gallery

What's New

Search Engine News

AltaVista Debuts Search Features

AltaVista introduced a number of significant new search features in October, including the display of relevant results from the Ask Jeeves answer service, a new filtering option and a photo search service.

Those performing a standard web search at the service may now receive information from up to four different sources on the search results page, a combination that AltaVista has dubbed "Full View Searching." The hope is that more sources mean better odds that a searcher will come away with relevant results.

Most notable are the new "Ask AltaVista" results, a branded version of the Ask Jeeves service. These results appear in response to many queries, under the heading of "AltaVista knows the answers to these questions."

These Ask Jeeves results gives AltaVista a real edge in terms of relevancy over its competitors, because the results are often exactly on target in response to a query.

A separate article below describes the Ask Jeeves system in more detail. In short, editors have created 7 million questions, which are linked to web pages that provide answers.

For instance, when you search for "software," Ask AltaVista responds with questions such as "Where can I find product reviews for software?" Clicking on the answer button takes you to a site with reviews.

Doing the same search at Ask Jeeves will reveal many more answers. AltaVista is saving screen real estate by listing only the first answer, though in some cases, it will display a "More Answers" link. A better way of getting more suggestions is to phrase your search as a question.

For example, "Where can I buy software?" causes AltaVista to display several questions, such as "Where can I find good deals on new software" and "How can I buy wholesale computers, peripherals & software?"

The second source of search results is from RealNames, through a partnership AltaVista established earlier this year. RealNames is an alternative web site address system, especially meant to deliver people directly to the correct site when doing brand-oriented searches such as "nike" or "barnes & noble." A past Search Engine Report article listed below describes the system in more detail.

The RealNames link used to be at the top of the page. Now it comes between Ask AltaVista results and matching web pages. Look for the description that says, "Official company or product home page by RealName."

The previous prominence of the RealNames link had been good news for webmasters, who have registered semi-generic names. Now the demotion of the link may mean a drop in related traffic.

To explain, understand that RealNames won't register a generic name, such as "shoes," to any site. So if someone searches for "shoes" at AltaVista, then clicks on the RealNames link, they will be taken to the RealNames search engine and shown a list of RealNames that contain the word "shoes."

Thus, someone who registers a name like "Tom's Shoes and Boots" has been getting indirect traffic. It can be quite significant and usually well worth the $100 yearly fee per name.

With the RealNames link no longer occupying top position in many of AltaVista's search results, this traffic is likely to drop. However, the RealNames partnership should begin soon with LookSmart, and RealNames is promising that another significant partnership is in the works. So, it is likely that registering names will still be worthwhile for many sites.

Matches from the AltaVista web index make up the third source of information being offered to searches. Here, the service has introduced a number of changes meant to improve the relevancy of its core offering.

First, AltaVista says there has been a relevancy change, especially designed to improve results for simple and popular terms.

"We have totally revamped our ranking algorithm," said Louis Monier, AltaVista's chief technical officer, "Not only for technical questions, but also the simple questions such as cars, real estate or wine."

Monier was closed mouthed about what specifically has been done to improve results, but they do not seem to include non-textual criteria, such as link popularity or boosts for reviewed sites, which has been remarkably effective at Infoseek.

In fact, I ran a quick comparison of the examples Monier cited against Infoseek's results. I felt Infoseek's results for these generic terms were impressive and far better than AltaVista's.

At AltaVista, there does seem to be a stronger emphasis on home pages in some cases -- these appear to carry slightly more weight in the system in response to single word and popular searches. Other positive factors seem to include short, focused titles, use of phrases in the meta keywords tag and minimal repetition of words in meta tags. There are exceptions to all of these, of course -- your mileage may vary.

Other behind the scenes changes are also at work, with one of the most important being automatic phrase searching.

Many people would benefit if they did phrase searching. For example, a search for "new york" -- with quote marks around the words to indicate an exact phrase should be matched -- is likely to provide better answers than a search that simply looks to see if any or all of the words appear on a page.

Since most people don't bother with using special commands like the quote marks, AltaVista has made it easier for many by making phrase searching automatic.

"We have built a huge dictionary of several million phrases," said Monier. "Essentially, the need for quotes has gone down to zero. If you look for New York, you don't need to quote New York."

Monier said the phrase detection has been built through a completely automated process, which takes advantage of linguistic patterns to determine what is a phrase, and what isn't.

Determining if phrase searching is active for a query is easy. Simply repeat the search using quotes. If phrase searching was on, the results should be the same. The match count should also be very close, though it may be slightly different given AltaVista's long standing problem in delivering accurate counts. If phrase searching was not on, you should see slightly different results and very different counts.

You cannot override the function in basic search mode, but it is not active when performing an advanced search.

AltaVista has also introduced spell checking, a first for a major search service, and something that is long overdue. Yahoo has been experimenting with it off and on for several months, but at AltaVista, it's now a full-time option.

"We estimate one in five queries is misspelled," Monier said, such as "virtual" spelled as "vurtual." In other cases, people fail to separate words, such as "networkcomputer" instead of "network computer."

AltaVista won't change a misspelled query. Instead, it offers a prompt on the search results pages with other suggestions. When triggered, they appear just below the search box with the words "Spell check." Spell checking works for queries in English, French, Spanish and Italian.

One change AltaVista could really use is results clustering. Often, the top results seem to be dominated by pages from one site. Do a search for "sports scores," for example, and six out of the top 10 results are from CBS SportsLine. SportsLine operates various domains, and AltaVista is listing the same page under slightly different addresses. Clustering could help improve the chances that one site wouldn't crowd out others like this.

Do a search for "mad cow disease," and you'll see a similar situation where two sites occupy five of the top ten listings. Additionally, spots two and three are taken up by pages that aren't in English. They do contain the search terms, but they are predominantly written in Japanese.

I've seen a lot of cases like this at AltaVista, where non-English pages dominate the top ten for English-language searches. One solution is to select "English" from the drop down box that sits just above the search button. That will return only pages identified as being written in English. If you don't specify English, then any page containing your search words may be listed, even if it is predominantly in another language. Naturally, set options accordingly if you only want pages in other languages.

Finally, AltaVista's last source of information is the LookSmart directory. Matching categories from the AltaVista-branded version of the directory appear after web page matches, in a section called "AltaVista Recommends."

These suggestions don't appear in response to all search queries. However, the entire AltaVista directory can be browsed from the home page. Simply start from any topic listed in "Categories," on the left-hand side of the home page, below the search box.

Also on the home page, there are two new search services being offered: filtered search and photo search. Links to both can be found just under the search box, in the "Specialty Searches" section.

AltaVista Family Filter is designed to protect children from seeing objectionable material when searching on innocent topics. For example, a search for "toys" may list pages offering sex toys, complete with graphically explicit page titles and descriptions. AltaVista Family Filter aims to prevent this from happening.

"Once you are in filtered mode, you should not see content from objectionable sites," said Monier.

AltaVista is the second major crawler-based search engine to offer this function. Lycos launched its service, SafetyNet, earlier this year. A third crawler-based service, Searchopolis, is currently in beta. It is powered by Inktomi.

AltaVista's filtering works in three ways. First, the spider tags pages as objectionable, if it finds certain words and phrases used in particular ways. Second, it then uses a filtering process developed in partnership with SurfWatch to catch anything that made it past the spidering identification. Finally, AltaVista allows users to report on any pages that may have slipped through the first two barriers.

Additionally, you should be able to still discover pages that contain sexual terms but which are not pornographic in nature, according to Monier. "It can distinguish between a medical page and a smut page," he said.

For example, a search for "breast cancer" should bring up relevant results about the disease and treatment, but not porn pages, when filtering is on.

To enable filtering, follow the link from the home page. Choose the "Start" button on the next page that appears. When enabled, a small red + symbol will appear in the page header area, to remind you that filtering is active.

AltaVista's new Photo Finder is an impressive new service. Photo search has sort of died away as a major offering with the search engines. Until now, only Lycos was still offering a dedicated crawler-based service. Now AltaVista has entered the scene.

"It is the largest index of images on the web. We have over 11.5 million pictures, most of them obtained by crawling the web," said Monier.

Lycos might dispute the title of largest, as it claims to have 18 million images indexed. But where AltaVista wins hands down is usability. Its results contain thumbnail pictures of images it has found, where Lycos displays only text descriptions. Consequently, it is much easier to spot images of interest at AltaVista.

Not everyone is happy with the thumbnail display, however. While it is great for searchers, some photographers and artists are concerned that AltaVista is violating their copyright by making copies of their pictures without explicit permission, in order to present the thumbnails. See the article below for more details on this issue.

Only about 1/2 million of the pictures in the AltaVista service come from its partnership with Corbus. The rest have been identified by AltaVista's spidering system. In particular, it's the spider hosted at that many people have seen in recent months that has been doing the work.

AltaVista's image identification system operates essentially like that at Lycos. Images are associated with words that appear in their ALT text, file names and on the page. A search looks for matches in this text, not within the images. Monier added that some more sophisticated things are also being done beyond this basic operation, but he declined to provide more details.

One sophisticated thing that AltaVista does offer beyond Lycos is the ability to do a true image search independent of text association. Users can ask to see more pictures that are visually similar to any picture selected.

AltaVista has also introduced one other new feature, meant to make life easier for repeat users: a shorter address. The service can now be reached at


Real Name Tops At AltaVista
The Search Engine Report, June 3, 1998

Kids Search Engines

More services meant to be safe and friendly for children. A link to Searchopolis, mentioned in the article, can be found here.


A new, Inktomi-powered filtered search engine, currently running in beta.

Lycos Pictures and Sounds

The Lycos multimedia search service. It features 40,000 images organized by category, from the PicturesNow catalog. You can browse categories and view thumbnails of these pictures. Search mode lets you scan the web for pictures or sounds of interest, but no thumbnails are provided.


AltaVista Photo Finder Has Artists Concerned

The introduction of AltaVista's new Photo Finder service has raised concerns with some photographers and artists that AltaVista is violating their copyright by making copies of their pictures without explicit permission.

Similar concerns have been raised in the past by webmasters concerned that search engines are indexing their textual content without permission. So far, there's never been a legal suit against any of the search engines regarding this. For the most part, webmasters want traffic, so they don't complain about indexing. Additionally, search engines generally say that they are not presenting entire documents, only summaries, and so they don't fall afoul of copyright violations.

Finally, the robots.txt file and the meta robots tag exist as a way for webmasters to explicitly exclude their content. They work as a de facto automatic copyright notice for spiders. My suspicion is that if there ever was a court case, use of these mechanisms as a "tell us no, otherwise it is OK" permission device would be supported. If not, crawler-based services might find their systems shut down, which would have a negative impact on the entire Internet community.

The situation is different in the image search case. Search engines give just a summary of text documents, but AltaVista is actually displaying complete copies of pictures in its image search results, albeit in low-quality thumbnail form.

This leads into a chief concern that the catalog gives the impression that images displayed may be used freely.

"In all honesty, this is my main complaint about Photo Finder: they've made it too easy for folks to steal people's web graphics, and there's already too much of that. In fact, by so freely reproducing the works of others, they appear to endorse this behavior as a company, in effect, leaving their visitors with the impression, "it's OK to put these on your page, too," said photographer Reid Stott, who has posted a page on the issue for fellow artists.

AltaVista's Chief Technical Office Louis Monier said the service is now working to ease concerns.

"As you can imagine, we are not trying to steal anything or encourage piracy. This is a first, so we were expecting some reactions and are taking action to make the Photo Finder useful for everyone. We are adding the proper disclaimers, and instructions for opt-in/opt-out," he said.

AltaVista has already added a notice to the Photo Finder home page, telling searchers they should seek permission to use the images displayed. Stott and others think this should be more strongly worded, and that it should also appear on results pages, in association with the thumbnail images themselves.

AltaVista has also made another change, in the wake of complaints. Previously, users could click on a thumbnail and download the image without ever visiting the host web site. Now, this is no longer possible.

However, if a user goes through the extra step of choosing "About This Image," then clicking on the "Image" link, they can still download an image without visiting the host site. A similar situation occurs if they view results in "verbose" mode. It is a simple step to plug this last hole, so I wouldn't be surprised to see it changed in the future.

Last, but not least, the fact that the images are being used without explicit permission upsets Stott and other artists.

"I believe it could be both a useful and non-controversial resource. If they'd placed the service online with all those Corbis images, and then allowed people to 'opt-in' to the service through a 'submit site' link, you'd never have heard a peep from me," Stott said. "This would have honored the spirit of copyright law by, in effect, asking permission for the use of copyrighted works in advance, by allowing the content creator to make a choice about the use of their work. It may seem a fine distinction, but it goes to the heart of copyright law: you must obtain permission, in advance."

The big problem with this is that many people would fail to explicitly submit their images, just as web authors already fail to properly submit their web sites or make use of meta tags. That would reduce the effectiveness of the current catalog, which ironically, is an ideal way for artists to discover if their images are being used without permission on the web.

Of course, the real benefit is to web searchers, and it is reasonable to assume that those web searchers are looking for images to use in their sites or elsewhere. This leads back to the issue that the service may encourage piracy.

For artists that wish to protect their images, the robots.txt file option is available, as are two new meta robots tag options that AltaVista has introduced specifically for those with image indexing concerns. These are useful for those unable to use a robots.txt file. Both are described on a special page AltaVista has created to help webmasters understand how to opt out of the service.

Unfortunately, there may be a delay between the time the blocks are installed and when AltaVista actually drops the images. Here, the service made another stumble. It has run its image spider over the past few months without publicly identifying what the spider was for. That meant artists had no idea that this was a spider they may have wanted to block, and so they have been included by default.

One unlikely change is removal of the thumbnails. AltaVista considers them acceptable use that doesn't require special permission, just as a summary of a web page might be considered acceptable use.

"The thumbnails are not the issue (they are an acceptable 'citation'). It's the fact that we linked to the picture with no context that displeased a few people: we now give access to the page, so users can see the entire context. And, of course, we respect the robots.txt file and any request to have images removed," Monier said, via email.

Whether a court case results remains to be seen. The onus is left to artists to block the AltaVista spider, just as with web page authors. The difference is that complete works are being presented, and that the artists receive far less gain from this than web authors do. Thus, they may have more desire to pursue an action.

AltaVista Photo Finder

AltaVista Photo Finder, and how to keep your images "unfound"

Reid Stott's summary of how to keep your images out of the AltaVista Photo Finder service.

AltaVista Help: Excluding Pages From Photo Finder

Instructions from AltaVista on excluding your pages from Photo Finder with a robots.txt file or the meta robots tag.

Compaq Accused Of Copyright Infringement
Newsbytes, Oct. 27, 1998

At least one artist has sent a formal complaint to AltaVista regarding Photo Finder.

News Robot Leads To Linking, Indexing Dispute
The Search Engine Report, Jan. 9, 1998

Discusses how the robots.txt file may be crucial in any indexing dispute that eventually winds up in court.


Ask Jeeves: Asking Questions To Give You Answers

One of the biggest problems that search services face is the fact that people often search too broadly. For example, they enter something like "travel" and then expect relevant results.

Travel what? Travel agents? Places to book airline tickets? Travel guides? If a search engine could talk, it would ask these questions in order to understand exactly what a person is seeking.

Enter Ask Jeeves. The service does an impressive job of getting people to what they want by asking questions.

For example, imagine you want information about cars. Enter "cars" into the Ask Jeeves search box, and the service comes back with questions like:

+ Where can I find product reviews for cars?
+ Which models of cars are most frequently stolen?
+ Where can I locate information on the history of automobiles?

In front of each question is a Go icon. Choosing it takes users to a web site that answers the question.

The secret to the accuracy of Ask Jeeves is human intervention. About 30 people work full time creating the knowledge base of questions, which currently numbers about 7 million. They come up with ideas on their own, especially for popular topics, and they also watch what people are actually searching for.

"One of the really wonderful things about our site is a significant portion of what people input is indeed questions," said David Warthen, cofounder of Ask Jeeves and its chief technical officer. "We've got a very active feedback loop going."

Technology also plays an important role in helping Ask Jeeves provide relevant matches. Do a search for "white house," and notice the questions that come up. Among those that provide White House information is "Where can I find special reports on the news topic Monica Lewinsky?"

The words "white house" aren't mentioned in that question, yet many people might find it relevant for a search on "white house." How is it happening?

At Ask Jeeves, questions are associated with concepts, and concepts are in turn related to each other. So, questions about the White House may be linked to words like "monica lewinsky." Likewise, a search for "kenneth starr" might be associated with "monica lewinsky" and "bill clinton."

These relationships cause unexpected yet often relevant questions to appear. A further twist is that relationships between concepts can grow or diminish depending on what users select.

For example, if many people searching for "white house" choose the Monica Lewinsky question, then that relationship is strengthened. More questions relating to her and the current political scandal may then appear for "white house" searches in the future.

In contrast, a year from now people may be looking for other information when searching for "white house." The relationship with Monica Lewinsky would weaken (no pun intended), and fewer questions relating to her would be presented.

Human editors also review relationships. They can upgrade or downgrade links in response to changing search patterns.

To get the most of Ask Jeeves, be specific and phrase your search as a question. Don't be afraid to ask it exactly what you want -- you'll probably be surprised to find it has an answer.

Of course, Ask Jeeves doesn't know everything. As a back up, it has a metacrawler component. Top results from various search engines appear below Ask Jeeves's own information, or if Ask Jeeves has no information, then metacrawler results appear at the top of the page.

Another feature users may like about Ask Jeeves is its spell check component. If it suspects a mistake, it will say, "I think you may have misspelled something" above the search results, sometimes accompanied by alternative spellings.

A fun feature on the home page is a real time display of actual questions people are asking.

Ask Jeeves has been online since the spring of last year, but its new partnership with AltaVista (see article above) will expose many more people to the pleasure of having good answers. But those looking for more should also consider making Ask Jeeves a first stop.

The partnership with AltaVista also means webmasters may be concerned about being listed in Ask Jeeves. It isn't like a traditional service, where you can submit pages or sites via a page. However, you can suggest a site be linked to a question via email. Simply send a message to

Be smart with your submission. You're likely to have more success if you find there are no existing questions relating to a particular topic. Do some searches, look for gaps, then suggest an appropriate page from your site. Be short, to the point and explain why your site has value.

How about a real life example? I did a search for "meta tags" and noticed that there is no exact question relating to this popular topic. So if I were going to submit, I might send a message like this:


I have a page about meta tags, which would be a perfect answer to questions you are missing, such as:

+ How do I add meta tags to my web site?
+ What is a meta tag?
+ Can meta tags improve my ranking on search engines?
+ How do meta tags work?

I think you'll find helpful to your users, as it is quite detailed and designed for beginners. You'll find the page at:

Thanks for your consideration!

I haven't actually submitted this -- I suspect I'm doing it publicly in this write up! But the main points are clear -- there is a gap you're helping to fill; you're offering up good, specific content, and you're even suggesting some appropriate questions. As always, if you make things easier for editors, you increase the odds of being accepted.

By the way, if you enter "How do I submit to Ask Jeeves?" into Ask Jeeves, you'll be taken to a short paragraph that describes -- surprise -- how to get listed with the service.

Ask Jeeves


Lycos Buys Wired, Gets Facelift

Lycos acquired both a network of new web properties, including the HotBot search engine, and a new look in October.

Lycos announced an agreement on Oct. 6 to acquire Wired Digital, which owns HotBot, HotWired, Wired News, Webmonkey and Suck, through a stock swap valued at US $83 million.

Devoted followers of HotBot needn't worry about dramatic changes, at least for the near future. Plans are to run HotBot as a separate service, especially as it appeals to a different audience than does the main Lycos service. Lycos says there is only a 20 percent overlap in audiences between HotBot and Lycos.

Also, due to an existing multiyear contract, HotBot will continue to be powered by Inktomi. In short, HotBot should continue to be everything that you've liked.

On the heels of the announcement came an overhaul of the Lycos service. This is the latest in a series of significant redesigns Lycos has undergone this year, so users can be forgiven if they feel a bit lost. To provide some guidance, here's a rundown on elements you may discover on the search results page.

Along the left-hand side of the page is a navigational guide, which is designed to highlight content within the site, such as site guides and message areas. These will often be relevant to a particular search topic.

In the main part of the page, paid "Bullseye" links continue to come first, in response to popular search terms such as "travel." After this, a new "First and Fast" section may appear, where Lycos displays links to information it believes will be appealing. Links include content partner sites, pages within the Lycos service and offsite editorial picks.

"We're trying to categorize popular links and known content right at the top," said Lycos product manager Rajive Mathur.

The Matching Categories section comes next, where relevant Lycos Community Guides are listed. These are Yahoo-like lists of web sites, created using automated technology and user feedback. They are one of the best parts of the Lycos service, and I find the quality of picks is often far better than the Lycos web search results.

There are guides for all sorts of categories, such as budget travel, Windows 98 and gender studies. An important change is that Lycos is now listing fewer categories in its search results overall. Previously, a search for "travel" might bring up 10 or 20 travel-related categories. Now, things are designed so that mostly upper level categories are returned, the service says.

Lycos has made the change so that only a few categories are listed, so as not to overwhelm searchers. Lycos has also added descriptions to the categories, so that people know what to expect if they select a link.

"We want to have less links, but more relevant links," Mathur said.

Remember, you can always browse the community guides, in order to get a better idea of all categories offered. Top level categories are listed on the home page, just below the search box. Simply click your way down to an area of interest.

One glitch in the More Categories section is that Lycos is also listing some content that is not from its Community Guides, such as matching Yellow Pages content. Mathur says Lycos is working to correct this.

Below More Categories comes the Check This Out section, where Lycos content partners are given prominent links. Following this are matching web pages from the Lycos index.

The most significant change in the web search results is that Lycos has now instituted clustering. This means that only one page per web site appears in the top listings. The change leaves only AltaVista, Excite and Excite-owned WebCrawler of the major services not to do clustering by default.

Clustering is good, because it means that more sites have an opportunity to be represented in the top results. That offers searchers more choice. However, a flaw with the Lycos system prevents this from happening.

For example, imagine that a web site has four pages in the top results. With clustering, only one page will be listed -- allowing room for three pages from other web sites to be represented. Unfortunately, this doesn't happen. Instead, the search results simply grow shorter. No new sites move up to occupy the "vacant" spots.

Clustering can't be turned off, but the "More Pages" link below each listing allows the presentation of other page from that web site.

Also relating to web page results, I mentioned last month that the Lycos index seemed dated. It still seems woefully stale. Some new sites submitted nearly three months ago that I know of have yet to appear, and I've received similar complaints from various readers.

Furthermore, using the Lycos URL Finder, one can enter a URL and often find its last modified date. This can be a clue to how fresh the index is.

For example, a check on the Yahoo home page reveals a last modified date of July 6. Similar dates can be found for the Microsoft and Netscape home pages. This is an indication that information in the index is rather stale.

Mathur says that the index is constantly being refreshed, and that another catalog update should occur shortly. So we'll all watch and see if things do improve.

Moving over the home page, users will find "Search Options" and "Kids Safe Search" as choices prominently listed at the top of the page.

Kids Safe Search allows users to enable the Lycos SafetyNet filtering mode, which is intended to allow kid safe searching. A past Search Engine Report article below describes this in more detail.

Search Options takes users to the Lycos Pro service, where advance queries can be performed. One relatively new feature, added about four months ago, is the ability to search by language. Lycos identifies pages at the time of spidering and categorizes them into one of 15 languages.



HotWired About To Encounter Its Hard-Charging New Master
Internet World, Nov. 2, 1998

In depth look at Lycos CEO Bob Davis. Excellent reading.

Wired Digital Is Bought by Lycos
Internet World, Oct. 12, 1998

Wired Finds New Network Home
Red Herring, Oct. 9, 1998

A look at how the Wired Digital properties fit into plans for Lycos to establish a network of sites, in comparison to how acquisitions have gone with Lycos rivals.

Kid-Friendly Searching From Lycos, Disney, Ask Jeeves
The Search Engine Report, July 1, 1998

Learn how the Lycos SafetyNet filter works.

Lycos Community Guides Get Comeuppance
The Search Engine Report, April 30, 1998

Describes how the Community Guides are created.


Direct Hit Begins Netscape Trial, Has New Partners

Direct Hit, which debuted on HotBot in August, is now running with two additional partners and under trial at Netscape.

At Netscape, Direct Hit results are now being offered in response to some of the service's more popular search terms, such as "beanie babies" and "horoscopes."

Netscape is testing the technology over the next two weeks, and Direct Hit CEO Mike Cassidy says that feedback so far is running 10 to 1 in favor of the service becoming a permanent addition.

If Direct Hit results are available for your search at Netscape, you'll see a "Top 10 Sites" link appear in the "Start Here" box that appears about many search results.

Direct Hit is also available to Mac users running Apple OS 8.5, as a plug-in to the new Sherlock search utility. See the link below for more information.

Users of AOL's ICQ messaging service will discover Direct Hit will be launching there in beta shortly. Watch the Direct Hit site for more details on how the system will work with the ICQ client.

By the way, in the last issue, I wrote about GlobalBrain's plans to debut profile searching on the web. Direct Hit says that it sees any deal that GlobalBrain may cut as strengthening demand for its technology.

"I think GlobalBrain's entry into this field validates the Direct Hit technology of user-based popularity ranking as the best method of organizing Internet search results, as compared to link-based methods," said Gary Culliss, chairman and founder of Direct Hit.

Additionally, Direct Hit has been developing its own profile-based searching system. As with GlobalBrain, it would deliver results tailored to particular types of people, based on their profiles.

Direct Hit

Direct Hit

Direct Hit for Apple OS 8.5


GlobalBrain To Offer Profile Searching
The Search Engine Update, Oct. 22, 1998

How profile searching works in the GlobalBrain system.

Counting Clicks and Looking At Links
The Search Engine Report, Aug. 4, 1998

More about how the Direct Hit system works.


AltaVista Northern Europe Looks Gone For Good

I still haven’t gotten a straight answer from AtlaVista regarding the closure its former Northern European site -- and lots of people keep asking. Here's the official line so far from AltaVista:

"The change in the AltaVista Northern Europe site is reflective of AltaVista's shift away from licensing its search technology. Instead, AltaVista is focusing on building and leveraging the AltaVista global brand to provide users with the most satisfying and comprehensive Internet experience."

I'm interpreting this to mean that AltaVista isn't going to renew the mirror site arrangement with Telia, either because AltaVista has changed its strategy, or perhaps -- as AltaVista's support staff messaged one reader -- because Telia decided to no longer partner with AltaVista.

Perhaps it was even a mutual decision, but whatever the case, fans of that former site shouldn't get their hopes up that it will return.

The entire situation has been confusing, in that over the past month, AltaVista has continued to list the site as part of its search network. But then, anyone following the link and trying to do a search gets a message that the service has been discontinued and is directed back to the main site.

For example, Danish users are told that the site is no longer running, and "the reason is that AltaVista and Scandinavia Online are working together to make a new and better search engine. You will get both AltaVista's great global index, but also Kvasirs huge Danish catalog."

Swedes are being directed to another search engine, and a similar situation may be happening with other languages.

AltaVista Northern Europe

The site's still up -- but no one is home.


A search engine for those in Denmark, Norway and Sweden (URLs in that order) that appears to use AtlaVista technology to custom crawl Scandinavian sites.

European Search Engines

Even more alternatives for everyone in Europe.

Search Engine Notes

Searchopolis Offers Filtered Search Option

N2H2's filtered search service, Searchopolis, went up in beta in October. The service is powered by Inktomi. I expect to bring you more details in a future issue about the technology involved.



Privacy Concerns About Smart Browsing

Researchers at Interhack have posted a document outlining concerns about information that Netscape's What's Related feature reports back to Netscape's servers. They describe how it is possible to determine the various web pages an actual individual has visited, which could possibly be abused. They say a similar situation is true for those using Alexa, whose technology Netscape uses for its What's Related feature. The authors make no accusation that the information is being abused, but rather they point out that the possibility for abuse exists.

What's Related: Everything But Your Privacy

Smart Browsers Ease Searching
The Search Engine Report, July 1, 1998

More details on Netscape's Smart Browsing features.

Search Engine Articles

A Small Quarterly Profit for Excite, But Investors Are Looking for Consistency
Internet World, Nov. 2, 1998

Excite finally shows a profit, but it still has a way to go.


Highlights Of Online World 98
Mining Company Web Search Guide, Oct. 19, 1998

Unfortunately, I wasn't able to attend Online World 98, a gathering of research and library professionals that featured a panel of search engine product managers. Fortunately, Chris Sherman of the Mining Company's Web Search guide did attend. Read his write-ups on important panels and tips from the show.

Sponsor Messages

Below are sponsor messages that ran in this month's issue of the Search Engine Report, which may
be of interest to Search Engine Update readers.


When a prospect does a search for a keyword related to your products or services, do you appear in the top 10 or does your competition? Submitting alone does nothing to insure good visibility. WebPosition is the first software product to monitor and analyze your search positions in the top search engines. WebPosition has been compared to similar "services" on the web and has been overwhelmingly voted the best and most accurate tool for search position management.

With WebPosition you'll know your exact positions for an unlimited number of keywords. You'll know if you drop in rank. You'll know when a search engine FINALLY indexes you. You'll know when you've been dropped from an engine. WebPosition is rated 5 out of 5 stars by ZD Net, and includes a 110 page guide to improving your search positions.

Try WebPosition yourself for FREE at:

=================== makes it easy for anyone to start an email group.
It's flexible and FREE, and a great way to keep in touch with:

*co-workers *family *colleagues *alumni *teams
*people interested in almost any topic *customers Join more than one million members in discovering
the power of free email groups at......

End Notes

How do I unsubscribe?
+ Send a message to with the following as the first line of the body:
signoff search-update

How do I subscribe?
The Search Engine Update is only available to paid subscribers of the Search Engine Watch web site. If you are not a subscriber and somehow are receiving a copy of the newsletter, learn how to subscribe at:

How do I see past issues?
Follow the links at:

Is there an HTML version?
Yes, but not via email. View it online at:

How do I change my address?
+ Send a message to

I need human help!
+ Send a message to DO NOT send messages regarding list management or site subscription issues to Danny Sullivan. He does not deal with these directly.

I have feedback about an article!
+ I'd love to hear it. Use the form at

This newsletter is Copyright (c) Mecklermedia, 1998