THE SEARCH ENGINE UPDATE
April 1, 1997 - Number 2
================ About The Update ================
The Search Engine Update is a twice-monthly update of search engine news. It is available only to those people who have subscribed to "A Webmaster's Guide to Search Engines."
================= Introductory Note =================
There are one or two stories reported in the last update that are repeated here due to new changes.
Also, some of you may also be receiving the Search Engine Report. Feel free to continue, if you wish. There's no need to receive both, however. The Search Engine Update has all the same content of the Search Engine Report, except that there are no sponsor ads. The only significant different is the Search Engine Report contains some stories that will have already run in the Search Engine Update.
============ Site Changes ============
There is now a new "Projects In Progress" section in the subscribers-only area, where you may view new additions to the guide while they are being prepared. I hope you find it interesting. The subscribers-only area is located at:
The latest offline edition will be available on April 2 for download. The date will be marked on the download link, so that you can be certain you're not downloading a copy you already have.
The Search Engine Features chart has been completely updated. There are new categories and updated information about how search engines work. I highly recommend revisiting this page to see what's new with the search engines.
Beyond the features page, the "How It Works" pages for each search engine have been updated. These can be found from links at:
================== Search Engine News ==================
New Netscape Net Search Line-Up
Netscape has renewed position contracts with several major search engines for its immensely popular Net Search page. "Premier Providers" will be Excite, Infoseek, Lycos and Yahoo They'll each have a tab at the top of the page, as under the current system.
The fifth tab, now occupied by WebCrawler, will be devoted to other engines called "Marquee Providers." WebCrawler now joins this group.
The change will take effect May 1st. Last time, the engines paid $5 million each for a year's placement. This time, the engines are paying based on the amount of traffic they receive from the page. Netscape is saying the cost should be about the same.
Currently, the top engines are rotated as default choices. Under the new system, users will be able to pick their favorite engine and have it always be selected. They can also pick which of the marquee providers they wish to appear in the fifth spot.
The ability to set a default search engine is significant. If people begin using a preferred engine, traffic to the other engines will drop -- possibly by a noticeable amount.
Netscape Press Release http://www.prnewswire.com/cgi-bin/stories.pl?ACCT=104&STORY= /oracle/dbtmp/77729&EDATE=
Netscape, Search Engines Team Up, CMP TechWeb http://www.techweb.com/investor/newsroom/tinews/mar/0318sear ch.html
Netscape Net Search page http://home.netscape.com/home/internet-search.html
HotBot Launches SmartCrawl
HotBot quietly launched its SmartCrawl system on 3/15, which will eventually index up to 10 million web pages per week. Its major competitors are in the 3 million web pages per week range.
The new system should greatly improve HotBot's freshness. Its crawling had been interrupted while SmartCrawl was brought online.
Submitted pages are to be added within three weeks, along with other pages found when visiting a web site.
AOL Launches AOL NetFind
On March 13, AOL unveiled its AOL NetFind service at Internet World in Los Angeles. In the past, AOL has directed its members to a search page, where they could choose between using Excite or WebCrawler. Now they are directed to the AOL NetFind page.
Under the hood, AOL NetFind is Excite with an AOL look. Excite is crawling the web as normal, and AOL NetFind taps into the Excite listings.
For example, a search for "bill clinton" will bring up the same number of matches and the same ranking order whether Excite or AOL NetFind is used. If there are any differences, it is because AOL's copy of the Excite listings may occasionally be a day or two behind the "main" Excite database.
So, don't worry about trying to submit to AOL NetFind. Your submission to Excite will cover you in both places.
Want to have some fun? Pop over to NetFind and do a search. Now in the address box, look for this at the end:
Cut that part off and reload the page. Surprise! Welcome to Excite, or at least the Excite look & feel. Don't stop there. Pop over to Excite and do a search. Now add those characters to the end of whatever is in the address box. Welcome back to AOL NetFind!
AOL NetFind http://www.aol.com/netfind/
Excite Switches To Channels
Excite announced in mid-March that it would regroup its content into "channels," which are subjects such as "news" and "sports." Search engine results will remain general in nature.
For example, a query sent to the Excite database from someone visiting the sports channel will still bring back results from across the web. There is no technology that will be used to identify or classify "sports" sites.
Of course, most people at the sports channel will probably send sports-related queries, such as "dodgers" or "basketball," so sports-related results will likely be found.
Expect to see the changes slowly occur over the next few months.
Excite changes channels, C|Net News.Com http://www.news.com/News/Item/0,4,8933,00.html
Lycos Launches Redesign
Yesterday, Lycos unveiled a new look, along with a new slogan, "Get Lycos or get lost," which is part of a rebranding campaign now underway.
Content has been reorganized into subject areas, such as "news" and "sports." Sound familiar? Well, it's not channels here. Lycos calls its groupings "WebGuides."
Search engine results are not filtered to match these areas. There are "power searches," but these are merely links that send keywords to the search engine. For example, the "car rental" power search simply sends those words to the Lycos search engine.
Under the hood, there's no sign that the crawling mechanism has been upgraded. That's supposed to occur sometime in April and will mean that submitted web pages will be indexed in near real-time. At the moment, Lycos still promises to add pages in 2 to 4 weeks -- though many webmasters have found it can take twice this time.
Lycos Press Release http://www.lycos.com/press/pressroom.html
Yahoo Takes Over Netscape Destinations Page
Somewhat related to Netscape's Net Search page is the Destinations page. This is reached via a button in Netscape Navigator, just like the Net Search page. A site listing here is a guarantee of increased traffic.
Yahoo is to take over production of this page and related pages such as What's New and What's Cool. It is paying Netscape $5 million to do so, plus Netscape will get a share of ad revenue generated by the site.
For web developers and users, the takeover probably means better information on those pages. For example, the Netscape What's Cool page was last updated February 20. The takeover is to occur by July 1.
Netscape Press Release http://www.prnewswire.com/cgi-bin/stories.pl?ACCT=104&STORY= /oracle/dbtmp/78735&EDATE=
Yahoo, Netscape strike deal, C|Net News.Com http://www.news.com/News/Item/0,4,8920,00.html
Netscape Destinations page http://www.netscape.com/escapes/index.html
Alta Vista Mirror Semi-Perfect Reflection
A number of people have noticed that results from Alta Vista's European mirror don't exactly match those from the main US-based search engine. This is because the European mirror is slightly behind the US site. If the indexes are not exactly the same, then results will not be exactly the same.
Alta Vista says the European site should never be more than a week behind the US. My testing supports this. A page submitted to Alta Vista appears in the US edition in a day and in the European edition in a week.
There's no way to submit directly to the European site to bypass this delay. Submissions done via pages at the European site simply prompt the US-based spider to visit your site. Next time you submit a page, notice the URL that appears in the confirmation page. You'll see that it's from the altavista.digital.com domain. It'll look something like:
Meanwhile, Alta Vista has made some changes that make using the European edition easier. By entering a country code, you can do directly to language-specific version for your country. For example, those wishing the English version from Great Britain would enter:
A full list of country codes is linked to below.
Alta Vista US http://www.altavista.digital.com/
Alta Vista Europe http://www.altavista.telia.com/
Alta Vista Europe Country Codes http://altavista.telia.com/telia/tmpl/gb/news/countrycodes.h tml
Alta Vista Vs. Alta Vista
Ever try to reach Alta Vista by accidentally typing http://www.altavista.com? If so, you ended up at the home page of Alta Vista Technology, a completely unrelated company.
Lots of people apparently make that mistake, so much so that Alta Vista Technology changed its home page to look very similar to the Alta Vista search engine page, complete with search box. The company sold ads to earn money off the confusion.
As you might expect, the Alta Vista search engine people weren't happy. They sued and now have won an injunction that requires Alta Vista Technologies to place a disclaimer on every web page, as well as a link to the Alta Vista search site.
AltaVista wins injunction, C|Net News.Com: http://www.news.com/News/Item/0,4,8900,00.html?latest
PC WEEK: Digital wins injunction in AltaVista legal snit http://www.pcweek.com/news/0317/18malta.html
Alta Vista Search Engine http://www.altavista.digital.com
Alta Vista Technologies http://www.altavista.com
G.O.D gets E-mail
G.O.D. (Global Online Directory) has gained email and telephone number search abilities through a partnership with Four11. G.O.D. is one of Europe's leading search directories.
More Infoseek News
Some more news from Infoseek, which had a busy month in March:
Infoseek will now be featured throughout CNN's various web sites as the preferred method of searching the Internet. In addition, news stories will have an option allowing users to search the Internet using Infoseek for sites related to the story.
Infoseek is also shipping its software for those who wish to index web sites or Intranets. The product is called Ultraseek Server.
Italian and French editions of Infoseek have been launched.
Infoseek What's New http://info.infoseek.com
Ultraseek Information http://software.infoseek.com
Excite Joins With Quote.com
Excite is now partnered with Quote.com, allowing visitors to the Excite web site to access stock quotes, stock headlines and stock articles.
Send in the search party http://go2.guardian.co.uk/theweb/859389571-alta.html
A journey behind the scenes at Alta Vista, from the United Kingdom's Guardian newspaper.
The Internet: Bringing Order from Chaos, Scientific American http://www.sciam.com/0397issue/0397intro.html
A series of articles on search engines, heavy on technical issues of improving searching and categorizing. There's a nice sidebar in advances in image searching. Find out how software could identify 43% of the nude photos in a sample collection.
April Fools Headlines
In honor of April Fool's Day, some fictional headlines I hope brighten your day. I expect a commission check if any of these stories come true :)
Alta Vista LoudTopics First it was LiveTopics, and now Alta Vista has rolled out LoudTopics. The new feature makes Alta Vista the first fully-audio search engine. Users pick a mode ranging from "Newbie-Helpful" to "Rude." Those selecting the latter are treated to the engine shouting "Get a dictionary!" when they misspell a keyword. Less-adventurous souls get prompts like "Don't worry. Lots of people get over 2,000,000 matches to a search. Shall we try again?"
Star Trek: Excite Excite announced a Star Trek-branded version of its search engine today. Star Trek: Excite has the look and feel of a Star Trek computer PADD. Fans have the choice of hearing "Working" or "Make It So" when clicking on the search button, and a result without any matches causes the engine to prompt, "Illogical."
Microsoft Search Microsoft entered the search engine market with Microsoft Search. The engine employs a unique ranking mechanism that gives pages a boost if they use Active X. The more Active X on a page, the better it performs. Unfortunately, a security flaw marred the debut. A 10-year old boy discovered a way to cause Microsoft Search to unlock the doors of a user's home anytime the Search button is pushed. Microsoft is rushing a patch.
Netscape JavaSearch Not to be outdone by Microsoft, Netscape is launching its own search engine. The search engine employs a unique "Netscape Now" crawling mechanism. If it detects a Netscape Now button on a web page, the page is included in the index. The engien will be reachable via the Net Search button, where it will now be listed as "Supreme Provider," over the Premier and Marquee Providers already on the page. Netscape has apparently paid itself $5 million for the placement.
=========================== New Search Engine Resources ===========================
Search Engine Mailing Lists There are two excellent mailing lists relating to search engines. The "search" mailing list is for those who want to discuss searching the web. The "robot" mailing list deals with technical issues relating to search engines and robots.
To subscribe to the search list, send email to [email protected], with "subscribe" as the message. Archives are at http://www.mccmedia.com/search/.
To subscribe to the robots list, send email to [email protected], with "subscribe" as the message. Archives are at http://www.mccmedia.com/robots/.
Search Engine Message Board The authors of "Search Engine Tutorial for Web Designers" have added a web-based message area for discussions about search engines and web promotional tactics. Aside from the board, the site covers search engine design issues. If you lke the Webmaster's Guide to Search Engines, then the Search Engine Tutorial is another book to add to your virtual bookshelf.
Search Engine Tutorial http://www.digital-cafe.com/˜webmaster/set01.html
Message Board http://www.digital-cafe.com/˜webmaster/set08.html
1,001 Best Internet Tips: Search Engines, PC Computing Pick up some tips on searching the web.
========= End Notes =========
To unsubscribe from this list, send a message to [email protected], with the following in the subject field:
If you have problems, just send a message to [email protected]
This newsletter is Copyright (c) Danny Sullivan, Calafia Consulting. It should not be distributed. If you are not a subscriber and somehow are receiving a copy of the newsletter, learn how to subscribe at:
Know your Ambiguous Customer: Effective Multi-Channel Tracking
Wednesday, June 5 at 1pm ET - Learn why a move from the "batch and blast" email approach enables better conversations with your customers.
Register today - don't miss this free webinar!