A longer, more detailed version of this article is
Over the past month, AltaVista has been busy making some under-the-hood changes to improve its search results. In particular, the service has upgraded its shopping search and is "blending" links that lead to its shopping search engine for appropriate queries into its main results. How searches themselves are processed has also been changed.
Do a search for product oriented information, such as "dvd players," "inline skates" or "computers" and you'll see the new shopping search links appear. They look similar to AltaVista's regular numbered listings and appear just before these. They usually begin "Compare Prices and Features on..." followed by your search terms, and the words "Shop Smart" also appear next to the link. Selecting the shopping link takes you to the AltaVista shopping search engine, where you can obtain product pricing from over 600 online web merchants.
"We've learned that 20 to 25 percent [of searches” are shopping related searches, but the average user may not know how to get to our shopping vertical," said Ganon Giguiere, senior director of search verticals at AltaVista. By integrating the links to shopping search in the main results, AltaVista hopes to better serve its users.
Naturally, getting people into the shopping search area also benefits AltaVista. Some of the merchants pay AltaVista to be included, but the "vast majority" don't, Giguiere said. Most major shopping search engines do have some type of payment model with merchants, and as long as there's a wide variety of major, reputable companies, I don't think users need to fear these deals.
I'm pleased to see the shopping links integrated as they are, and I'll be looking forward to watching how AltaVista integrates other links to new verticals that it plans to launch in the near future. For the most part, users would benefit by finding better specialty search tools. It's simply been a big challenge to figure out how best to direct them, as I've covered more in the separate "Being Search Boxed To Death" article (see below in the newsletter).
For the most part, I'd rather one or two targeted vertical links replace all the "dumb" links that appear in response to any query. For instance, search for anything on AltaVista, and you'll always get "Extend Your Search" links at the bottom of the page that include whatever you searched for, even if it is absurd that you would do this -- a search for "korean war" makes this area suggest things like "Shop the web for korean war" and "Searching for korean war? Find it at Casino-On-Net.com." Nor is AltaVista alone in having these dumb links. Removing them would eliminate clutter from the result page and ought to increase usability.
AltaVista's shopping search service lets you compare prices, but I'd also like to see product information added. It would be great to see the service expanded to pick up product reviews and consumer information from key sites, which would help it be more than an online mall.
If you like the shopping search service, it remains accessible also from its own home page, plus the service can be customized to turn off product pictures, increase the number of results and place the "Shop Near You" section first on the page.
Shop Near You is completely new. This is information that comes from "brick and mortar" stores near your home. You give AltaVista your zip code, and it pulls back matches powered by information from SalesHound.com. This can be especially helpful if you prefer to use AltaVista Shopping to do online research, then find a local vendor with a "real" store that you can visit. In addition, auction listings from uBid for products can also be found.
I noticed some bugs with the shopping link integration. Try a search for "pc computers," for example, and rather than a generic "Compare Prices" style link, you'll get a link to a specific product. I don't think the user experience is as good, in these cases. "Cordless mouse" was another example, but fortunately, I didn't see many other instances.
The next vertical search product to appear will be news. Giguiere said will contain stories from many leading news providers. Finance, real estate and travel verticals are also planned. In all these cases, links to the appropriate vertical service will be integrated as with shopping into the main results page, appearing in response to appropriate queries.
Don't forget that AltaVista already has a variety of vertical search tools that you can reach by using the "tabs" above the search box on the results page. Within the AltaVista Tools area, you can also access specialty search features that let you search against US educational sites or US government sites.
Beyond the vertical links, AltaVista has upgraded how it processes search requests, being more expansive with what it returns. Here's a look at the new "query reformulation" changes.
Single word queries are easy -- AltaVista will return any pages it knows of that contain that particular word.
For multiword queries of between two to four terms in length, AltaVista continues to perform automatic phrase detection. This means that it looks to see if there are any recognized phrases that match a dictionary of about 500,000 phrases it maintains. If your search terms appear in the phrase dictionary, then AltaVista automatically translates your request into a phrase search. For example, if you search for:
the request will be turned into a phrase search behind the scenes, even though you didn't specifically request this by placing quotation marks around the terms.
AltaVista has done automatic phrase searching like this since November 1998. However, in a twist that began in February, it now goes beyond providing only exact phrase matches and will also return pages that contain all of the words in your query, even if they aren't contained in an exact phrase. For instance, consider a search for
new york stock exchange
AltaVista will look for pages that match the exact phrase, but then it also finds pages that have all four words on them, even if they don't occur in that exact order.
Before this change, if you had searched for an exact phrase and there were no pages or few pages with that exact phrase, you would have come up with no results or only a few matches. With this change, AltaVista better ensures that its automatic phrase detection, which is helpful in many cases, doesn't leave users without results in some situations.
"The advantage of not removing documents without the phrase is that sometimes the exact phrase isn't exactly how the page describes the concept. For example, the user might be looking for information on Clinton's cybersecurity proposal. The user enters: 'president bill clinton cybersecurity,' said Vaughn Rhodes, senior director of product marketing for AltaVista. "None of the documents discussing the proposal use that specific phrase [so would be missed the old way”. The new AltaVista technique correctly returns those documents."
Finally, in situations where there are five or more words, AltaVista continues to do phrase detection, and then it will seek pages that have ANY of the words on them, rather than ALL of them.
"When users enter a small number of query concepts [such as two to four words”, they are usually looking for documents that have all of the terms in them. However, when large numbers of concepts are used [five or more”, users tend to be in a 'find stuff like what I describe here' mode, in which they don't necessarily require that every term they enter is present," Rhodes said.
AltaVista clearly hopes the changes will mean better results for average web users, and most people probably will be fine letting AltaVista do the driving, so to speak. However, advanced searchers may still prefer to control AltaVista themselves by using power commands such as the + symbol or Boolean operators. AltaVista says that if such commands are used, they'll take precedence over the internal logic it tries to follow. That hasn't been the case in the past, and I haven't had a chance to look closely to see if this is indeed happening. In addition, AltaVista's power and advanced search pages have none of the behind-the-scenes processing happening.
"The query document selection technique changes apply only to the main search box, not to Advanced or Power Search. Users of those interfaces won't see any changes. In addition, if users enter into the main search box the syntax elements that were used in the previous technique [such as +, -, or quotes”, we will automatically fall back to the previous methodology," Rhodes said.
Related to search processing, another relatively new feature is the ability to search within results at AltaVista. After performing a search, just check the "Search Within Results" box under the search box on the results page. Then you can do a new search just against the first set of results retrieved.
Also, be aware that if you get to the bottom of the page and want to see more results, you might accidentally select the "More Sponsored Listings" option, if you aren't careful. That brings up more advertisements from GoTo. Instead, if you want more editorial listings, you need to select any of the "Results Pages" numbers or the "Next" link. These appear near the bottom of the results page and just above the "Sponsored Listings" heading.
In yet more under-the-hood changes at AltaVista, the company says that it now has in excess of 500 million web pages indexed, up from its previous 350 million and in line with the full-text indexes other major crawlers such as Inktomi, Google and FAST.
A longer, more detailed version of this article is
Access to the AltaVista education and government search engines can be found here, on the left-side of the page. The Power Search page is also listed with them.
Being Search Boxed To Death
The Search Engine Report, March 5, 2001
Overview of how search blending such as that being done at AltaVista may improve the search experience for users.