Google Demos Word Clustering

Andy Beal has a nice write-up of Google showing off its word clustering tools at the recent Web 2.0 conference: Web 2.0 - Exclusive Demonstration of Clustering from Google. Jason Calacanis also has an MP3 audio file of the presentation you can listen to.

We've had some hints at such technology before. Google Sets, which was released in 2002, lets you enter some terms and see other terms that may be related to it.

Related Searches came-and-went quickly with Google AdWords and have occasionally popped up in the past on a very small sample of Google users (see an example here).

Neither Google Sets or Related Searches provide clustering as was demonstrated or as can be seen via Vivisimo (or Vivisimo's recently launched consumer site Clusty). But some of the underlying clustering technology may be used for these.

Also interesting is mention of Google excluding "noisy" data to focus on the key part of a page. It's common that search engines may ignore "stop words" such as "the" when indexing or searching. However, Google's "named entities" would go beyond that to focus on the core content of a page.

Both clustering and named entities have interesting applications to searchers and search marketing. By understanding clusters of search results, it may be easier for Google (and other search engines) to determine pages that don't seem to belong somehow on a particular topic -- in particular, spam pages that given their often artificial nature might stand out more.

Similarly, understanding the key concepts of a page and first ranking pages based on a concept match, then following on an actual word match, might help eliminate some false poor matches.