New Research at DARPA

The primary instigator of the Internet, DARPA, is funding research into future technologies -- including many that have potential to dramatically improve search systems.

The Defense Advanced Research Projects Agency (DARPA) was the government agency directly responsible for funding and supporting research that led to the development of the Internet. DARPA´s charter is to prevent technological surprise from harming U.S. national security by sponsoring revolutionary and innovative high-payoff research.

Contrary to the secretive nature of many government agencies, DARPA publishes a fairly detailed summary of current projects it is sponsoring. The DARPA "Fact File" describes these programs, which are "aimed at finding solutions to urgent, difficult, and dangerous threats to U.S. national security, which require an in-depth response beyond that of the Military Services. In particular, these programs are meant to counter asymmetric and transnational threats, such as terrorist, biological warfare, or information attacks, and maintain unhindered U.S. access to space."

While descriptions of all of these programs make fascinating reading, the fruits of some of these programs may very well find their way into search technologies in the future. For example:

- Information Awareness: The DARPA Information Awareness Office (IAO) is developing technology that will promote sharing, collaborating, and reasoning to convert nebulous data to knowledge and actionable options. Some of this work involves projects working on Real-time learning, pattern-matching, and anomalous pattern detection; human network analysis and behavior model building engines; event prediction and capability development model building engines; and change detection.

- Project Genoa: A "thematic" search engine called "Athens" that complements traditional search engines by allowing users to find nuggets of information in large collections of documents without having to construct a complicated query, and breaks up result pages into chunks of relevant information.

- The Genisys program: This project will produce technology for an ultra-large, all-source information repository. "Current database technology is clearly insufficient to address the need to integrate all relevant existing databases and semi-structured information sources, to automatically populate the new repository with many different and non-traditional data-feeds, and to enable the easy creation of new information systems, which today exist only in manual form."

In other words -- a potential solution one of the major problems responsible for the phenomenon of the Invisible Web!

These are just a few of the fascinating projects described in the DARPA fact file. Spend some time reading through the others and you'll get a good feel for some of the emerging technologies we can expect to see over the next decade or so that will lead to a greatly enhanced search experience.

DARPA Fact File
This document provides short summaries of selected DARPA programs in FY 2002 and FY 2003, and it is intended as a ready reference for those interested in DARPA's research portfolio.

Search Headlines

NOTE: Article links often change. In case of a bad link, use the publication's search facility, which most have, and search for the headline.

Online search engines news
U.S. Department of Defense to Use Verity Technology...
EContent Jul 28 2002 1:32AM GMT
Online portals news
Yahoo introduces paid email service... Jul 27 2002 8:04PM GMT
Terra Lycos loses its biggest advertiser... Jul 27 2002 8:04PM GMT
Online search engines news
Google remains most popular search engine... Jul 27 2002 8:04PM GMT
Online content news
InfoSpace seeking reverse stock split...
Seattle Times Jul 27 2002 4:16PM GMT
Web developer news
Search Toolbar Roundup...
WebmasterBase Jul 27 2002 5:41AM GMT
Online search engines news
LookSmart reports increased revenue...
Sydney Morning Herald Jul 26 2002 2:42PM GMT
Tech latest
Companies rev up for Internet protocol upgrade... Jul 26 2002 12:23PM GMT
Online search engines news
In Truth, Verity 'Is Looking Strong'...
Business Week Jul 26 2002 9:05AM GMT
Domain name news
VeriSign posts loss after charges...
CNET Jul 26 2002 1:18AM GMT
Domain name policy absurd when it comes to trademarks... Jul 25 2002 6:52PM GMT
Top internet stories
Dotcom downsizing...
The Economist Jul 25 2002 5:14PM GMT
Online search engines news
BT LookSmart buys UK Plus...
The Register Jul 25 2002 12:03PM GMT
powered by

About the author

Chris Sherman is a frequent contributor to several information industry journals. He's written several books, including The McGraw-Hill CD ROM Handbook and The Invisible Web: Uncovering Information Sources Search Engines Can't See, co-authored with Gary Price. Chris has written about search and search engines since 1994, when he developed online searching tutorials for several clients. From 1998 to 2001, he was's Web Search Guide.