Data Mapping

As web technologies evolve, many leading analysts are looking beyond “Web 2.0” and asking “what’s next?” If Tim Berners-Lee is to be believed, the web will evolve according to semantic relationships, which will provide for near universal data-sharing across various applications and sites, breaking down the previous-generation “walled garden” model that is commonly associated with today’s proprietary data standards.

Berners-Lee has a reputation for foresight in terms of shaping the web’s direction, as he is credited with establishing the hyper-text protocol (HTTP) which powers the web while working as a researcher at Cern. As a leading technologist, Berners-Lee works for the Web Consortium (W3C) as well as serving on boards at 3Com and MIT. As a researcher working out of the University of Southampton, he is working with a variety of collaborators on the next set of web standards. In order to better understand the future direction of semantic search, it’s important to understand how the major players in search have evolved, as well as their potential innovations.

Shortly after the development of the first web-standards, the first-generation of web search utilized a series of algorithms based entirely on text, led by companies such as Lycos and Excite. Without a clear leader, Google emerged as a startup in 1998 which improved upon web-results by integrating their Page-Rank algorithm to associate rankings based upon links between sites, a product of research from the company’s founders at Stanford University. Today, the major players in the space, Google, Ask, Microsoft and Yahoo, are also competing with a variety of startups, including Powerset and Wikia, which aim to improve the indexing standards by incorporating broader sets of data into their ranking algorithms. In this context, search is evolving to become closer to the “intelligent agents…capable of analyzing all the data on the Web…” as envisioned by Berners-Lee. As search engines move beyond text to capture universal search (rich media, social graphics and maps), a number of new initiatives are competing to create the next generation of search with the goal of truly answering search queries by improving the relevance of results.