New search engine takes 'DeepDyve' into the Dark Web

11.11.2008
DeepDyve Inc. Tuesday announced that it has launched a that can be used to access databases, scholarly journals, unstructured information and other data sources in the so-called where traditional search technologies don't work.

The DeepDyve search engine enables searches of the Dark Web to more easily find data life sciences, patent, and data. The new engine indexes 500 million pages, said DeepDyve, which was known as Infovell before changing its name on Tuesday.

The company said it will soon start indexing physical sciences content in the areas of information technology, clean technology and energy - which will help it meet its goal of growing its index to more than 1 billion pages by the end of the year.

Because much of the content on the Deep Web is made up of technical publications, databases, scholarly publications and unstructured data, it has been difficult for traditional search engines to access it. To tackle this issue, DeepDyve is partnering with those publishers to gain access to content overlooked by other engines, the company added.

earlier this month that it is ratcheting up its aim at the Dark Web by adding the ability to search PDF documents. In April, that it was trying to find a way for its search engine to index HTML forms such as drop-down boxes and select menus that are typically part of the Dark Web.

"According to IDC, more than 42 million consumers spend 25 hours per month online researching business and personal information, and they are frustrated with the results they get back and the tools they have to use," said William Park, CEO of DeepDyve, in a statement. "DeepDyve gives information-savvy consumers unparalleled access to quality information found only in the Deep Web, with features and functionality that make it easy to find, filter and organize their results."