Exploiting hyperlinks for automatic information discovery on the WWW

The explosion of the World Wide Web as a global information network brings with it a number of related challenges for information retrieval and automation. The link structure, which is the main feature of the hypermedia environment, can be a rich source of information for exploration. This paper is centered around the exploiting of hyperlinks in the subject of automatic discovery. In this paper, we will discuss the design of site traversing algorithms and identify some important parameters for hyperlink-based information discovery on the Web. Meanwhile, we propose a new evaluation method, the search depth, for comparing various hyperlink traversing algorithms.