Automatic information extraction from semi-structured Web pages by pattern discovery

Chia Hui Chang, Chun Nan Hsu, Shao Cheng Lui

研究成果: 雜誌貢獻期刊論文同行評審

81 引文 斯高帕斯(Scopus)


The World Wide Web is now undeniably the richest and most dense source of information; yet, its structure makes it difficult to make use of that information in a systematic way. This paper proposes a pattern discovery approach to the rapid generation of information extractors that can extract structured data from semi-structured Web documents. Previous work in wrapper induction aims at learning extraction rules from user-labeled training examples, which, however, can be expensive in some practical applications. In this paper, we introduce IEPAD (an acronym for Information Extraction based on PAttern Discovery), a system that discovers extraction patterns from Web pages without user-labeled examples. IEPAD applies several pattern discovery techniques, including PAT-trees, multiple string alignments and pattern matching algorithms. Extractors generated by IEPAD can be generalized over unseen pages from the same Web data source. We empirically evaluate the performance of IEPAD on an information extraction task from 14 real Web data sources. Experimental results show that with the extraction rules discovered from a single page, IEPAD achieves 96% average retrieval rate, and with less than five example pages, IEPAD achieves 100% retrieval rate for 10 of the sample Web data sources.

頁(從 - 到)129-147
期刊Decision Support Systems
出版狀態已出版 - 4月 2003


深入研究「Automatic information extraction from semi-structured Web pages by pattern discovery」主題。共同形成了獨特的指紋。