Visual webpage block importance prediction using conditional random fields

Richard Tzong-Han Tsai, Borong Chiu, Chi En Wu

研究成果: 雜誌貢獻期刊論文同行評審


We have developed a system that segments web pages into blocks and predicts those blocks' importance (block importance prediction or BIP). First, we use VIPS to partition a page into a tree composed of blocks and then extracts features from each block and labels all leaf nodes. This paper makes two main contributions. Firstly, we are pioneering the formulation of BIP as a sequence tagging task. We employ DFS, which outputs a single sequence for the whole tree in which related sub-blocks are adjacent. Our second contribution is using the conditional random fields (CRF) model for labeling these sequences. CRF's transition features model correlations between neighboring labels well, and CRF can simultaneously label all blocks in a sequence to find the global optimal solution for the whole sequence, not only the best solution for each block. In our experiments, our CRF-based system achieves an F1-measure of 97.41%, which significantly outperforms our ME-based baseline (95.64%). Lastly, we tested the CRF-based system using sites which were not covered in the training data. On completely novel sites CRF performed slightly worse than ME. However, when given only two training pages from a given site, CRF improved almost three times as much as ME.

頁(從 - 到)2225-2235
期刊Journal of the American Society for Information Science and Technology
出版狀態已出版 - 11月 2011


深入研究「Visual webpage block importance prediction using conditional random fields」主題。共同形成了獨特的指紋。