A support vector machine-based context-ranking model for question answering

Show Jane Yen, Yu Chieh Wu, Jie Chi Yang, Yue Shi Lee, Chung Jung Lee, Jui Jung Liu

Research output: Contribution to journalArticlepeer-review

47 Scopus citations

Abstract

Modern information technologies and Internet services are suffering from the problem of selecting and managing a growing amount of textual information, to which access is often critical. Machine learning techniques have recently shown excellent performance and flexibility in many applications, such as artificial intelligence and pattern recognition. Question answering (QA) is a method of locating exact answer sentences from vast document collections. This paper presents a machine learning-based question-answering framework, which integrates a question classifier, simple document/passage retrievers, and the proposed context-ranking models. The question classifier is trained to categorize the answer type of the given question and instructs the context-ranking model to re-rank the passages retrieved from the initial retrievers. This method provides flexible features to learners, such as word forms, syntactic features, and semantic word features. The proposed context-ranking model, which is based on the sequential labeling of tasks, combines rich features to predict whether the input passage is relevant to the question type. We employ TREC-QA tracks and question classification benchmarks to evaluate the proposed method. The experimental results show that the question classifier achieves 85.60% accuracy without any additional semantic or syntactic taggers, and reached 88.60% after we employed the proposed term expansion techniques and a predefined related-word set. In the TREC-10 QA task, by using the gold TREC-provided relevant document set, the QA model achieves a 0.563 mean reciprocal rank (MRR) score, and a 0.342 MRR score is achieved after using the simple document and passage retrieval algorithms.

Original languageEnglish
Pages (from-to)77-87
Number of pages11
JournalInformation Sciences
Volume224
DOIs
StatePublished - 1 Mar 2013

Keywords

  • Information retrieval
  • Passage retrieval
  • Question answering
  • Question classification
  • Support vector machines

Fingerprint

Dive into the research topics of 'A support vector machine-based context-ranking model for question answering'. Together they form a unique fingerprint.

Cite this