Toward multimedia: A string pattern-based passage ranking model for video question answering

Yu Chieh Wu, Jie Chi Yang

Research output: Contribution to conferencePaperpeer-review

2 Scopus citations

Abstract

In this paper, we present a new string pattern matching-based passage ranking algorithm for extending traditional text-based QA toward videoQA. Users interact with our videoQA system through natural language questions, while our system returns passage fragments with corresponding video clips as answers. We collect 75.6 hours videos and 253 Chinese questions for evaluation. The experimental results showed that our method outperformed six top-performed ranking models. It is 10.16% better than the second best method (language model) in relatively MRR score and 6.12% in precision rate. Besides, we also show that the use of a trained Chinese word segmentation tool did decrease the overall videoQA performance where most ranking algorithms dropped at least 10% in relatively MRR, precision, and answer pattern recall rates.

Original languageEnglish
Pages540-547
Number of pages8
StatePublished - 2007
EventHuman Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics, NAACL HLT 2007 - Rochester, NY, United States
Duration: 22 Apr 200727 Apr 2007

Conference

ConferenceHuman Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics, NAACL HLT 2007
Country/TerritoryUnited States
CityRochester, NY
Period22/04/0727/04/07

Fingerprint

Dive into the research topics of 'Toward multimedia: A string pattern-based passage ranking model for video question answering'. Together they form a unique fingerprint.

Cite this