NCU-IISR/AS-GIS: Using BERTScore and Snippet Score to Improve the Performance of Pretrained Language Model in BioASQ 10b Phase B

Hao Hsuan Ting, Yu Zhang, Jen Chieh Han, Richard Tzong Han Tsai

Research output: Contribution to journalConference articlepeer-review

1 Scopus citations

Abstract

This paper presents our system for the BioASQ10b Phase B task. For ideal answers, we used the fine-tuned BioBERT model on the MNLI dataset to construct sentence embeddings and combined it with BERTScore to select sentences from the provided Snippets as answers. For the exact answers, we also used the BioBERT model and used the snippet scores generated from the ideal answer selection model to predict the exact answers for factoid and list questions. The exact answers of our fifth test batch ranked second place. In addition, the ideal answers we submitted achieved first place in the ROUGE score in all test batches from batch second to fifth.

Original languageEnglish
Pages (from-to)357-367
Number of pages11
JournalCEUR Workshop Proceedings
Volume3180
StatePublished - 2022
Event2022 Conference and Labs of the Evaluation Forum, CLEF 2022 - Bologna, Italy
Duration: 5 Sep 20228 Sep 2022

Keywords

  • Biomedical Question Answer
  • Pre-trained Language Model
  • Text Similarity

Fingerprint

Dive into the research topics of 'NCU-IISR/AS-GIS: Using BERTScore and Snippet Score to Improve the Performance of Pretrained Language Model in BioASQ 10b Phase B'. Together they form a unique fingerprint.

Cite this