NCU-IISR/AS-GIS: Results of various pre-trained biomedical language models and linear regression model in BioASQ task 9b Phase B

Yu Zhang, Jen Chieh Han, Richard Tzong Han Tsai

研究成果: 雜誌貢獻會議論文同行評審

摘要

Transformer has been widely applied in Natural Language Processing (NLP) field, and it also results in an amount of pre-trained language models like BioBERT, SciBERT, NCBI_Bluebert, and PubMedBERT. In this paper, we introduce our system for the BioASQ Task 9b Phase B. We employed various pre-trained biomedical language models, including BioBERT, BioBERT-MNLI, and PubMedBERT, to generate “exact” answers for the questions, and a linear regression model with our sentence embedding to construct the top-n sentences as a prediction for “ideal” answers.

原文???core.languages.en_GB???
頁(從 - 到)360-368
頁數9
期刊CEUR Workshop Proceedings
2936
出版狀態已出版 - 2021
事件2021 Working Notes of CLEF - Conference and Labs of the Evaluation Forum, CLEF-WN 2021 - Virtual, Bucharest, Romania
持續時間: 21 9月 202124 9月 2021

指紋

深入研究「NCU-IISR/AS-GIS: Results of various pre-trained biomedical language models and linear regression model in BioASQ task 9b Phase B」主題。共同形成了獨特的指紋。

引用此