TY - JOUR
T1 - NCU-IISR
T2 - 24th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF-WN 2023
AU - Hsueh, Chun Yu
AU - Zhang, Yu
AU - Lu, Yu Wei
AU - Han, Jen Chieh
AU - Meesawad, Wilailack
AU - Tsai, Richard Tzong Han
N1 - Publisher Copyright:
© 2023 Copyright for this paper by its authors.
PY - 2023
Y1 - 2023
N2 - In this paper, we present our system applied in BioASQ 11b phase b. We showcase prompt engineering strategies and outline our experimental steps. Building upon the success of ChatGPT/GPT-4 in answer generation and the field of biology, we developed a system that utilizes GPT-4 to answer biomedical questions. The system leverages OpenAI’s ChatCompletions API and combines Prompt Engineering methods to explore various prompts. In addition, we also attempted to incorporate GPT-4 into our system from last year, which combines a BERT-based model and BERTScore. However, the standalone GPT-4 method outperformed this approach by a large margin. Ultimately, in our submission, we adopted what we believe to be the optimal prompts and achieved the highest scores in the second batch.
AB - In this paper, we present our system applied in BioASQ 11b phase b. We showcase prompt engineering strategies and outline our experimental steps. Building upon the success of ChatGPT/GPT-4 in answer generation and the field of biology, we developed a system that utilizes GPT-4 to answer biomedical questions. The system leverages OpenAI’s ChatCompletions API and combines Prompt Engineering methods to explore various prompts. In addition, we also attempted to incorporate GPT-4 into our system from last year, which combines a BERT-based model and BERTScore. However, the standalone GPT-4 method outperformed this approach by a large margin. Ultimately, in our submission, we adopted what we believe to be the optimal prompts and achieved the highest scores in the second batch.
KW - Biomedical Question Answer
KW - Generative Pre-trained Transformer
KW - Large language models (LLMs)
KW - Zero-shot
UR - http://www.scopus.com/inward/record.url?scp=85175624044&partnerID=8YFLogxK
M3 - 會議論文
AN - SCOPUS:85175624044
SN - 1613-0073
VL - 3497
SP - 114
EP - 121
JO - CEUR Workshop Proceedings
JF - CEUR Workshop Proceedings
Y2 - 18 September 2023 through 21 September 2023
ER -