NCU-IISR: Enhancing Biomedical Question Answering with GPT-4 and Retrieval Augmented Generation in BioASQ 12b Phase B

Bing Chen Chih, Jen Chieh Han, Richard Tzong Han Tsai

Research output: Contribution to journalConference articlepeer-review

1 Scopus citations

Abstract

In this paper, we introduce our system and submissions in BioASQ 12b phase b [1], highlighting a significant improvement with GPT-4 and the integration of Retrieval Augmented Generation (RAG) techniques. We describe our prompt engineering methods and the experimental procedures followed. Because GPT-4 has proven effectiveness in generating answers and its ability in the biological domain, our system utilizes GPT-4 to address biomedical question-answering (QA). Leveraging OpenAI's ChatCompletions API, we refined previous prompt engineering approaches [2] for BioASQ 11b phase b. This year, the addition of RAG techniques significantly improved the information retrieval capabilities of our system. Consequently, our latest submission employed what we experimented to be the most effective prompts and techniques, achieving excellent performance across multiple metrics in the fourth batch.

Original languageEnglish
Pages (from-to)99-105
Number of pages7
JournalCEUR Workshop Proceedings
Volume3740
StatePublished - 2024
Event25th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF 2024 - Grenoble, France
Duration: 9 Sep 202412 Sep 2024

Keywords

  • Biomedical Question Answer
  • Generative Pre-trained Transformer
  • Large Language Models (LLMs)
  • Retrieval Augmented Generation

Fingerprint

Dive into the research topics of 'NCU-IISR: Enhancing Biomedical Question Answering with GPT-4 and Retrieval Augmented Generation in BioASQ 12b Phase B'. Together they form a unique fingerprint.

Cite this