Abstract
In this paper, we introduce our system and submissions in BioASQ 12b phase b [1], highlighting a significant improvement with GPT-4 and the integration of Retrieval Augmented Generation (RAG) techniques. We describe our prompt engineering methods and the experimental procedures followed. Because GPT-4 has proven effectiveness in generating answers and its ability in the biological domain, our system utilizes GPT-4 to address biomedical question-answering (QA). Leveraging OpenAI's ChatCompletions API, we refined previous prompt engineering approaches [2] for BioASQ 11b phase b. This year, the addition of RAG techniques significantly improved the information retrieval capabilities of our system. Consequently, our latest submission employed what we experimented to be the most effective prompts and techniques, achieving excellent performance across multiple metrics in the fourth batch.
Original language | English |
---|---|
Pages (from-to) | 99-105 |
Number of pages | 7 |
Journal | CEUR Workshop Proceedings |
Volume | 3740 |
State | Published - 2024 |
Event | 25th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF 2024 - Grenoble, France Duration: 9 Sep 2024 → 12 Sep 2024 |
Keywords
- Biomedical Question Answer
- Generative Pre-trained Transformer
- Large Language Models (LLMs)
- Retrieval Augmented Generation