TY - GEN
T1 - Enhancing Academic Performance with Generative AI-Based Quiz Platform
AU - Chang, Chia Kai
AU - Chien, Lee Chia Tung
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - In this work, we build a QuizGPT web interface for learners to learn Python via quizzing and chatting. Additionally, we evaluate the impact of generative AI on learning. To effectively evaluate learners' learning achievements, the quizzes must be diverse, and the options should be challenging to ensure a complete understanding of the material. It is a time-consuming challenge for teachers to create adaptive quizzes based on learners' levels for individual learning needs. This study generates 366 quiz questions automatically via generative AI in three difficulty levels (easy, medium, hard), based on Python knowledge points. A positive correlation observed between the QuizGPT platform activities and learners' test scores. These activities include the number of quizzes attended, the correctness rates, and the frequency of participation in generative AI sessions. Additionally, QuizGPT platform activities could predict learners' test scores with a Root Mean Squared Error percentage (%RMSE) of 3.58%. Remarkably, interaction with generative AI proves to enhance Python programming skills more effectively than the number of quiz attempts. Survey analysis reveals that QuizGPT can reduce learning anxiety and enhance learning interest. Our findings suggest that generative AI, as implemented in the QuizGPT platform, is a potent tool for academic improvement, significantly enhancing self-regulation and engagement in learning Python programming.
AB - In this work, we build a QuizGPT web interface for learners to learn Python via quizzing and chatting. Additionally, we evaluate the impact of generative AI on learning. To effectively evaluate learners' learning achievements, the quizzes must be diverse, and the options should be challenging to ensure a complete understanding of the material. It is a time-consuming challenge for teachers to create adaptive quizzes based on learners' levels for individual learning needs. This study generates 366 quiz questions automatically via generative AI in three difficulty levels (easy, medium, hard), based on Python knowledge points. A positive correlation observed between the QuizGPT platform activities and learners' test scores. These activities include the number of quizzes attended, the correctness rates, and the frequency of participation in generative AI sessions. Additionally, QuizGPT platform activities could predict learners' test scores with a Root Mean Squared Error percentage (%RMSE) of 3.58%. Remarkably, interaction with generative AI proves to enhance Python programming skills more effectively than the number of quiz attempts. Survey analysis reveals that QuizGPT can reduce learning anxiety and enhance learning interest. Our findings suggest that generative AI, as implemented in the QuizGPT platform, is a potent tool for academic improvement, significantly enhancing self-regulation and engagement in learning Python programming.
KW - Artificial intelligence generated content
KW - ChatGPT
KW - Generative AI
KW - Quiz platform
UR - http://www.scopus.com/inward/record.url?scp=85203804567&partnerID=8YFLogxK
U2 - 10.1109/ICALT61570.2024.00062
DO - 10.1109/ICALT61570.2024.00062
M3 - 會議論文篇章
AN - SCOPUS:85203804567
T3 - Proceedings - 2024 IEEE International Conference on Advanced Learning Technologies, ICALT 2024
SP - 193
EP - 195
BT - Proceedings - 2024 IEEE International Conference on Advanced Learning Technologies, ICALT 2024
A2 - Altinay, Zehra
A2 - Chang, Maiga
A2 - Kuo, Rita
A2 - Tlili, Ahmed
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 24th IEEE International Conference on Advanced Learning Technologies, ICALT 2024
Y2 - 1 July 2024 through 4 July 2024
ER -