A digital reality theater with the mechanisms of real-time spoken language evaluation and interactive switching of scenario virtual costumes: Effects on motivation and learning performance

Ming Yuan Cai, Jui Yi Wang, Gwo Dong Chen, Jen Hang Wang, Su Hang Yang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

To promote language learning performance, a realistic speech mission-based digital learning theater, which integrates with real-time spoken language evaluation and interactive switching of scenario and virtual costumes, was proposed in this study. Regarding evaluation, an AI chatbot is integrated into the digital learning theater to assign speech tasks to learners and evaluate their performance in terms of pronunciation and grammar, and then provide immediate feedback for improvement. Regarding interaction, with Kinect motion detection technology, learners can immerse themselves into the digital scene of drama with their whole body and wear various virtual costumes that can automatically match learners' body size and motions, to strengthen learners' interest and engagement in learning. This study was conducted on a Japanese language course for university students. The results suggest that students' learning outcomes and motivation can be enhanced with realistic speech mission-based digital learning theater.

Original languageEnglish
Title of host publicationProceedings - IEEE 20th International Conference on Advanced Learning Technologies, ICALT 2020
EditorsMaiga Chang, Demetrios G Sampson, Ronghuai Huang, Danial Hooshyar, Nian-Shing Chen, Kinshuk Kinshuk, Margus Pedaste
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages295-299
Number of pages5
ISBN (Electronic)9781728160900
DOIs
StatePublished - Jul 2020
Event20th IEEE International Conference on Advanced Learning Technologies, ICALT 2020 - Virtual, Online, Estonia
Duration: 6 Jul 20209 Jul 2020

Publication series

NameProceedings - IEEE 20th International Conference on Advanced Learning Technologies, ICALT 2020

Conference

Conference20th IEEE International Conference on Advanced Learning Technologies, ICALT 2020
Country/TerritoryEstonia
CityVirtual, Online
Period6/07/209/07/20

Keywords

  • Authentic Learning
  • Authentic Learning, Drama-based Learning, Speech Interaction, Motion Detection
  • Drama-based Learning
  • Motion Detection;
  • Speech Interaction

Fingerprint

Dive into the research topics of 'A digital reality theater with the mechanisms of real-time spoken language evaluation and interactive switching of scenario virtual costumes: Effects on motivation and learning performance'. Together they form a unique fingerprint.

Cite this