A VR-based Training and Intelligent Assessment System Integrated with Multi-modal Sensing for Children with Autism Spectrum Disorder

Yan Qing Chen, Fu An Lin, Ting Yu Yang, Shih Ching Yeh, Eric Hsiao Kuang Wu, James M. Poole, Charles Shao

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Autism Spectrum Disorder (ASD) exhibits social communication and social interaction disorders, and abnormal restrictive and repetitive behaviors. However, symptoms of infants less than 1-year-old are difficult to reliably predict subsequent diagnosis. Patients with mild ASD may not be discovered until school age, because schools have more opportunities for social activities. In addition, the therapist also needs to consider the labor cost. To provide effective treatment, it also needs to consume more resources. The current situation in Taiwan is that outlying islands and remote areas often have insufficient manpower for therapists. If VR technology can be applied, some of the problems may be solved. However, due to the global pandemic, COVID-19, early treatments or group treatments in many countries have been forced to stop. If VR technology can provide interpersonal interaction scenes, the training of ASD children can hardly be affected.This research uses Virtual Reality (VR) technology, combined with wearable multi-model sensing technology, including EEG, eye tracking, heart rate variability (HRV), and breath-sensing strap. Physiological signals and game performance data are collected while users are training, and integrate multiple evaluation scales such as ADOS, SRS, and CBCL. Statistical analysis of these data is performed to classify them through machine learning models to develop a VR assistance system that can be used to evaluate the diagnosis, severity, and social behavior treatment of ASD. This system presents assessment and therapy in a game-oriented way. In addition to enhancing the incentives for users to participate, it provides better training results than traditional training. It is also an effective and convenient tool for the therapist to use during evaluation and training.

Original languageEnglish
Title of host publicationProceedings of the 3rd IEEE Eurasia Conference on IOT, Communication and Engineering 2021, ECICE 2021
EditorsTeen-Hang Meen
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages191-195
Number of pages5
ISBN (Electronic)9781665445160
DOIs
StatePublished - 2021
Event3rd IEEE Eurasia Conference on IOT, Communication and Engineering, ECICE 2021 - Yunlin, Taiwan
Duration: 29 Oct 202131 Oct 2021

Publication series

NameProceedings of the 3rd IEEE Eurasia Conference on IOT, Communication and Engineering 2021, ECICE 2021

Conference

Conference3rd IEEE Eurasia Conference on IOT, Communication and Engineering, ECICE 2021
Country/TerritoryTaiwan
CityYunlin
Period29/10/2131/10/21

Keywords

  • ASD
  • Autism Spectrum Disorder
  • Diagnosis
  • EEG
  • Evaluation
  • Intervention
  • Machine Learning
  • Training
  • Virtual Reality

Fingerprint

Dive into the research topics of 'A VR-based Training and Intelligent Assessment System Integrated with Multi-modal Sensing for Children with Autism Spectrum Disorder'. Together they form a unique fingerprint.

Cite this