TY - JOUR
T1 - Virtual Reality-Based Supermarket for Intellectual Disability Classification, Diagnostics and Assessment
AU - Chih-Hsuan, Chen
AU - Chung, Chia Ru
AU - Yang, Hsuan Yu
AU - Yeh, Shih Ching
AU - Wu, Eric Hsiao Kuang
AU - Ting, Hsin Jung
N1 - Publisher Copyright:
IEEE
PY - 2023
Y1 - 2023
N2 - Possible symptoms of intellectual disability (ID) include delayed physical development that becomes more pronounced as the disability progresses, delayed development of gross and fine motor skills, sensory perception problems, and difficulty grasping the integrity of objects. Although there is no cure or reversal, research has shown that extensive training and learning can lead to easier social integration, but the human demands of diagnosis and the cost of training often result in overburdened families of origin, an unmanageable workload for teachers, and high social costs. Therefore, it is important to conduct efficient, effective, and economical assessments in a safe and reproducible training environment. Currently, the assessment of intellectual disability relies on intelligence tests such as the Wechsler Intelligence Scale (WIS) and the Vineland Adaptive Behavior Scale (VABS). With the rapid development of virtual reality (VR) and machine learning (ML), we created a virtual supermarket and then collected data in three areas, including eye movements, brain waves, and behaviors. We also propose an intelligent executive function evaluation using ML to develop a more objective and automatic evaluation model based on real data through physiological data obtained from user reflections. Statistical analysis of the obtained data showed that some data metrics derived from behavioral information differed significantly between ID patients and healthy participants. This shows that it is possible to perform classification through neural networks, even at multiple levels, which may prove effective for vocational training through VR.
AB - Possible symptoms of intellectual disability (ID) include delayed physical development that becomes more pronounced as the disability progresses, delayed development of gross and fine motor skills, sensory perception problems, and difficulty grasping the integrity of objects. Although there is no cure or reversal, research has shown that extensive training and learning can lead to easier social integration, but the human demands of diagnosis and the cost of training often result in overburdened families of origin, an unmanageable workload for teachers, and high social costs. Therefore, it is important to conduct efficient, effective, and economical assessments in a safe and reproducible training environment. Currently, the assessment of intellectual disability relies on intelligence tests such as the Wechsler Intelligence Scale (WIS) and the Vineland Adaptive Behavior Scale (VABS). With the rapid development of virtual reality (VR) and machine learning (ML), we created a virtual supermarket and then collected data in three areas, including eye movements, brain waves, and behaviors. We also propose an intelligent executive function evaluation using ML to develop a more objective and automatic evaluation model based on real data through physiological data obtained from user reflections. Statistical analysis of the obtained data showed that some data metrics derived from behavioral information differed significantly between ID patients and healthy participants. This shows that it is possible to perform classification through neural networks, even at multiple levels, which may prove effective for vocational training through VR.
KW - Assessment
KW - Behavioral sciences
KW - Brain modeling
KW - Electroencephalography
KW - Physiology
KW - Solid modeling
KW - Task analysis
KW - Vocational training
KW - intelligent disability
KW - machine learning
KW - virtual reality
UR - http://www.scopus.com/inward/record.url?scp=85151504349&partnerID=8YFLogxK
U2 - 10.1109/TLT.2023.3261314
DO - 10.1109/TLT.2023.3261314
M3 - 期刊論文
AN - SCOPUS:85151504349
SN - 1939-1382
SP - 1
EP - 10
JO - IEEE Transactions on Learning Technologies
JF - IEEE Transactions on Learning Technologies
ER -