Baseball player behavior classification system using long short-term memory with multimodal features

Shih Wei Sun, Ting Chen Mou, Chih Chieh Fang, Pao Chi Chang, Kai Lung Hua, Huang Chia Shih

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

In this paper, a preliminary baseball player behavior classification system is proposed. By using multiple IoT sensors and cameras, the proposed method accurately recognizes many of baseball players’ behaviors by analyzing signals from heterogeneous sensors. The contribution of this paper is threefold: (i) signals from a depth camera and from multiple inertial sensors are obtained and segmented, (ii) the time-variant skeleton vector projection from the depth camera and the statistical features extracted from the inertial sensors are used as features, and (iii) a deep learning-based scheme is proposed for training behavior classifiers. The experimental results demonstrate that the proposed deep learning behavior system achieves an accuracy of greater than 95% compared to the proposed dataset.

Original languageEnglish
Article number1425
JournalSensors (Switzerland)
Volume19
Issue number6
DOIs
StatePublished - 2 Mar 2019

Keywords

  • Behavior recognition
  • Deep learning
  • Depth camera
  • Inertial sensor
  • LSTM network
  • Machine learning
  • Multimodal

Fingerprint

Dive into the research topics of 'Baseball player behavior classification system using long short-term memory with multimodal features'. Together they form a unique fingerprint.

Cite this