Real-time static and dynamic gesture recognition using mixed space features for 3D virtual world's interactions

S. P.Kasthuri Arachchi, Noorkholis Luthfil Hakim, Hui Huang Hsu, Stanislav Vladimirovich Klimenko, Timothy K. Shih

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Scopus citations

Abstract

Gesture Recognition is a technology that makes devices such as a computer capable of recognizing and responding to different gestures produced by the human body. With the recent growth of 3D virtual world applications, the demand to improve the gesture recognition method, especially hand gesture recognition, has increased. In this paper, we propose a novel vision-based gesture recognition system for controlling the 3D virtual world based on depth images obtained from the 3D camera device. For the proposed system, we used mix spatial space features consisting of 3D and 2D space features. The finger position in the point cloud represents the 3D space feature and the contour of hand from the images as 2D space feature. To investigate the robustness of our system, we designed 9 gestures including 6 static and 3 dynamic varieties. During experiments, we instruct people to display those gestures and calculate the recognition rate. Our results demonstrate that the proposed system was able to recognize the 9 gestures very well with the average accuracy of 95% for static gestures and 81.34% for dynamic ones.

Original languageEnglish
Title of host publicationProceedings - 32nd IEEE International Conference on Advanced Information Networking and Applications Workshops, WAINA 2018
EditorsLidia Ogiela, Tomoya Enokido, Marek R. Ogiela, Nadeem Javaid, Leonard Barolli, Makoto Takizawa
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages627-632
Number of pages6
ISBN (Electronic)9781538653944
DOIs
StatePublished - 20 Jul 2018
Event32nd IEEE International Conference on Advanced Information Networking and Applications Workshops, WAINA 2018 - Krakow, Poland
Duration: 16 May 201818 May 2018

Publication series

NameProceedings - 32nd IEEE International Conference on Advanced Information Networking and Applications Workshops, WAINA 2018
Volume2018-January

Conference

Conference32nd IEEE International Conference on Advanced Information Networking and Applications Workshops, WAINA 2018
Country/TerritoryPoland
CityKrakow
Period16/05/1818/05/18

Keywords

  • Depth camera
  • Dynamic gesture
  • Gesture recognition
  • Static gesture

Fingerprint

Dive into the research topics of 'Real-time static and dynamic gesture recognition using mixed space features for 3D virtual world's interactions'. Together they form a unique fingerprint.

Cite this