A Skeleton-based Dynamic Hand Gesture Recognition for Home Appliance Control System

Tsung Han Tsai, Yi Jhen Luo, Wei Chung Wan

研究成果: 書貢獻/報告類型會議論文篇章同行評審

6 引文 斯高帕斯(Scopus)

摘要

In recent years, advances in 3D sensors have dramatically promoted the development of dynamic hand gesture recognition research. On the other side, the task of hand pose estimation has seen significant progress due to the powerful feature extraction capabilities based on Convolutional Neural Networks (CNNs). In this paper, we present a lightweight CNNs method on hand gesture recognition for home appliance control system. We propose a two-stage CNN model to facilitate it. At the first stage, we utilize DetNet to detect the hand and generate 3D hand skeleton locations. At the second stage, a skeleton-based dynamic hand gesture recognition model is developed. We have 99.4% accuracy by the trained CNN model with the testing dataset. Besides, we implement this system on the Nvidia Jetson AGX Xavier to control the on/off of the fan and the light.

原文???core.languages.en_GB???
主出版物標題IEEE International Symposium on Circuits and Systems, ISCAS 2022
發行者Institute of Electrical and Electronics Engineers Inc.
頁面3265-3268
頁數4
ISBN(電子)9781665484855
DOIs
出版狀態已出版 - 2022
事件2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022 - Austin, United States
持續時間: 27 5月 20221 6月 2022

出版系列

名字Proceedings - IEEE International Symposium on Circuits and Systems
2022-May
ISSN(列印)0271-4310

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???2022 IEEE International Symposium on Circuits and Systems, ISCAS 2022
國家/地區United States
城市Austin
期間27/05/221/06/22

指紋

深入研究「A Skeleton-based Dynamic Hand Gesture Recognition for Home Appliance Control System」主題。共同形成了獨特的指紋。

引用此