Enhanced appearance-based finger detection and tracking using finite state machine control

Noorkholis Luthfil Hakim, Timothy K. Shih, Lin Hui

Research output: Contribution to journalArticlepeer-review


Real-time finger detection and tracking systems have been growing rapidly in the past decade. Among those methods, Appearance-based and Model-based methods have produced excellent results. However, the occlusion issue is one of the main challenges in this field. In this study, we address this issue by considering the repeating-finite gestures of a guitar-strumming or a hand puppet and, represent using a Finite State Machine model. Also we proposed a novel finger pose tracking system using FSM Model combining with the appearance-based method.. The proposed system consists of two parts: FSM-FT builder creates the FSM hand, and the FSM-FT runner controls the FSM-FT system. Empirically, we conducted an experimental study involving one sample repeating hand gesture and our approach achieved a significance recognition rate of 82% in the testing phase.

Original languageEnglish
Pages (from-to)1087-1096
Number of pages10
JournalJournal of Internet Technology
Issue number4
StatePublished - 2020


  • Finger detection
  • Finger tracking
  • Finite State Machine
  • Human-computer Interaction


Dive into the research topics of 'Enhanced appearance-based finger detection and tracking using finite state machine control'. Together they form a unique fingerprint.

Cite this