Video-based Chinese input system via fingertip tracking

Chih Chang Yu, Hsu Yung Cheng, Chih Lung Lin, Chien Cheng Lee, Wei Tyng Hong, Thomas C. Chuang

Research output: Contribution to journalArticlepeer-review


In this paper, we propose a system to detect and track fingertips online and recognize Mandarin Phonetic Symbol (MPS) for user-friendly Chinese input purposes. Using fingertips and cameras to replace pens and touch panels as input devices could reduce the cost and improve the ease-of-use and comfort of computer-human interface. In the proposed framework, particle filters with enhanced appearance models are applied for robust fingertip tracking. Afterwards, MPS combination recognition is performed on the tracked fingertip trajectories using Hidden Markov Models. In the proposed system, the fingertips of the users could be robustly tracked. Also, the challenges of entering, leaving and virtual strokes caused by video-based fingertip input can be overcome. Experimental results have shown the feasibility and effectiveness of the proposed work.

Original languageEnglish
JournalInternational Journal of Advanced Robotic Systems
StatePublished - 30 Oct 2012


  • Fingertip Tracking
  • Mandarin Phonetic Symbol Recognition
  • Video-Based Input System


Dive into the research topics of 'Video-based Chinese input system via fingertip tracking'. Together they form a unique fingerprint.

Cite this