Human-centered fingertip Mandarin input system using single camera

Chih Chang Yu, Hsu Yung Cheng, Bor Shenn Jeng, Chien Cheng Lee, Wei Tyng Hong

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Designing a user friendly Chinese input system is a challenging task due to the logographic nature of Chinese characters. Using fingertips and cameras to replace pens and touch panels as input devices could reduce the cost and improve ease-of-use and comfort of the computer-human interface. In this work, Chinese character entry is achieved using Mandarin Phonetic Symbol (MPS) recognition via on-line fingertip tracking. In the proposed system, particle filters are applied for robust fingertip tracking. Afterwards, MPS recognition is performed on the tracked fingertip trajectories using Hidden Markov Models. In the proposed system, the challenges of entering, leaving, and virtual strokes caused by video-based fingertip input can be overcome. We conduct experiments to validate that the MPS symbols written by fingertips are successfully and efficiently recognized using the proposed framework.

Original languageEnglish
Title of host publicationAdvances in Multimedia Modeling - 17th International Multimedia Modeling Conference, MMM 2011, Proceedings
Number of pages9
EditionPART 2
StatePublished - 2011
Event17th Multimedia Modeling Conference, MMM 2011 - Taipei, Taiwan
Duration: 5 Jan 20117 Jan 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume6524 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference17th Multimedia Modeling Conference, MMM 2011


  • Mandarin Phonetic Symbol recognition
  • Vision-based


Dive into the research topics of 'Human-centered fingertip Mandarin input system using single camera'. Together they form a unique fingerprint.

Cite this