Virtual guitar: Using real-time finger tracking for musical instruments

Noorkholis Luthfil Hakim, Shih Wei Sun, Mu Hsen Hsu, Timothy K. Shih, Shih Jung Wu

Research output: Contribution to journalArticlepeer-review

4 Scopus citations


Kinect, a 3D sensing device from Microsoft, invokes the human-computer interaction research evolution. Kinect was implemented in many areas including music. One was implemented in a virtual musical instrument (VMI) system, which uses natural gestures to produce synthetic sounds similar to real musical instruments. From related work, it was found that the use of a large joint such as hand, arm and leg is inconvenient and limits the way of playing VMI. Thus, this study proposes a fast and reliable finger tracking algorithm suitable for virtual musical instrument playing. In addition, a virtual guitar system application is developed as an implementation of the proposed algorithm. Experimental results show that the proposed method can be used to play many varieties of songs with an acceptable quality. Furthermore proposed application could be used by a beginner who does not have any experience in music or on playing a real musical instrument.

Original languageEnglish
Pages (from-to)438-450
Number of pages13
JournalInternational Journal of Computational Science and Engineering
Issue number4
StatePublished - 2019


  • Depth camera
  • Finger tracking
  • Hand detection
  • Hand gesture recognition
  • Hand tracking
  • Human computer interaction
  • Virtual guitar
  • Virtual musical instrument
  • VMI


Dive into the research topics of 'Virtual guitar: Using real-time finger tracking for musical instruments'. Together they form a unique fingerprint.

Cite this