Spider King: Virtual musical instruments based on microsoft Kinect

Mu Hsen Hsu, W. G.C.W. Kumara, Timothy K. Shih, Zixue Cheng

Research output: Contribution to conferencePaperpeer-review

18 Scopus citations

Abstract

Human Computer Interaction is becoming a major component in computer science related fields allowing humans to communicate with machines in very simple ways exploring new dimensions of research. Kinect, the 3D sensing device introduced by Microsoft mainly aiming computer games domain now is used in different scopes, one is being generation or controlling of sound signals producing aesthetic music. Here, in this paper, authors' experimental efforts on three virtual music instruments: Drum, Guitar and Spider King, based on Kinect sensor are presented. All three instruments virtually set the relevant sensing input areas, as an example, strings of the guitar or cymbals of the drum, then, the player controls the instrument through those virtual inputs through the Kinect. Sound control data is then generated and fed to the audio library based on the musically oriented human computer interaction gestures, composing a realtime musical expressive performance. A live performance using the presented virtual instruments was carried out at the end.

Original languageEnglish
Pages707-712
Number of pages6
DOIs
StatePublished - 2013
Event2013 International Joint Conference on Awareness Science and Technology, iCAST 2013 and 6th International Conference on Ubi-Media Computing, UMEDIA 2013 - Aizuwakamatsu, Japan
Duration: 2 Nov 20134 Nov 2013

Conference

Conference2013 International Joint Conference on Awareness Science and Technology, iCAST 2013 and 6th International Conference on Ubi-Media Computing, UMEDIA 2013
Country/TerritoryJapan
CityAizuwakamatsu
Period2/11/134/11/13

Keywords

  • MIDI
  • Midi port
  • OpenNI
  • RtMIDI
  • VST instrument

Fingerprint

Dive into the research topics of 'Spider King: Virtual musical instruments based on microsoft Kinect'. Together they form a unique fingerprint.

Cite this