Image recognition and force measurement application in the humanoid robot imitation

Hsin Yu Liu, Wen June Wang, Rong Jyue Wang, Cheng Wei Tung, Pei Jui Wang, I. Ping Chang

Research output: Contribution to journalArticlepeer-review

33 Scopus citations

Abstract

This paper studies and implements motion imitation interaction between a humanoid robot and a human. To achieve the implementation, three main processes are required. The first is the human motion data acquisition; the second is the motion data modification; and the last is the ankle angle adjustment on the supporting foot (or feet) of the humanoid robot. In the human motion data acquisition, we use a webcam to recognize the 13 marks that are pasted on the human's body and then calculate and record the relative positions of the marks for each motion into the motion database. In the motion data modification, the recorded motion data are modified by computer simulation to guarantee that the zero moment point of the robot is inside the stable region. Finally, based on the force sensor measurement on the soles of the robot, the ankle angles of the supporting foot (or feet) are adjusted such that the humanoid robot is capable of imitating the human motion with a balance status in real time. The experimental results demonstrate that the humanoid robot successfully imitates a series of human gymnastic motions.

Original languageEnglish
Article number6017116
Pages (from-to)149-161
Number of pages13
JournalIEEE Transactions on Instrumentation and Measurement
Volume61
Issue number1
DOIs
StatePublished - Jan 2012

Keywords

  • Force sensor
  • fuzzy control
  • humanoid robot
  • image processing
  • stability
  • zero moment point (ZMP)

Fingerprint

Dive into the research topics of 'Image recognition and force measurement application in the humanoid robot imitation'. Together they form a unique fingerprint.

Cite this