Extension of Hidden Markov Models for Multiple Candidates and Its Application to Gesture Recognition

Yosuke SATO  Tetsuji OGAWA  Tetsunori KOBAYASHI  

IEICE TRANSACTIONS on Information and Systems   Vol.E88-D   No.6   pp.1239-1247
Publication Date: 2005/06/01
Online ISSN: 
DOI: 10.1093/ietisy/e88-d.6.1239
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Image Recognition, Computer Vision
gesture recognition,  Hidden Markov Model,  multiple candidates of feature vector,  mobile robot,  

Full Text: PDF>>
Buy this Article

We propose a modified Hidden Markov Model (HMM) with a view to improve gesture recognition using a moving camera. The conventional HMM is formulated so as to deal with only one feature candidate per frame. However, for a mobile robot, the background and the lighting conditions are always changing, and the feature extraction problem becomes difficult. It is almost impossible to extract a reliable feature vector under such conditions. In this paper, we define a new gesture recognition framework in which multiple candidates of feature vectors are generated with confidence measures and the HMM is extended to deal with these multiple feature vectors. Experimental results comparing the proposed system with feature vectors based on DCT and the method of selecting only one candidate feature point verifies the effectiveness of the proposed technique.