Estimating Head Orientation Using a Combination of Multiple Cues

Bima Sena Bayu DEWANTARA  Jun MIURA  

IEICE TRANSACTIONS on Information and Systems   Vol.E99-D   No.6   pp.1603-1614
Publication Date: 2016/06/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2015EDP7375
Type of Manuscript: PAPER
Category: Human-computer Interaction
human head orientation,  Weber feature,  gradient,  intensity deviation,  covariance,  block importance feature,  head detection and tracking,  

Full Text: PDF(1.9MB)
>>Buy this Article

This paper proposes an appearance-based novel descriptor for estimating head orientation. Our descriptor is inspired by the Weber-based feature, which has been successfully implemented for robust texture analysis, and the gradient which performs well for shape analysis. To further enhance the orientation differences, we combine them with an analysis of the intensity deviation. The position of a pixel and its intrinsic intensity are also considered. All features are then composed as a feature vector of a pixel. The information carried by each pixel is combined using a covariance matrix to alleviate the influence caused by rotations and illumination. As the result, our descriptor is compact and works at high speed. We also apply a weighting scheme, called Block Importance Feature using Genetic Algorithm (BIF-GA), to improve the performance of our descriptor by selecting and accentuating the important blocks. Experiments on three head pose databases demonstrate that the proposed method outperforms the current state-of-the-art methods. Also, we can extend the proposed method by combining it with a head detection and tracking system to enable it to estimate human head orientation in real applications.