Eyegaze Detection from Monocular Camera Image for Eyegaze Communication System

Ryo OHTERA  Takahiko HORIUCHI  Hiroaki KOTERA  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E93-D   No.1   pp.134-143
Publication Date: 2010/01/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.E93.D.134
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Image Recognition, Computer Vision
Keyword: 
eyegaze detection,  Hough transform,  eyeball model,  eyegaze keyboard,  

Full Text: PDF(1.4MB)
>>Buy this Article


Summary: 
An eyegaze interface is one of the key technologies as an input device in the ubiquitous-computing society. In particular, an eyegaze communication system is very important and useful for severely handicapped users such as quadriplegic patients. Most of the conventional eyegaze tracking algorithms require specific light sources, equipment and devices. In this study, a simple eyegaze detection algorithm is proposed using a single monocular video camera. The proposed algorithm works under the condition of fixed head pose, but slight movement of the face is accepted. In our system, we assume that all users have the same eyeball size based on physiological eyeball models. However, we succeed to calibrate the physiologic movement of the eyeball center depending on the gazing direction by approximating it as a change in the eyeball radius. In the gaze detection stage, the iris is extracted from a captured face frame by using the Hough transform. Then, the eyegaze angle is derived by calculating the Euclidean distance of the iris centers between the extracted frame and a reference frame captured in the calibration process. We apply our system to an eyegaze communication interface, and verified the performance through key typing experiments with a visual keyboard on display.