Measuring Three-Dimensional Shapes of a Moving Human Face Using Photometric Stereo Method with Two Light Sources and Slit Patterns

Hitoshi SAJI  Hiromasa NAKATANI  

IEICE TRANSACTIONS on Information and Systems   Vol.E80-D   No.8   pp.795-801
Publication Date: 1997/08/25
Online ISSN: 
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Image Processing,Computer Graphics and Pattern Recognition
3D measurement,  photometric stereo,  slit pattern projection,  moving human face,  

Full Text: PDF>>
Buy this Article

In this paper, a new method for measuring three-dimensional (3D) moving facial shapes is introduced. This method uses two light sources and a slit pattern projector. First, the normal vectors at points on a face are computed by the photometric stereo method with two light sources and a conventional video camera. Next, multiple light stripes are projected onto the face with a slit pattern projector. The 3D coordinates of the points on the stripes are measured using the stereo vision algorithm. The normal vectors are then integrated within 2D finite intervals around the measured points on the stripes. The 3D curved segment within each finite interval is computed by the integration. Finally, all the curved segments are blended into the complete facial shape using a family of exponential functions. By switching the light rays at high speed, the time required for sampling data can be reduced, and the 3D shape of a moving human face at each instant can be measured.