Light Source Estimation in Mobile Augmented Reality Scenes by Using Human Face Geometry

Emre KOC  Selim BALCISOY  

IEICE TRANSACTIONS on Information and Systems   Vol.E97-D   No.8   pp.1974-1982
Publication Date: 2014/08/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.E97.D.1974
Type of Manuscript: Special Section PAPER (Special Section on Cyberworlds)
Category: Augmented Reality
Mobile Augmented Reality,  Outdoor Illumination,  Real-time Rendering,  

Full Text: PDF(1.4MB)
>>Buy this Article

Light source estimation and virtual lighting must be believable in terms of appearance and correctness in augmented reality scenes. As a result of illumination complexity in an outdoor scene, realistic lighting for augmented reality is still a challenging problem. In this paper, we propose a framework based on an estimation of environmental lighting from well-defined objects, specifically human faces. The method is tuned for outdoor use, and the algorithm is further enhanced to illuminate virtual objects exposed to direct sunlight. Our model can be integrated into existing mobile augmented reality frameworks to enhance visual perception.