Patch Optimization for Surface Light Field Reconstruction

Wei LI  Huajun GONG  Chunlin SHEN  Yi WU  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E101-D   No.12   pp.3267-3271
Publication Date: 2018/12/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2018EDL8072
Type of Manuscript: LETTER
Category: Computer Graphics
Keyword: 
surface light field,  appearance reconstruction,  photo-realistic rendering,  

Full Text: PDF(2.1MB)
>>Buy this Article


Summary: 
Surface light field advances conventional light field rendering techniques by utilizing geometry information. Using surface light field, real-world objects with complex appearance could be faithfully represented. This capability could play an important role in many VR/AR applications. However, an accurate geometric model is needed for surface light field sampling and processing, which limits its wide usage since many objects of interests are difficult to reconstruct with their usually very complex appearances. We propose a novel two-step optimization framework to reduce the dependency of accurate geometry. The key insight is to treat surface light field sampling as a multi-view multi-texture optimization problem. Our approach can deal with both model inaccuracy and image to model misalignment, making it possible to create high-fidelity surface light field models without using high-precision special hardware.