Calibration of Real Scenes for the Reconstruction of Dynamic Light Fields

Ingo SCHOLZ  Joachim DENZLER  Heinrich NIEMANN  

IEICE TRANSACTIONS on Information and Systems   Vol.E87-D   No.1   pp.42-49
Publication Date: 2004/01/01
Online ISSN: 
Print ISSN: 0916-8532
Type of Manuscript: Special Section PAPER (Special Section on Machine Vision Applications)
Category: Background Estimation
dynamic light field,  camera calibration,  structure from motion,  image-based rendering,  

Full Text: PDF>>
Buy this Article

The classic light field and lumigraph are two well-known approaches to image-based rendering, and subsequently many new rendering techniques and representations have been proposed based on them. Nevertheless the main limitation remains that in almost all of them only static scenes are considered. In this contribution we describe a method for calibrating a scene which includes moving or deforming objects from multiple image sequences taken with a hand-held camera. For each image sequence the scene is assumed to be static, which allows the reconstruction of a conventional static light field. The dynamic light field is thus composed of multiple static light fields, each of which describes the state of the scene at a certain point in time. This allows not only the modeling of rigid moving objects, but any kind of motion including deformations. In order to facilitate the automatic calibration, some assumptions are made for the scene and input data, such as that the image sequences for each respective time step share one common camera pose and that only the minor part of the scene is actually in motion.