Creating Virtual Environment Based on Video Data with Forward Motion

Xiaohua ZHANG  Hiroki TAKAHASHI  Masayuki NAKAJIMA  

IEICE TRANSACTIONS on Information and Systems   Vol.E83-D   No.4   pp.931-936
Publication Date: 2000/04/25
Online ISSN: 
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Multimedia Pattern Processing
virtual environment,  pseudo-3D structure,  image composition,  pyramid data structure,  camera motion,  image-based rendering,  

Full Text: PDF>>
Buy this Article

The construction of photo-realistic 3D scenes from video data is an active and competitive area of research in the fields of computer vision, image processing and computer graphics. In this paper we address our recent work in this area. Unlike most methods of 3D scene construction, we consider the generation of virtual environments from video sequence with a video-cam's forward motion. Each frame is decomposed into sub-images, which are registered correspondingly using the Levenberg-Marquardt iterative algorithm to estimate motion parameters. The registered sub-images are correspondingly pasted together to form a pseudo-3D space. By controlling the position and direction, the virtual camera can walk through this virtual space to generate novel 2D views to acquire an immersive impression. Even if the virtual camera goes deep into this virtual environment, it can still obtain a novel view while maintaining relatively high resolution.