Factorization Method for Structure from Perspective Multi-View Images

Koichiro DEGUCHI  

IEICE TRANSACTIONS on Information and Systems   Vol.E81-D   No.11   pp.1281-1289
Publication Date: 1998/11/25
Online ISSN: 
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Image Processing,Computer Graphics and Pattern Recognition
3D shape reconstruction,  image sequence analysis,  motion analysis,  factorization method,  stereo,  

Full Text: PDF(902.4KB)>>
Buy this Article

This paper describes a factorization-based algorithm that reconstructs 3D object structure as well as motion from a set of multiple uncalibrated perspective images. The factorization method introduced by Tomasi-Kanade is believed to be applicable under the assumption of linear approximations of imaging system. In this paper we describe that the method can be extended to the case of truly perspective images if projective depths are recovered. We established this fact by interpreting their purely mathematical theory in terms of the projective geometry of the imaging system and thereby, giving physical meanings to the parameters involved. We also provide a method to recover them using the fundamental matrices and epipoles estimated from pairs of images in the image set. Our method is applicable for general cases where the images are not taken by a single moving camera but by different cameras having individual camera parameters. The experimental results clearly demonstrates the feasibility of the proposed method.