Incremental Segmentation of Moving Pictures--An Analysis by Synthesis Approach--

Hiroyuki MORIKAWA  Hiroshi HARASHIMA  

IEICE TRANSACTIONS on Information and Systems   Vol.E76-D   No.4   pp.446-453
Publication Date: 1993/04/25
Online ISSN: 
Print ISSN: 0916-8532
Type of Manuscript: Special Section PAPER (Special Issue on Image Processing and Understanding)
image processing,  computer vision,  dynamic scene analysis,  segmentation,  structural descriptions,  

Full Text: PDF>>
Buy this Article

We describe an approach to describe moving pictures in terms of their structural properties for video editing, video indexing, and video coding. The description contains 2D shape, motion, spatial relation, and relative depth of each region. To obtain the description, we develop the incremental segmentation scheme which includes dynamic occlusion analysis to determine relative depths of several objects. The scheme has been designed along the analysis-by-synthesis" approach, and uses a sequence of images to estimate object boundaries and motion information successively/incrementally. The scheme consists of three components: motion estimation, prediction with dynamic occlusion analysis, and update of the segmentation results. By combining the information from extended (longer) image sequences, and also by treating the segmentation and dynamic occlusion analysis simultaneously, the scheme attempts to improve successively over time the accuracy of the object boundary and motion estimation.