Hole-Filling Algorithm with Spatio-Temporal Background Information for View Synthesis

Huu-Noi DOAN  Tien-Dat NGUYEN  Min-Cheol HONG  

IEICE TRANSACTIONS on Information and Systems   Vol.E100-D   No.9   pp.1994-2004
Publication Date: 2017/09/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2016PCP0010
Type of Manuscript: Special Section PAPER (Special Section on Picture Coding and Image Media Processing)
hole-filling,  spatio-temporal background information,  background codebook,  spatial local background estimation,  priority function,  

Full Text: PDF(1.3MB)
>>Buy this Article

This paper presents a new hole-filling method that uses extrapolated spatio-temporal background information to obtain a synthesized free-view. A new background codebook for extracting reliable temporal background information is introduced. In addition, the paper addresses estimating spatial local background to distinguish background and foreground regions so that spatial background information can be extrapolated. Background holes are filled by combining spatial and temporal background information. Finally, exemplar-based inpainting is applied to fill in the remaining holes using a new priority function. The experimental results demonstrated that satisfactory synthesized views can be obtained using the proposed algorithm.