Perceptually Optimized Missing Texture Reconstruction via Neighboring Embedding

Takahiro OGAWA  Miki HASEYAMA  

IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences   Vol.E98-A   No.8   pp.1709-1717
Publication Date: 2015/08/01
Online ISSN: 1745-1337
DOI: 10.1587/transfun.E98.A.1709
Type of Manuscript: Special Section PAPER (Special Section on Image Media Quality)
missing texture reconstruction,  quality assessment,  SSIM index,  neighboring embedding,  

Full Text: PDF>>
Buy this Article

Perceptually optimized missing texture reconstruction via neighboring embedding (NE) is presented in this paper. The proposed method adopts the structural similarity (SSIM) index as a measure for representing texture reconstruction performance of missing areas. This provides a solution to the problem of previously reported methods not being able to perform perceptually optimized reconstruction. Furthermore, in the proposed method, a new scheme for selection of the known nearest neighbor patches for reconstruction of target patches including missing areas is introduced. Specifically, by monitoring the SSIM index observed by the proposed NE-based reconstruction algorithm, selection of known patches optimal for the reconstruction becomes feasible even if target patches include missing pixels. The above novel approaches enable successful reconstruction of missing areas. Experimental results show improvement of the proposed method over previously reported methods.