Wiener-Based Inpainting Quality Prediction

Takahiro OGAWA  Akira TANAKA  Miki HASEYAMA  

IEICE TRANSACTIONS on Information and Systems   Vol.E100-D   No.10   pp.2614-2626
Publication Date: 2017/10/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2017EDP7058
Type of Manuscript: PAPER
Category: Image Processing and Video Processing
quality prediction,  inpainting,  Wiener filter,  least-squares estimation,  

Full Text: PDF(9.1MB)
>>Buy this Article

A Wiener-based inpainting quality prediction method is presented in this paper. The proposed method is the first method that can predict inpainting quality both before and after the intensities have become missing even if their inpainting methods are unknown. Thus, when the target image does not include any missing areas, the proposed method estimates the importance of intensities for all pixels, and then we can know which areas should not be removed. Interestingly, since this measure can be also derived in the same manner for its corrupted image already including missing areas, the expected difficulty in reconstruction of these missing pixels is predicted, i.e., we can know which missing areas can be successfully reconstructed. The proposed method focuses on expected errors derived from the Wiener filter, which enables least-squares reconstruction, to predict the inpainting quality. The greatest advantage of the proposed method is that the same inpainting quality prediction scheme can be used in the above two different situations, and their results have common trends. Experimental results show that the inpainting quality predicted by the proposed method can be successfully used as a universal quality measure.