For Full-Text PDF, please login, if you are a member of IEICE,|
or go to Pay Per View on menu list, if you are a nonmember of IEICE.
Video Inpainting by Frame Alignment with Deformable Convolution
IEICE TRANSACTIONS on Information and Systems
Publication Date: 2021/08/01
Online ISSN: 1745-1361
Type of Manuscript: PAPER
Category: Image Processing and Video Processing
video inpainting, deformable convolution, deep learning, computer vision,
Full Text: PDF>>
Video inpainting is a task of filling missing regions in videos. In this task, it is important to efficiently use information from other frames and generate plausible results with sufficient temporal consistency. In this paper, we present a video inpainting method jointly using affine transformation and deformable convolutions for frame alignment. The former is responsible for frame-scale rough alignment and the latter performs pixel-level fine alignment. Our model does not depend on 3D convolutions, which limits the temporal window, or troublesome flow estimation. The proposed method achieves improved object removal results and better PSNR and SSIM values compared with previous learning-based methods.