Superpixel Based Depth Map Generation for Stereoscopic Video Conversion

Jie FENG  Xiangyu LIN  Hanjie MA  Jie HU  

IEICE TRANSACTIONS on Information and Systems   Vol.E97-D   No.8   pp.2131-2137
Publication Date: 2014/08/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.E97.D.2131
Type of Manuscript: PAPER
Category: Image Recognition, Computer Vision
depth map,  superpixel,  depth generation,  2D to 3D conversion,  

Full Text: PDF>>
Buy this Article

In this paper, we propose a superpixel based depth map generation scheme for the application to monoscopic to stereoscopic video conversion. The proposed algorithm employs four main processes to generate depth maps for all frames in the video sequences. First, the depth maps of the key frames in the input sequence are generated by superpixel merging and some user interactions. Second, the frames in the input sequences are over-segmented by Simple Linear Iterative Clustering (SLIC) or depth aided SLIC method depending on whether or not they have the depth maps. Third, each superpixel in current frame is used to match the corresponding superpixel in its previous frame. Finally, depth map is propagated with a joint bilateral filter based on the estimated matching vector of each superpixel. We show an improved performance of the proposed algorithm through experimental results.