Content-Based Superpixel Segmentation and Matching Using Its Region Feature Descriptors

Jianmei ZHANG  Pengyu WANG  Feiyang GONG  Hongqing ZHU  Ning CHEN  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E103-D   No.8   pp.1888-1900
Publication Date: 2020/08/01
Publicized: 2020/04/27
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2019EDP7322
Type of Manuscript: PAPER
Category: Image Processing and Video Processing
Keyword: 
image matching,  superpixel region descriptor,  multi-features fusion,  superpixel,  superpixel segmentation,  

Full Text: PDF>>
Buy this Article



Summary: 
Finding the correspondence between two images of the same object or scene is an active research field in computer vision. This paper develops a rapid and effective Content-based Superpixel Image matching and Stitching (CSIS) scheme, which utilizes the content of superpixel through multi-features fusion technique. Unlike popular keypoint-based matching method, our approach proposes a superpixel internal feature-based scheme to implement image matching. In the beginning, we make use of a novel superpixel generation algorithm based on content-based feature representation, named Content-based Superpixel Segmentation (CSS) algorithm. Superpixels are generated in terms of a new distance metric using color, spatial, and gradient feature information. It is developed to balance the compactness and the boundary adherence of resulted superpixels. Then, we calculate the entropy of each superpixel for separating some superpixels with significant characteristics. Next, for each selected superpixel, its multi-features descriptor is generated by extracting and fusing local features of the selected superpixel itself. Finally, we compare the matching features of candidate superpixels and their own neighborhoods to estimate the correspondence between two images. We evaluated superpixel matching and image stitching on complex and deformable surfaces using our superpixel region descriptors, and the results show that new method is effective in matching accuracy and execution speed.