A Novel Saliency-Based Graph Learning Framework with Application to CBIR

Hong BAO  Song-He FENG  De XU  Shuoyan LIU  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E94-D   No.6   pp.1353-1356
Publication Date: 2011/06/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.E94.D.1353
Print ISSN: 0916-8532
Type of Manuscript: LETTER
Category: Image Recognition, Computer Vision
Keyword: 
localized CBIR,  graph learning,  visual attention,  relevance feedback,  

Full Text: PDF(339.9KB)>>
Buy this Article




Summary: 
Localized content-based image retrieval (LCBIR) has emerged as a hot topic more recently because in the scenario of CBIR, the user is interested in a portion of the image and the rest of the image is irrelevant. In this paper, we propose a novel region-level relevance feedback method to solve the LCBIR problem. Firstly, the visual attention model is employed to measure the regional saliency of each image in the feedback image set provided by the user. Secondly, the regions in the image set are constructed to form an affinity matrix and a novel propagation energy function is defined which takes both low-level visual features and regional significance into consideration. After the iteration, regions in the positive images with high confident scores are selected as the candidate query set to conduct the next-round retrieval task until the retrieval results are satisfactory. Experimental results conducted on the SIVAL dataset demonstrate the effectiveness of the proposed approach.