Highly Efficient Mobile Visual Search Algorithm

Chuang ZHU  Xiao Feng HUANG  Guo Qing XIANG  Hui Hui DONG  Jia Wen SONG  

IEICE TRANSACTIONS on Information and Systems   Vol.E101-D    No.12    pp.3073-3082
Publication Date: 2018/12/01
Publicized: 2018/09/14
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2018EDP7075
Type of Manuscript: PAPER
Category: Data Engineering, Web Information Systems
mobile visual search,  descriptor extraction,  feature selection,  reranking,  

Full Text: PDF>>
Buy this Article

In this paper, we propose a highly efficient mobile visual search algorithm. For descriptor extraction process, we propose a low complexity feature detection which utilizes the detected local key points of the coarse octaves to guide the scale space construction and feature detection in the fine octave. The Gaussian and Laplacian operations are skipped for the unimportant area, and thus the computing time is saved. Besides, feature selection is placed before orientation computing to further reduce the complexity of feature detection by pre-discarding some unimportant local points. For the image retrieval process, we design a high-performance reranking method, which merges both the global descriptor matching score and the local descriptor similarity score (LDSS). In the calculating of LDSS, the tf-idf weighted histogram matching is performed to integrate the statistical information of the database. The results show that the proposed highly efficient approach achieves comparable performance with the state-of-the-art for mobile visual search, while the descriptor extraction complexity is largely reduced.