Local Feature Reliability Measure Consistent with Match Conditions for Mobile Visual Search

Kohei MATSUZAKI  Kazuyuki TASAKA  Hiromasa YANAGIHARA  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E101-D   No.12   pp.3170-3180
Publication Date: 2018/12/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2018EDP7107
Type of Manuscript: PAPER
Category: Image Processing and Video Processing
Keyword: 
mobile visual search,  binary feature,  feature selection,  maximum coverage problem,  

Full Text: PDF(1.5MB)
>>Buy this Article


Summary: 
We propose a feature design method for a mobile visual search based on binary features and a bag-of-visual words framework. In mobile visual search, detection error and quantization error are unavoidable due to viewpoint changes and cause performance degradation. Typical approaches to visual search extract features from a single view of reference images, though such features are insufficient to manage detection and quantization errors. In this paper, we extract features from multiview synthetic images. These features are selected according to our novel reliability measure which enables robust recognition against various viewpoint changes. We regard feature selection as a maximum coverage problem. That is, we find a finite set of features maximizing an objective function under certain constraints. As this problem is NP-hard and thus computationally infeasible, we explore approximate solutions based on a greedy algorithm. For this purpose, we propose novel constraint functions which are designed to be consistent with the match conditions in the visual search method. Experiments show that the proposed method improves retrieval accuracy by 12.7 percentage points without increasing the database size or changing the search procedure. In other words, the proposed method enables more accurate search without adversely affecting the database size, computational cost, and memory requirement.