Improvements of Local Descriptor in HOG/SIFT by BOF Approach

Zhouxin YANG  Takio KURITA  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E97-D   No.5   pp.1293-1303
Publication Date: 2014/05/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.E97.D.1293
Type of Manuscript: PAPER
Category: Image Recognition, Computer Vision
Keyword: 
bag of features,  connection with HOG/SIFT,  pedestrian detection,  scene matching,  image classification,  

Full Text: PDF(2.7MB)>>
Buy this Article




Summary: 
Numerous studies have been focusing on the improvement of bag of features (BOF), histogram of oriented gradient (HOG) and scale invariant feature transform (SIFT). However, few works have attempted to learn the connection between them even though the latter two are widely used as local feature descriptor for the former one. Motivated by the resemblance between BOF and HOG/SIFT in the descriptor construction, we improve the performance of HOG/SIFT by a) interpreting HOG/SIFT as a variant of BOF in descriptor construction, and then b) introducing recently proposed approaches of BOF such as locality preservation, data-driven vocabulary, and spatial information preservation into the descriptor construction of HOG/SIFT, which yields the BOF-driven HOG/SIFT. Experimental results show that the BOF-driven HOG/SIFT outperform the original ones in pedestrian detection (for HOG), scene matching and image classification (for SIFT). Our proposed BOF-driven HOG/SIFT can be easily applied as replacements of the original HOG/SIFT in current systems since they are generalized versions of the original ones.