Image Modification Based on a Visual Saliency Map for Guiding Visual Attention

Hironori TAKIMOTO  Tatsuhiko KOKUI  Hitoshi YAMAUCHI  Mitsuyoshi KISHIHARA  Kensuke OKUBO  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E98-D   No.11   pp.1967-1975
Publication Date: 2015/11/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2015EDP7087
Type of Manuscript: PAPER
Category: Image Recognition, Computer Vision
Keyword: 
visual attention,  saliency map,  image processing,  guiding attention,  

Full Text: PDF(1.4MB)>>
Buy this Article




Summary: 
It is commonly believed that improved interaction between humans and electronic device, it is effective to draw the viewer's attention to a particular object. Augmented reality (AR) applications can call attention to real objects by overlaying highlight effects or visual stimuli (such as arrows) on a physical scene. Sometimes, more subtle effects would be desirable, in which case it would be necessary to smoothly and naturally guide the user's gaze without external stimuli. Here, a novel image modification method is proposed for directing a viewer's gaze to specific regions of interest. The proposed method uses saliency analysis and color modulation to create modified images in which the region of interest is the most salient region in the entire image. The proposed saliency map model that is used during saliency analysis reduces computational costs and improves the naturalness of the image using the LAB color space and simplified normalization. During color modulation, the modulation value of each LAB component is determined in order to consider the relationship between the LAB components and the saliency value. With the image obtained in this manner, the viewer's attention is smoothly attracted to a specific region very naturally. Gaze measurements as well as a subjective experiments were conducted to prove the effectiveness of the proposed method. These results show that a viewer's visual attention is indeed attracted toward the specified region without any sense of discomfort or disruption when the proposed method is used.