A Visual Attention Based Region-of-Interest Determination Framework for Video Sequences

Wen-Huang CHENG  Wei-Ta CHU  Ja-Ling WU  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E88-D    No.7    pp.1578-1586
Publication Date: 2005/07/01
Online ISSN: 
DOI: 10.1093/ietisy/e88-d.7.1578
Print ISSN: 0916-8532
Type of Manuscript: Special Section PAPER (Special Section on Recent Advances in Circuits and Systems--Part 1)
Category: Image Processing and Multimedia Systems
Keyword: 
region-of-interest,  video analysis,  visual attention model,  computational media aesthetics,  

Full Text: PDF>>
Buy this Article


Summary: 
This paper presents a framework for automatic video region-of-interest determination based on visual attention model. We view this work as a preliminary step towards the solution of high-level semantic video analysis. Facing such a challenging issue, in this work, a set of attempts on using video attention features and knowledge of computational media aesthetics are made. The three types of visual attention features we used are intensity, color, and motion. Referring to aesthetic principles, these features are combined according to camera motion types on the basis of a new proposed video analysis unit, frame-segment. We conduct subjective experiments on several kinds of video data and demonstrate the effectiveness of the proposed framework.