Evaluation of the Corresponding Degree between a Visual Image and Its Associated Sound under Dynamic Conditions on a Wide Screen

Hiroshi HASEGAWA  Miyoshi AYAMA  Shuichi MATSUMOTO  Atsushi KOIKE  Koichi TAKAGI  Masao KASUGA  

IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences   Vol.E87-A    No.6    pp.1409-1416
Publication Date: 2004/06/01
Online ISSN: 
Print ISSN: 0916-8508
Type of Manuscript: Special Section PAPER (Special Section on Papers Selected from 2003 International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC 2003))
auditory-visual interaction,  ventriloquist effect,  wide screen,  peripheral visual field,  

Full Text: PDF(960.4KB)>>
Buy this Article

In this paper, the effects of visual information on associated auditory information were investigated when presented simultaneously under dynamic conditions on a wide screen. Experiments of an auditory-visual stimulus presentation using a computer graphics movie of a moving patrol car and its siren sound, which were combined in various locations, were performed in 19 subjects. The experimental results showed the following: the visual stimulus at the beginning of the presentation captured the sound image stronger than that at the end (i.e., beginning effect), the sound image separated from the visual image even when both stimulus locations were exactly at the same place and then when both stimuli moved in opposite directions from each other, the visual stimulus tended to capture the sound image stronger in the peripheral visual field than in the central visual field, and the visual stimulus moving toward the sound source captured the sound image stronger than that moving away from the sound source.