For Full-Text PDF, please login, if you are a member of IEICE,|
or go to Pay Per View on menu list, if you are a nonmember of IEICE.
Visual Emphasis of Lip Protrusion for Pronunciation Learning
Siyang YU Kazuaki KONDO Yuichi NAKAMURA Takayuki NAKAJIMA Hiroaki NANJO Masatake DANTSUJI
IEICE TRANSACTIONS on Information and Systems
Publication Date: 2019/01/01
Online ISSN: 1745-1361
Type of Manuscript: PAPER
Category: Educational Technology
lip protrusion, pseudocolouring, rounded vowel, visual support in CALL,
Full Text: PDF(1.2MB)>>
Pronunciation is a fundamental factor in speaking and listening. However, instructions for important articulation have not been sufficiently provided in conventional computer-assisted language learning (CALL) systems. One typical case is the articulation of rounded vowels. Although lip protrusion is essential for their correct pronunciation, the perception of lip protrusion is often difficult for beginners. To tackle this issue, we propose an innovative method that will provide a comprehensive visual explanation for articulation. Lip movements are three-dimensionally measured, and face images or videos are pseudocoloured on the basis of the movements. The coloured regions represent the lip protrusion of rounded vowels. To verify the learning effect of the proposed method, we conducted experiments with Japanese undergraduates in Chinese classes. The results showed that our method has advantages over conventional video materials.