Visual Emphasis of Lip Protrusion for Pronunciation Learning

Siyang YU  Kazuaki KONDO  Yuichi NAKAMURA  Takayuki NAKAJIMA  Hiroaki NANJO  Masatake DANTSUJI  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E102-D   No.1   pp.156-164
Publication Date: 2019/01/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2017EDP7411
Type of Manuscript: PAPER
Category: Educational Technology
Keyword: 
lip protrusion,  pseudocolouring,  rounded vowel,  visual support in CALL,  

Full Text: PDF(1.2MB)
>>Buy this Article


Summary: 
Pronunciation is a fundamental factor in speaking and listening. However, instructions for important articulation have not been sufficiently provided in conventional computer-assisted language learning (CALL) systems. One typical case is the articulation of rounded vowels. Although lip protrusion is essential for their correct pronunciation, the perception of lip protrusion is often difficult for beginners. To tackle this issue, we propose an innovative method that will provide a comprehensive visual explanation for articulation. Lip movements are three-dimensionally measured, and face images or videos are pseudocoloured on the basis of the movements. The coloured regions represent the lip protrusion of rounded vowels. To verify the learning effect of the proposed method, we conducted experiments with Japanese undergraduates in Chinese classes. The results showed that our method has advantages over conventional video materials.