Foreign Language Tutoring in Oral Conversations Using Spoken Dialog Systems

Sungjin LEE  Hyungjong NOH  Jonghoon LEE  Kyusong LEE  Gary Geunbae LEE  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E95-D   No.5   pp.1216-1228
Publication Date: 2012/05/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.E95.D.1216
Print ISSN: 0916-8532
Type of Manuscript: Special Section PAPER (Special Section on Recent Advances in Multimedia Signal Processing Techniques and Applications)
Category: Speech Processing
Keyword: 
intelligent computer-assisted language learning,  robot-assisted language learning,  language learning game,  grammatical error detection,  corrective feedback,  

Full Text: PDF(2.6MB)>>
Buy this Article




Summary: 
Although there have been enormous investments into English education all around the world, not many differences have been made to change the English instruction style. Considering the shortcomings for the current teaching-learning methodology, we have been investigating advanced computer-assisted language learning (CALL) systems. This paper aims at summarizing a set of POSTECH approaches including theories, technologies, systems, and field studies and providing relevant pointers. On top of the state-of-the-art technologies of spoken dialog system, a variety of adaptations have been applied to overcome some problems caused by numerous errors and variations naturally produced by non-native speakers. Furthermore, a number of methods have been developed for generating educational feedback that help learners develop to be proficient. Integrating these efforts resulted in intelligent educational robots – Mero and Engkey – and virtual 3D language learning games, Pomy. To verify the effects of our approaches on students' communicative abilities, we have conducted a field study at an elementary school in Korea. The results showed that our CALL approaches can be enjoyable and fruitful activities for students. Although the results of this study bring us a step closer to understanding computer-based education, more studies are needed to consolidate the findings.