A Method for Recognizing Noisy Romanized Japanese Words in Learner English


IEICE TRANSACTIONS on Information and Systems   Vol.E91-D   No.10   pp.2458-2466
Publication Date: 2008/10/01
Online ISSN: 1745-1361
DOI: 10.1093/ietisy/e91-d.10.2458
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Educational Technology
romanized Japanese words,  English writing,  grammatical error detection,  learner English,  language learning and teaching,  

Full Text: PDF(254KB)>>
Buy this Article

This paper describes a method for recognizing romanized Japanese words in learner English. They become noise and problematic in a variety of systems and tools for language learning and teaching including text analysis, spell checking, and grammatical error detection because they are Japanese words and thus mostly unknown to such systems and tools. A problem one encounters when recognizing romanized Japanese words in learner English is that the spelling rules of romanized Japanese words are often violated. To address this problem, the described method uses a clustering algorithm reinforced by a small set of rules. Experiments show that it achieves an F-measure of 0.879 and outperforms other methods. They also show that it only requires the target text and an English word list of reasonable size.