Three-Phase Text Error Correction Model for Korean SMS Messages

Jeunghyun BYUN  So-Young PARK  Seung-Wook LEE  Hae-Chang RIM 

Publication
IEICE TRANSACTIONS on Information and Systems  Vol.E92-D  No.5  pp.1213-1217
Publication Date: 2009/05/01
Online ISSN: 1745-1361
Print ISSN: 0916-8532
Type of Manuscript: LETTER
Category: Natural Language Processing
Keyword: 
text error correction,  word spacing errors,  spelling errors,  SMS messages, 

Full Text: PDF(87.5KB)

Summary: 
In this paper, we propose a three-phase text error correction model consisting of a word spacing error correction phase, a syllable-based spelling error correction phase, and a word-based spelling error correction phase. In order to reduce the text error correction complexity, the proposed model corrects text errors step by step. With the aim of correcting word spacing errors, spelling errors, and mixed errors in SMS messages, the proposed model tries to separately manage the word spacing error correction phase and the spelling error correction phase. For the purpose of utilizing both the syllable-based approach covering various errors and the word-based approach correcting some specific errors accurately, the proposed model subdivides the spelling error correction phase into the syllable-based phase and the word-based phase. Experimental results show that the proposed model can improve the performance by solving the text error correction problem based on the divide-and-conquer strategy.