Korean-Vietnamese Neural Machine Translation with Named Entity Recognition and Part-of-Speech Tags

Van-Hai VU  Quang-Phuoc NGUYEN  Kiem-Hieu NGUYEN  Joon-Choul SHIN  Cheol-Young OCK  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E103-D   No.4   pp.866-873
Publication Date: 2020/04/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2019EDP7154
Type of Manuscript: PAPER
Category: Natural Language Processing
Keyword: 
Korean-Vietnamese machine translation,  neural machine translation,  named entity recognition,  part-of-speech,  word sense disambiguation,  

Full Text: PDF>>
Buy this Article




Summary: 
Since deep learning was introduced, a series of achievements has been published in the field of automatic machine translation (MT). However, Korean-Vietnamese MT systems face many challenges because of a lack of data, multiple meanings of individual words, and grammatical diversity that depends on context. Therefore, the quality of Korean-Vietnamese MT systems is still sub-optimal. This paper discusses a method for applying Named Entity Recognition (NER) and Part-of-Speech (POS) tagging to Vietnamese sentences to improve the performance of Korean-Vietnamese MT systems. In terms of implementation, we used a tool to tag NER and POS in Vietnamese sentences. In addition, we had access to a Korean-Vietnamese parallel corpus with more than 450K paired sentences from our previous research paper. The experimental results indicate that tagging NER and POS in Vietnamese sentences can improve the quality of Korean-Vietnamese Neural MT (NMT) in terms of the Bi-Lingual Evaluation Understudy (BLEU) and Translation Error Rate (TER) score. On average, our MT system improved by 1.21 BLEU points or 2.33 TER scores after applying both NER and POS tagging to the Vietnamese corpus. Due to the structural features of language, the MT systems in the Korean to Vietnamese direction always give better BLEU and TER results than translation machines in the reverse direction.