Introducing a Translation Dictionary into Phrase-Based SMT

Hideo OKUMA  Hirofumi YAMAMOTO  Eiichiro SUMITA  

IEICE TRANSACTIONS on Information and Systems   Vol.E91-D   No.7   pp.2051-2057
Publication Date: 2008/07/01
Online ISSN: 1745-1361
DOI: 10.1093/ietisy/e91-d.7.2051
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Natural Language Processing
statistical machine translation,  translation dictionary,  

Full Text: PDF(493.2KB)>>
Buy this Article

This paper presents a method to effectively introduce a translation dictionary into phrase-based SMT. Though SMT systems can be built with only a parallel corpus, translation dictionaries are more widely available and have many more entries than parallel corpora. A simple and low-cost method to introduce a translation dictionary is to attach a dictionary entry into a phrase table. This, however, does not work well. Target word order and even whole target sentences are often incorrect. To solve this problem, the proposed method uses high-frequency words in the training corpus. The high-frequency words may already be trained well; in other words, they may appear in the phrase table and therefore be translated with correct word order. Experimental results show the proposed method as far superior to simply attaching dictionary entries into phrase tables.