Keyword : word segmentation


Contextualized Character Embedding with Multi-Sequence LSTM for Automatic Word Segmentation
Hyunyoung LEE Seungshik KANG 
Publication:   
Publication Date: 2020/11/01
Vol. E103-D  No. 11 ; pp. 2371-2378
Type of Manuscript:  PAPER
Category: Natural Language Processing
Keyword: 
contextualized character embeddingLSTMlinear-chain CRFword segmentation
 Summary | Full Text:PDF

Improving Thai Word and Sentence Segmentation Using Linguistic Knowledge
Rungsiman NARARATWONG Natthawut KERTKEIDKACHORN Nagul COOHAROJANANONE Hitoshi OKADA 
Publication:   
Publication Date: 2018/12/01
Vol. E101-D  No. 12 ; pp. 3218-3225
Type of Manuscript:  PAPER
Category: Natural Language Processing
Keyword: 
Thaiword segmentationtopic extractiontranslationsummarization
 Summary | Full Text:PDF

Integration of Multiple Bilingually-Trained Segmentation Schemes into Statistical Machine Translation
Michael PAUL Andrew FINCH Eiichiro SUMITA 
Publication:   IEICE TRANSACTIONS on Information and Systems
Publication Date: 2011/03/01
Vol. E94-D  No. 3 ; pp. 690-697
Type of Manuscript:  PAPER
Category: Natural Language Processing
Keyword: 
statistical machine translationword segmentationmachine learningAsian languages
 Summary | Full Text:PDF

Joint Chinese Word Segmentation and POS Tagging Using an Error-Driven Word-Character Hybrid Model
Canasai KRUENGKRAI Kiyotaka UCHIMOTO Jun'ichi KAZAMA Yiou WANG Kentaro TORISAWA Hitoshi ISAHARA 
Publication:   IEICE TRANSACTIONS on Information and Systems
Publication Date: 2009/12/01
Vol. E92-D  No. 12 ; pp. 2298-2305
Type of Manuscript:  Special Section PAPER (Special Section on Natural Language Processing and its Applications)
Category: Morphological/Syntactic Analysis
Keyword: 
word segmentationPOS taggingerror-drivenword-character hybrid model
 Summary | Full Text:PDF

Utilizing the Web for Automatic Word Spacing
Gumwon HONG Jeong-Hoon LEE Young-In SONG Do-Gil LEE Hae-Chang RIM 
Publication:   IEICE TRANSACTIONS on Information and Systems
Publication Date: 2009/12/01
Vol. E92-D  No. 12 ; pp. 2553-2556
Type of Manuscript:  LETTER
Category: Natural Language Processing
Keyword: 
word spacingword segmentation
 Summary | Full Text:PDF

Pattern-Based Features vs. Statistical-Based Features in Decision Trees for Word Segmentation
Thanaruk THEERAMUNKONG Thanasan TANHERMHONG 
Publication:   IEICE TRANSACTIONS on Information and Systems
Publication Date: 2004/05/01
Vol. E87-D  No. 5 ; pp. 1254-1260
Type of Manuscript:  PAPER
Category: Natural Language Processing
Keyword: 
word segmentationdecision tree inductionstatisticsThai character cluster
 Summary | Full Text:PDF

Determining Indexing Strings with Statistical Analysis
Yoshiyuki TAKEDA Kyoji UMEMURA Eiko YAMAMOTO 
Publication:   IEICE TRANSACTIONS on Information and Systems
Publication Date: 2003/09/01
Vol. E86-D  No. 9 ; pp. 1781-1787
Type of Manuscript:  Special Section PAPER (Special Issue on Text Processing for Information Access)
Category: 
Keyword: 
agglutinative languageword segmentationadaptation
 Summary | Full Text:PDF