IEICE Trans - Evaluation Method of Non-task-oriented Dialogue Agent Using Word Co-occurrence

Evaluation Method of Non-task-oriented Dialogue Agent Using Word Co-occurrence

Michimasa INABA  Fujio TORIUMI  Kenichiro ISHII

Publication
D - Abstracts of IEICE TRANSACTIONS on Information and Systems (Japanese Edition)   Vol.J94-D   No.1   pp.48-58
Publication Date: 2011/01/01
Online ISSN: 1881-0225
DOI:
Print ISSN: 1880-4535
Type of Manuscript: Special Section PAPER (Special Section on Human Communication --Fundamental Techniques for Construction of Human-centered Information Environment--)
Category:
Keyword:
dialogue agent,  word co-occurrence,  evaluation method,  large-scale corpora,  non-task-oriented,

Full Text(in Japanese): PDF(248.8KB)>>

Summary:
Recently, the computer aided communication have been actively studied. One of them is the study of dialogue agent. However, There are few researches on the systems to talk with a human, and there are no systems that can make an intellectual reply. In order to realize a practical system, the performance should be evaluated quantitatively. In this paper, we propose a new method that is based on the presumption that a utterance is semantically correct if it has lexical cohesion among a context. It was clarified that our method can evaluate performance of dialogue system objectively and quantitatively.