Evaluation Method of Non-task-oriented Dialogue Agent Using Word Co-occurrence

Michimasa INABA  Fujio TORIUMI  Kenichiro ISHII  

D - Abstracts of IEICE TRANSACTIONS on Information and Systems (Japanese Edition)   Vol.J94-D    No.1    pp.48-58
Publication Date: 2011/01/01
Online ISSN: 1881-0225
Print ISSN: 1880-4535
Type of Manuscript: Special Section PAPER (Special Section on Human Communication --Fundamental Techniques for Construction of Human-centered Information Environment--)
dialogue agent,  word co-occurrence,  evaluation method,  large-scale corpora,  non-task-oriented,  

Full Text(in Japanese): PDF(248.8KB)>>
Buy this Article

Recently, the computer aided communication have been actively studied. One of them is the study of dialogue agent. However, There are few researches on the systems to talk with a human, and there are no systems that can make an intellectual reply. In order to realize a practical system, the performance should be evaluated quantitatively. In this paper, we propose a new method that is based on the presumption that a utterance is semantically correct if it has lexical cohesion among a context. It was clarified that our method can evaluate performance of dialogue system objectively and quantitatively.

open access publishing via