For Full-Text PDF, please login, if you are a member of IEICE,|
or go to Pay Per View on menu list, if you are a nonmember of IEICE.
Evaluation Method of Non-task-oriented Dialogue Agent Using Word Co-occurrence
Michimasa INABA Fujio TORIUMI Kenichiro ISHII
D - Abstracts of IEICE TRANSACTIONS on Information and Systems (Japanese Edition)
Publication Date: 2011/01/01
Online ISSN: 1881-0225
Print ISSN: 1880-4535
Type of Manuscript: Special Section PAPER (Special Section on Human Communication --Fundamental Techniques for Construction of Human-centered Information Environment--)
dialogue agent, word co-occurrence, evaluation method, large-scale corpora, non-task-oriented,
Full Text(in Japanese): PDF(248.8KB)>>
Recently, the computer aided communication have been actively studied. One of them is the study of dialogue agent. However, There are few researches on the systems to talk with a human, and there are no systems that can make an intellectual reply. In order to realize a practical system, the performance should be evaluated quantitatively. In this paper, we propose a new method that is based on the presumption that a utterance is semantically correct if it has lexical cohesion among a context. It was clarified that our method can evaluate performance of dialogue system objectively and quantitatively.