Please login using the form on menu list.|
It is required to login for Full-Text PDF.
CHQ: A Multi-Agent Reinforcement Learning Scheme for Partially Observable Markov Decision Processes
IEICE TRANSACTIONS on Information and Systems Vol.E88-D No.5 pp.1004-1011
Publication Date: 2005/05/01
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Artificial Intelligence and Cognitive Science
partially observable MDP,
Full Text: PDF(255.1KB)
In this paper, we propose a new reinforcement learning scheme called CHQ that could efficiently acquire appropriate policies under partially observable Markov decision processes (POMDP) involving probabilistic state transitions, that frequently occurs in multi-agent systems in which each agent independently takes a probabilistic action based on a partial observation of the underlying environment. A key idea of CHQ is to extend the HQ-learning proposed by Wiering et al. in such a way that it could learn the activation order of the MDP subtasks as well as an appropriate policy under each MDP subtask. The goodness of the proposed scheme is experimentally evaluated. The result of experiments implies that it can acquire a deterministic policy with a sufficiently high success rate, even if the given task is POMDP with probabilistic state transitions.