Agent-Oriented Routing in Telecommunications Networks

Karla VITTORI  Aluizio F. R. ARAUJO  

IEICE TRANSACTIONS on Communications   Vol.E84-B   No.11   pp.3006-3013
Publication Date: 2001/11/01
Online ISSN: 
Print ISSN: 0916-8516
Type of Manuscript: PAPER
Category: Software Platform
ant-based agents,  Q-learning,  routing,  telecommunications networks,  

Full Text: PDF>>
Buy this Article

This paper presents an intelligent routing algorithm, called Q-Agents, which bases its actions only on the agent-environment interaction. This algorithm combines properties of three learning strategies (Q-learning, dual reinforcement learning and learning based on ant colony behavior), adding to them two further mechanisms to improve its adaptability. Hence, the proposed algorithm is composed of a set of agents, moving through the network independently and concurrently, searching for the best routes. The agents share knowledge about the quality of the paths traversed through indirect communication. Information about the network and traffic status is updated by using Q-learning and dual reinforcement updating rules. Q-Agents were applied to a model of an AT&T circuit-switched network. Experiments were carried out on the performance of the algorithm under variations of traffic patterns, load level and topology, and with addition of noise in the information used to route calls. Q-Agents suffered a lower number of lost calls than two algorithms based entirely on ant colony behavior.