Introducing an Adaptive VLR Algorithm Using Learning Automata for Multilayer Perceptron

Behbood MASHOUFI  Mohammad Bagher MENHAJ  Sayed A. MOTAMEDI  Mohammad R. MEYBODI  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E86-D   No.3   pp.594-609
Publication Date: 2003/03/01
Online ISSN: 
DOI: 
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Algorithms
Keyword: 
multilayer neural network,  backpropagation,  variable learning rate,  learning automata,  

Full Text: PDF>>
Buy this Article



Summary: 
One of the biggest limitations of BP algorithm is its low rate of convergence. The Variable Learning Rate (VLR) algorithm represents one of the well-known techniques that enhance the performance of the BP. Because the VLR parameters have important influence on its performance, we use learning automata (LA) to adjust them. The proposed algorithm named Adaptive Variable Learning Rate (AVLR) algorithm dynamically tunes the VLR parameters by learning automata according to the error changes. Simulation results on some practical problems such as sinusoidal function approximation, nonlinear system identification, phoneme recognition, Persian printed letter recognition helped us better to judge the merit of the proposed AVLR method.