For Full-Text PDF, please login, if you are a member of IEICE,|
or go to Pay Per View on menu list, if you are a nonmember of IEICE.
Multilayer Network Learning Algorithm Based on Pattern Search Method
Xu-Gang WANG Zheng TANG Hiroki TAMURA Masahiro ISHII
IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences
Publication Date: 2003/07/01
Print ISSN: 0916-8508
Type of Manuscript: PAPER
Category: Neural Networks and Bioengineering
multilayer neural networks, pattern search method, backpropagation, learning,
Full Text: PDF>>
A new multilayer artificial neural network learning algorithm based on the pattern search method is proposed. The learning algorithm is designed to provide a very simple and effective means of searching the minima of an objective function directly without any knowledge of its derivatives. We test this algorithm on benchmark problems, such as exclusive-or (XOR), parity and alphabetic character learning problems. For all problems, the systems are shown to be trained efficiently by our algorithm. As a simple direct search algorithm, it can be applied to hardware implementations easily.