Dynamic Constructive Fault Tolerant Algorithm for Feedforward Neural Networks

Nait Charif HAMMADI  Toshiaki OHMAMEUDA  Keiichi KANEKO  Hideo ITO  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E81-D   No.1   pp.115-123
Publication Date: 1998/01/25
Online ISSN: 
DOI: 
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Bio-Cybernetics and Neurocomputing
Keyword: 
feedforward neural network,  dynamic constructive algorithm,  fault tolerance,  DCFTA,  

Full Text: PDF>>
Buy this Article




Summary: 
In this paper, a dynamic constructive algorithm for fault tolerant feedforward neural network, called DCFTA, is proposed. The algorithm starts with a network with single hidden neuron, and a new hidden unit is added dynamically to the network whenever it fails to converge. Before inserting the new hidden neuron into the network, only the weights connecting the new hidden neuron to the other neurons are trained (i. e. , updated) until there is no significant reduction of the output error. To generate a fault tolerant network, the relevance of each synaptic weight is estimated in each cycle, and only the weights which have their relevance less than a specified threshold are updated in that cycle. The loss of a connections between neurons (which are equivalent to stuck-at-0 faults) are assumed. The simulation results indicate that the network constructed by DCFTA has a significant fault tolerance ability.