
For FullText PDF, please login, if you are a member of IEICE,
or go to Pay Per View on menu list, if you are a nonmember of IEICE.

Image Associative Memory by Recurrent Neural Subnetworks
Wfadysfaw SKARBEK Andrzej CICHOCKI
Publication
IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences
Vol.E79A
No.10
pp.16381646 Publication Date: 1996/10/25 Online ISSN:
DOI: Print ISSN: 09168508 Type of Manuscript: Special Section PAPER (Special Section on Nonlinear Theory and its Applications (NOLTA)) Category: Neural Nets and Human Being Keyword: recurrent neural networks, associative memory, image compression, fractals,
Full Text: PDF(939.1KB)>>
Summary:
Gray scale images are represented by recurrent neural subnetworks which together with a competition layer create an associative memory. The single recurrent subnetwork N_{i} implements a stochastic nonlinear fractal operator F_{i}, constructed for the given image f_{i}. We show that under realstic assumptions F has a unique attractor which is located in the vicinity of the original image. Therefore one subnetwork represents one original image. The associative recall is implemented in two stages. Firstly, the competition layer finds the most invariant subnetwork for the given input noisy image g. Next, the selected recurrent subnetwork in few (510) global iterations produces high quality approximation of the original image. The degree of invariance for the subnetwork N_{i} on the inprt g is measured by a norm gF_{i}(g). We have experimentally verified that associative recall for images of natural scenes with pixel values in [0, 255] is successful even when Gaussian noise has the standard deviation σ as large as 500. Moreover, the norm, computed only on 10% of pixels chosen randomly from images still successfuly recalls a close approximation of original image. Comparing to AmariHopfield associative memory, our solution has no spurious states, is less sensitive to noise, and its network complexity is significantly lower. However, for each new stored image a new subnetwork must be added.

