Unsupervised learning in noise
- 1 March 1990
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 1 (1), 44-57
- https://doi.org/10.1109/72.80204
Abstract
A new hybrid learning law, the differential competitive law, which uses the neuronal signal velocity as a local unsupervised reinforcement mechanism, is introduced, and its coding and stability behavior in feedforward and feedback networks is examined. This analysis is facilitated by the recent Gluck-Parker pulse-coding interpretation of signal functions in differential Hebbian learning systems. The second-order behavior of RABAM (random adaptive bidirectional associative memory) Brownian-diffusion systems is summarized by the RABAM noise suppression theorem: the mean-squared activation and synaptic velocities decrease exponentially quickly to their lower bounds, the instantaneous noise variances driving the system. This result is extended to the RABAM annealing model, which provides a unified framework from which to analyze Geman-Hwang combinatorial optimization dynamical systems and continuous Boltzmann machine learning.Keywords
This publication has 29 references indexed in Scilit:
- Hidden patterns in combined and adaptive knowledge networksInternational Journal of Approximate Reasoning, 1988
- Design for a massive all-optical bidirectional associative memory: the big BAMApplied Optics, 1988
- Nonlinear neural networks: Principles, mechanisms, and architecturesNeural Networks, 1988
- Bidirectional associative memoriesIEEE Transactions on Systems, Man, and Cybernetics, 1988
- Adaptive bidirectional associative memoriesApplied Optics, 1987
- ART 2: self-organization of stable category recognition codes for analog input patternsApplied Optics, 1987
- COUNTERPROPAGATION NETWORKSApplied Optics, 1987
- Masking fields: a massively parallel neural architecture for learning, recognizing, and predicting multiple groupings of patterned dataApplied Optics, 1987
- A massively parallel architecture for a self-organizing neural pattern recognition machineComputer Vision, Graphics, and Image Processing, 1987
- Distinctive features, categorical perception, and probability learning: Some applications of a neural model.Psychological Review, 1977