Optimal Plasticity from Matrix Memories: What Goes Up Must Come Down
- 1 March 1990
- journal article
- Published by MIT Press in Neural Computation
- Vol. 2 (1), 85-93
- https://doi.org/10.1162/neco.1990.2.1.85
Abstract
A recent article (Stanton and Sejnowski 1989) on long-term synaptic depression in the hippocampus has reopened the issue of the computational efficiency of particular synaptic learning rules (Hebb 1949; Palm 1988a; Morris and Willshaw 1989) — homosynaptic versus heterosynaptic and monotonic versus nonmonotonic changes in synaptic efficacy. We have addressed these questions by calculating and maximizing the signal-to-noise ratio, a measure of the potential fidelity of recall, in a class of associative matrix memories. Up to a multiplicative constant, there are three optimal rules, each providing for synaptic depression such that positive and negative changes in synaptic efficacy balance out. For one rule, which is found to be the Stent-Singer rule (Stent 1973; Rauschecker and Singer 1979), the depression is purely heterosynaptic; for another (Stanton and Sejnowski 1989), the depression is purely homosynaptic; for the third, which is a generalization of the first two, and has a higher signal-to-noise ratio, it is both heterosynaptic and homosynaptic. The third rule takes the form of a covariance rule (Sejnowski 1977a,b) and includes, as a special case, the prescription due to Hopfield (1982) and others (Willshaw 1971; Kohonen 1972).Keywords
This publication has 12 references indexed in Scilit:
- Maximum Storage Capacity in Neural NetworksEurophysics Letters, 1987
- Information storage in neural networks with low levels of activityPhysical Review A, 1987
- Excitatory amino acids in synaptic transmission in the Schaffer collateral‐commissural pathway of the rat hippocampus.Journal Of Physiology-London, 1983
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences of the United States of America, 1982
- Storing covariance with nonlinearly interacting neuronsJournal of Mathematical Biology, 1977
- Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant pathJournal Of Physiology-London, 1973
- A Physiological Mechanism for Hebb's Postulate of LearningProceedings of the National Academy of Sciences of the United States of America, 1973
- Correlation Matrix MemoriesIEEE Transactions on Computers, 1972
- Simple memory: a theory for archicortexPhilosophical Transactions of the Royal Society of London. B, Biological Sciences, 1971
- A memory storage model utilizing spatial correlation functionsKybernetik, 1968