Reliable computing with unreliable components: Using separable environments to stabilize long-term information storage

Physica D: Nonlinear Phenomena

Volumn 237, Issue 9, 2008, Pages 1196-1206

  Nugent, M A ^a   Porter, R ^b   Kenyon, G T ^b  

^a KnowmTech   (United States)

^b LOS ALAMOS NATIONAL LABORATORY   (United States)

Author keywords

Classification; Connectionist; Information storage; Long term memory; Molecular scale; Nano scale; Neural network; Separability; Stability

Indexed keywords

BINARY SEQUENCES; CLASSIFICATION (OF INFORMATION); NEURAL NETWORKS; NONVOLATILE STORAGE; RELIABILITY ANALYSIS; VECTOR QUANTIZATION;

BINARY CLASSIFICATIONS; CONNECTIONIST NETWORKS; LONG TERM MEMORY; MOLECULAR SCALE; SEPARABILITY;

DATA STORAGE EQUIPMENT;

EID: 44349097400     PISSN: 01672789     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physd.2008.03.043     Document Type: Article

References (25)

1. In: Adamatzky BDLC A., Bull L., Stepney S., and Teuscher C. (Eds). Unconventional Computing 2007 (2007), Luniver Press
2. Abraham W.C., and Robins A. Memory retention - the synaptic stability versus plasticity dilemma. Trends Neurosci. 28 (2005) 73-78
3. Bell A.J., and Sejnowski T.J. The "independent components" of natural scenes are edge filters. Vision Res 37 (1997) 3327-3338
4. Bienenstock E.L., Cooper L.N., and Munro P.W. Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex. J. Neurosci. 2 (1982) 32-48
5. In: Calude C.S., Dinneen M.J., Pǎun G., Rozenberg G., and Stepney S. (Eds). Unconventional Computation: 5th International Conference, UC 2006, York, UK, 4-8 September, 2006, Proceedings (2006), Springer
6. Crair M.C., and Malenka R.C. A critical period for long-term potentiation at thalamocortical synapses. Nature 375 (1995) 325-328
7. Crick F., and Mitchison G. The function of dream sleep. Nature 304 (1983) 111-114
8. Fusi S., Drew P.J., and Abbott L.F. Cascade models of synaptically stored memories. Neuron 45 (2005) 599-611
9. Fusi S., Annunziato M., Badoni D., Salamon A., and Amit D.J. Spike-driven synaptic plasticity: Theory, simulation, VLSI implementation. Neural Comput. 12 (2000) 2227-2258
10. Goldstein S.C. The impact of the nanoscale on computing systems. International Conference on Computer-Aided Design (2005), IEEE/ACM, San Jose, CA 655-661
11. Hastie T., Tibshirani R., and Friedman J. The Elements of Statistical Learning (2001), Springer, New York
12. Hopfield J.J., Feinstein D.I., and Palmer R.G. 'Unlearning' has a stabilizing effect in collective memories. Nature 304 (1983) 158-159
13. Hyvarinen A., Karhunen J., and Oja E. Independent Component Analysis (2001), J. Wiley, New York
14. Kenyon G.T. A model of long-term memory storage in the cerebellar cortex: A possible role for plasticity at parallel fiber synapses onto stellate/basket interneurons. Proc. Natl. Acad. Sci. USA 94 (1997) 14200-14205
15. Kim S.J., and Linden D.J. Ubiquitous plasticity and memory storage. Neuron 56 (2007) 582-592
16. Miller P., Zhabotinsky A.M., Lisman J.E., and Wang X.J. The stability of a stochastic CaMKII switch: Dependence on the number of enzyme molecules and protein turnover. PLoS. Biol. 3 (2005) e107 Epub 2005 Mar 2029
17. Nathan I., and Leon N.C. Objective function formulation of the BCM theory of visual cortical plasticity: Statistical connections, stability conditions. Neural Netw. 5 (1992) 3-17
18. Neumann J.v. Probabilistic logics and synthesis of reliable organisms from unreliable components. In: McCarthy C. (Ed). Automata Studies (1956), Princeton University Press 43-98
19. Nicholson D.A., Sweet J.A., and Freeman Jr. J.H. Long-term retention of the classically conditioned eyeblink response in rats. Behav. Neurosci. 117 (2003) 871-875
20. Nugent A., Kenyon G., and Porter R. Unsupervised adaptation to improve fault tolerance of neural network classifiers. In: Zebulum R.S., Gwaltney D., Hornby G., Keymeulen D., Lohn J., and Stoica A. (Eds). 2004 NASA/DoD Conference on Evolvable Hardware (2004), IEEE Computer Society, Seattle, Washington 246-249
21. Robins A., and McCallum S. The consolidation of learning during sleep: Comparing the pseudorehearsal and unlearning accounts. Neural Netw. 12 (1999) 1191-1206
22. Rummelhart D.E., and McClelland J.L. Parallel distributed processing: Explorations in the microstructure of cognition. Foundations vol. 1 (1986), MIT Press
23. Schreurs B.G. Long-term memory and extinction of the classically conditioned rabbit nictitating membrane response. Learning Motivation 24 (1993) 293-302
24. Shouval H.Z. Clusters of interacting receptors can stabilize synaptic efficacies. Proc. Natl. Acad. Sci. USA 102 (2005) 14440-14445 Epub 12005 Sep 14427
25. Xia Y., Nawy S., and Carroll R.C. Activity-dependent synaptic plasticity in retinal ganglion cells. J. Neurosci. 27 (2007) 12221-12229