Finite memory loading in hairy neurons

Natural Computing

Volumn 5, Issue 1, 2006, Pages 15-42

  Liou, Cheng Yuan ^a   Lin, Shiao Lin ^b  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b NATIONAL TAIWAN NORMAL UNIVERSITY   (Taiwan)

Author keywords

Associative memory; Error correction rule; Gibb's free energy; Hairy model; Hopfield network; Little model; Music perception; Neural network; Spin glass model

Indexed keywords

ANALYTICAL ERROR; ARTICLE; ARTIFICIAL NEURAL NETWORK; ASSOCIATIVE MEMORY; CONTROLLED STUDY; GEOMETRY; INTERMETHOD COMPARISON; MATHEMATICAL MODEL; NERVE CELL; PROCESS OPTIMIZATION; SIMULATION; STATE DEPENDENT LEARNING;

EID: 31144474148     PISSN: 15677818     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11047-004-5490-x     Document Type: Article

References (25)

1. DH Ackley GE Hinton TJ. Sejnowski 1985 A learning algorithm for Boltzmann machine Cognitive Science. 9 147-169 10.1016/ S0364-0213(85)80012-4
2. SI. Amari 1972 Learning patterns and pattern sequences by self-organising nets IEEE Transactions on Computers. 21 1197-1206 0245.94024 51 #2373
3. Boser B, Guyon I, Vapnik VN. (1992). A training algorithm for optimal margin classifiers. In: Fifth Annual Workshop on Computational Learning Theory, Morgan Kaufmann, pp. 144-152
4. J. Bruck 1990 On the convergence properties of the Hopfield model Proceeding of IEEE. 78 1579-1585
5. TM. Cover 1965 Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition IEEE Transactions on Electronic Computers. 14 326-334 0152.18206
6. E. Gardner 1987 Maximum storage capacity in neural networks Electrophysics Letters. 4 4 481-485
7. E. Gardner 1989 Optimal basins of attraction in randomly sparse neural network models Journal of Physics. A 22 12 1969-1974 90f:82028 90f:82028
8. DO. Hebb 1949 The Organization of Behavior: A Neuropsychological Theory Wiley New York
9. JJ. Hopfield 1982 Neural networks and physical systems with emergent collective computational ability Proceeding of the National Academy of Science. 79 2554-2558 83g:92024
10. Ince DC. (1992). Intelligent machinery. In: Ince DC. (eds). Collected Works of A. M. Turing: Mechanical Intelligence. Elsevier Science Publishers
11. I Kanter H. Sompolinsky 1987 Associative recall of memory without errors Physics Review. A 35 1 380-392
12. Kauffman SA (1991) Antichaos and adaptation. Scientific American: 64-70
13. J Li AN Michel W. Porod 1989 Analysis and synthesis of a class of neural networks: Linear systems operating on a closed hypercube IEEE Transactions on Circuits and Systems. 36 11 1405-1422 10.1109/31.41297 90k:92015
14. Liou CY and Lin SL (1989) The other variant Boltzmann machine. In: Proceedings of the IJCNN, Washington DC, pp. 449-454
15. Liou CY and Sou UC. (2003) Loading temporal associative memory using the neuronic equation. In: Kaynak O, Alpaydin E, Oja E and Xu L (eds), LCS, vol. 2714, Springer, pp. 52-59
16. CY Liou JM. Wu 1996 Self-organization using Potts models Neural Networks. 9 4 671-684 10.1016/0893-6080(95)00111-5
17. Liou CY and Yu WJ (1995) Ambiguous binary representation in multilayer neural network. In: Proceedings of the ICNN, Perth, Australia, vol. 1, pp. 379-384
18. CY Liou SK. Yuan 1999 Error tolerant associative memory Biological Cybernetics. 81 331-342 10.1007/s004220050566
19. WA. Little 1974 The existence of persistent states in the brain Mathematical Biosciences. 19 101-120 10.1016/0025-5564(74)90031-5 0272.92011
20. RJ Mceliece EC Posner ER Rodemich SS. Venkatesh 1987 The capacity of the Hopfield associative memory IEEE Transaction on information Theory. 33 461-482 88h:92019
21. Szu H. (1989). Reconfigurable neural nets by energy convergence learning principle based on extended McCulloch-Pitts neurons and synapses. In: Proc IJCNN, Washington, DC, vol. 1, pp. 485-496
22. H. Szu 1999 Thermodynamics energy for both supervised and unsupervised learning neural nets at a constant temperature International Journal of Neural System. 9 175-186
23. Q Tao T Fang H. Qiao 2001 A novel continuous-time neural network for realizing associative memory IEEE Transactions on Neural Networks. 12 2 418-423
24. Widrow B and Hoff ME Jr. (1960) Adaptive switching circuits. In: IRE WESCON Convention Record, pp. 96-104
25. PD. Wilde 1997 The magnitude of the diagonal elements in neural networks Neural Networks. 10 3 499-504 10.1016/S0893-6080(96)00094-9