Nonlinear quantization on Hebbian-type associative memories

Applied Intelligence

Volumn 36, Issue 4, 2012, Pages 824-833

  Liaw, Chishyan ^a   Tsai, Ching Tsorng ^a   Ko, Chao Hui ^b  

^a TUNGHAI UNIVERSITY   (Taiwan)

^b HSIUPING INSTITUTE OF TECHNOLOGY   (Taiwan)

Author keywords

Hebbian type associative memory; Interconnection; Neuron; Nonlinear quantization; Probability of direct convergence

Indexed keywords

ASSOCIATIVE MEMORIES; CHIP AREAS; CONNECTION WEIGHTS; GAUSSIAN DISTRIBUTED; HARDWARE IMPLEMENTATIONS; INTERCONNECTION; INTERCONNECTION WEIGHT; LINEAR QUANTIZATION; NONLINEAR QUANTIZATION;

ASSOCIATIVE STORAGE; DIRECTIONAL PATTERNS (ANTENNA); HARDWARE; NEURONS; PROBABILITY;

ASSOCIATIVE PROCESSING;

EID: 84862117419     PISSN: 0924669X     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10489-011-0299-7     Document Type: Article

References (39)

1. M Verleysen B Sirletti 1989 A high-storage capacity content-addressable memory and its learning algorithm IEEE Trans Circuits Syst 36 5 762 766 10.1109/31.31325
2. T Kamio H Fujisaka M Morisue 2001 Backpropagation algorithm for LOGic oriented neural networks with quantized weights and multilevel threshold neurons IEICE Trans Fundam E84-A 705 712
3. A Heittmann U Ruckert 2002 Mixed mode VLSI implementation of a neural associative memory Analog Integr Circuits Signal Process 30 2 159 172 10.1023/A:1013707829174
4. T Kamio H Fujisaka M Morisue 2002 Associative memories using interaction between multilayer perceptrons and sparsely interconnected neural networks IEICE Trans Fundam E85-A 1220 1228
5. Kamio T, Morisue M (2003) A synthesis procedure for associative memories using cellular neural networks with space-invariant cloning template library. In: Proceedings of the international joint conference on neural networks, pp 885-890
6. C Ho B Ling HK Lam M Nasir 2008 Global convergence and limit cycle behavior of weights of perceptron IEEE Trans Neural Netw 19 6 938 947 10.1109/TNN.2007.914187
7. JJ Hopfield DW Tank 1985 Neural computation of decisions in optimization problems Biol Cybern 52 3 141 152 824597 0572.68041
8. DW Tank JJ Hopfield 1986 Simple optimization networks: A/D converter and a linear programming circuit IEEE Trans Circuits Syst CAS-33 533 541 10.1109/TCS.1986.1085953
9. P Sussner Valle ME 2006 Gray-scale morphological associative memories IEEE Trans Neural Netw 17 3 559 570 10.1109/TNN.2006.873280
10. H Zhang W Huang Z Huang B Zhang 2005 A kernel autoassociator approach to pattern classification IEEE Trans Syst Man Cybern, Part B, Cybern 35 3 593 606 10.1109/TSMCB.2005.843980
11. Sussner P, Valle ME (2007) Morphological and certain fuzzy morphological associative memories for classification and prediction. In: Kaburlasos V, Ritter G (eds) Computational intelligence based on lattice theory. Springer, Heidelberg, pp 149-172
12. G Costantini D Casali R Perfetti 2003 Neural associative memory storing gray-coded gray-scale images IEEE Trans Neural Netw 14 3 703 707 10.1109/TNN.2003.810596
13. G Costantini D Casali R Perfetti 2006 Associative memory design for 256 gray-level images using a multilayer neural network IEEE Trans Neural Netw 17 2 519 522 10.1109/TNN.2005.863465
14. DL Lee 2006 Improvement of complex-valued Hopfield associative memory by using generalized projection rules IEEE Trans Neural Netw 17 5 1341 1347 10.1109/TNN.2006.878786
15. A Monteros Rave de los JHS Azuela 2008 A bidirectional hetero-associative memory for true-color patterns Neural Process Lett 28 3 131 153 10.1007/s11063-008-9086-9
16. ME Valle 2009 A class of sparsely connected autoassociative morphological memories for large color images IEEE Trans Neural Netw 20 6 1045 1050 10.1109/TNN.2009.2020849
17. P Zheng J Zhang W Tang 2010 Color image associative memory on a class of Cohen-Grossberg networks Pattern Recognit 43 10 3255 3260 1213.68672 10.1016/j.patcog.2010.04.027
18. BL Zhang H Zhang SS Ge 2004 Face recognition by applying wavelet subband representation and kernel associative memory IEEE Trans Neural Netw 15 1 166 177 2077184 10.1109/TNN.2003.820673
19. H Zhang B Zhang W Huang Q Tian 2005 Gabor wavelet associative memory for face recognition IEEE Trans Neural Netw 16 1 275 278 10.1109/TNN.2004.841811
20. D Zhang W Zuo 2007 Computational intelligence-based biometric technologies IEEE Comput Intell Mag 2 2 26 36 2316744 10.1109/MCI.2007.353418
21. SJ Han SY Oh 2009 A new paradigm for real-time parallel storage and recognition of patterns based on a hierarchical organization of associative memories utilizing Walsh function encoding Appl Intell 31 3 305 317 10.1007/s10489-008-0128-9
22. Amit DJ (1989) Modeling brain function: the world of attractor neural networks. Cambridge University Press, Cambridge
23. H Sompolinsky 1987 The theory of neural networks: The Hebb rule and beyond Heidelberg Colloquium on Glassy Dyn 275 485 527 916890 10.1007/BFb0057531
24. PC Chung TF Krile 1992 Characteristics of Hebbian-type associative memories having faulty interconnections IEEE Trans Neural Netw 3 6 969 980 10.1109/72.165598
25. PC Chung TF Krile 1995 Reliability characteristics of quadratic Hebbian-type associative memories in optical and electronic network implementations IEEE Trans Neural Netw 6 2 357 367 10.1109/72.363471
26. Guzmán E, Alvarado S, Pogrebnyak O, Sánchez LP, Yánez C (2007) Hardware implementation of image recognition system based on morphological associative memories and discrete wavelet transform. LNCS, vol 4827. Springer, Berlin, pp 664-677
27. Guzmán E, Alvarado S, Pogrebnyak O, Yánez C (2007) Image recognition processor based on morphological associative memories. In: IEEE proceedings of the electronics, robotics and automotive mechanics conference, pp 260-265
28. A Ahmadi HJ Mattausch MA Abedin M Saeidi T Koide 2011 An associative memory-based learning model with an efficient hardware implementation in FPGA Expert Syst Appl 38 3499 3513 10.1016/j.eswa.2010.08.138
29. T Szabó G Horváth 2004 An efficient hardware implementation of feed-forward neural networks Appl Intell 21 2 143 158 1075.68077 10.1023/B:APIN.0000033634.62074.46
30. M Jiang G Gielen 2008 Analysis of quantization effects on high-order function neural networks Appl Intell 28 1 51 67 10.1007/s10489-007-0041-7
31. JH Wang 1998 Principal interconnections in higher order Hebbian-type associative memories IEEE Trans Knowl Data Eng 10 2 342 344 10.1109/69.683763
32. PC Chung CT Tsai YN Sun 1994 Characteristics of Hebbian-type associative memories with quantized interconnections IEEE Trans Circuits Syst 41 2 168 171 0846.68086
33. Davey N, Frank R, Hunt S, Adams R, Calcraft L (2004) High capacity associative memory models-binary and bipolar representation. In: Proceedings of the eighth IASTED international conference artificial intelligence and soft computing, Marbella, Spain, pp 392-397
34. Chung PC, Tsai CT, Sun YN (1994) Linear quantization of Hebbian-type associative memories in interconnection implementation. In: IEEE international conference on neural networks, Orlando, pp 1092-1097
35. RJ McEliece EC Posner 1987 The capacity of the Hopfield associative memory IEEE Trans Inf Theory 33 4 461 482 901677 0631.94016 10.1109/TIT.1987. 1057328
36. DJ Willshaw OP Buneman HC Longuet-Higgins 1969 Nonholographic associative memory Nature 222 960 962 10.1038/222960a0
37. G Palm FT Sommer 1992 Information capacity in recurrent McCulloch-Pitts networks with sparsely coded memory states Network 3 2 177 186 0795.68163 10.1088/0954-898X/3/2/006
38. JH Wang TF Krile JF Walkup 1990 Determination of Hopfield associative memory characteristics using a single parameter Neural Netw 3 3 319 331 10.1016/0893-6080(90)90075-V
39. Walkup JF, Krile TF (1991) Programmable optical quadratic neural networks. Technical Report, Department of Electrical Engineering, Texas Tech University