Design and analysis of high-capacity associative memories based on a class of discrete-time recurrent neural networks

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 38, Issue 6, 2008, Pages 1525-1536

  Zeng, Zhigang ^a   Wang, Jun ^b  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Autoassociative memory; Cellular neural networks (CNNs); Cloning template; Heteroassociative memory

Indexed keywords

ASSOCIATIVE PROCESSING; ASYMPTOTIC STABILITY; CLONING; CONTINUOUS TIME SYSTEMS; DATA STORAGE EQUIPMENT; GENETIC ENGINEERING; NEURAL NETWORKS; RECURRENT NEURAL NETWORKS; REINFORCEMENT LEARNING; SPACE PROBES;

ASSOCIATIVE MEMORIES; AUTOASSOCIATIVE MEMORIES; AUTOASSOCIATIVE MEMORY; CLONING TEMPLATE; CLONING TEMPLATES; DESIGN AND ANALYSES; DESIGN METHODS; DESIGN PARAMETERS.; EXTERNAL INPUTS; GLOBAL ASYMPTOTIC STABILITIES; HETEROASSOCIATIVE MEMORY; INITIAL CONDITIONS; INPUT MATRIXES; STORAGE CAPACITIES; STORED PATTERNS;

CELLULAR NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOMIMETICS; COMPUTER PROGRAM; COMPUTER SIMULATION; FEEDBACK SYSTEM; LEARNING; METHODOLOGY; SIGNAL PROCESSING; THEORETICAL MODEL;

ALGORITHMS; ASSOCIATION LEARNING; BIOMIMETICS; COMPUTER SIMULATION; FEEDBACK; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER); SIGNAL PROCESSING, COMPUTER-ASSISTED; SOFTWARE; SOFTWARE DESIGN;

EID: 57049103992     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2008.927717     Document Type: Article

References (24)

1. J. A. Anderson, J. W. Silverstein, S. A. Ritz, and R. S. Jones, "Distinctive features, categorical perception, and probability leaming: Some applications of a neural model," Psychol. Rev., vol. 84, pp. 413-451, 1977.
2. J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities," Proc. Nat. Acad. Sci., vol. 79, no. 8, pp. 2554-2558, Apr. 1982.
3. B. Kosko, "Bidirectional associative memories," IEEE Trans. Syst., Man, Cybern., vol. 18, no. 1, pp. 49-60, Jan./Feb. 1988.
4. A. N. Michel and J. A. Farrell, "Associative memories via artificial neural networks," IEEE Control Syst. Mag., vol. 10, no. 3, pp. 6-17, Apr. 1990.
5. A. N. Michel, J. A. Farrell, and H. F. Sun, "Analysis and synthesis techniques for Hopfield type synchronous discrete time neural networks with application to associative memory," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 37, no. 11, pp. 1356-1366, Nov. 1990.
6. G. Yen and A. N. Michel, "A learning and forgetting algorithm in associative memories: Results involving pseudo-inverses," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 38, no. 10, pp. 1193-1205, Oct. 1991.
7. G. Yen and A. N. Michel, "A learning and forgetting algorithm in associative memories: The eigenstructure method," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 39, no. 4, pp. 212-225, Apr. 1992.
8. D. Liu and A. N. Michel, "Sparsely interconnected neural networks for associative memories with applications to cellular neural networks," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 41, no. 4, pp. 295-307, Apr. 1994.
9. M. Brucoli, L. Carnimeo, and G. Grassi, "Discrete-time cellular neural networks for associative memories with learning and forgetting capabilities," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl. vol. 42, no. 7, pp. 396-399, Jul. 1995.
10. D. Liu, "Cloning template design of cellular neural networks for associative memories," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 44, no. 7, pp. 646-650, Jul. 1997.
11. D. Liu and Z. Lu, "A new synthesis approach for feedback neural networks based on the perceptron training algorithm," IEEE Trans. Neural Netw., vol. 8, no. 6, pp. 1468-1482, Nov. 1997.
12. Z. J. Lu and D. Liu, "A new synthesis procedure for a class of cellular neural networks with space-invariant cloning template," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 45, no. 12, pp. 1601-1605, Dec. 1998.
13. Z. G. Zeng and J. Wang, "Analysis and design of associative memories based on recurrent neural networks with linear saturation activation functions and time-varying delays," Neural Comput., vol. 19, no. 8, pp. 2149-2182, Aug. 2007.
14. G. Grassi, "A new approach to design cellular neural networks for associative memories," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 44, no. 9, pp. 835-838, Sep. 1997.
15. G. Grassi, "On discrete-time cellular neural networks for associative memories," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 48, no. 1, pp. 107-111, Jan. 2001.
16. D. R. Chowdhury, I. S. Gupta, and P. P. Chaudhuri, "A low-cost high-capacity associative memory design using cellular automata," IEEE Trans. Comput., vol. 44, no. 10, pp. 1260-1264, Oct. 1995.
17. P. Maji, N. Ganguly, and P. Pal Chaudhuri, "Error correcting capability of cellular automata based associative memory," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 33, no. 4, pp. 466-480, Jul. 2003.
18. N. Ganguly, P. Maji, B. K. Sikdar, and P. P. Chaudhuri, "Design and characterization of cellular automata based associative memory for pattern recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 672-678, Feb. 2004.
19. X. X. Liao and J. Wang, "Algebraic criteria for global exponential stability of cellular neural networks with multiple time delays," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 50, no. 2, pp. 268-275, Feb. 2003.
20. Z. G. Zeng, J. Wang, and X. X. Liao, "Stability analysis of delayed cellular neural networks described using cloning templates," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 11, pp. 2313-2324, Nov. 2004.
21. Z. G. Zeng, J. Wang, and X. X. Liao, "Global exponential stability of a general class of recurrent neural networks with time-varying delays," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 50, no. 10, pp. 1353-1358, Oct. 2003.
22. Z. G. Zeng, D. S. Huang, and Z. F. Wang, "Global stability of a general class of discrete-time recurrent neural networks," Neural Process. Lett., vol. 22, no. 1, pp. 33-47, Aug. 2005.
23. Z. G. Zeng and J. Wang, "Multiperiodicity and exponential attractivity evoked by periodic external inputs in delayed cellular neural networks," Neural Comput., vol. 18, no. 4, pp. 848-870, Apr. 2006.
24. Z. G. Zeng and J. Wang, "Complete stability of cellular neural networks with time-varying delays," IEEE Trans. Circuits Syst. I, Reg. Papers vol. 53, no. 4, pp. 944-955, Apr. 2006.