Multistability of discrete-time recurrent neural networks with unsaturating piecewise linear activation functions

IEEE Transactions on Neural Networks

Volumn 15, Issue 2, 2004, Pages 329-336

  Yi, Zhang ^a   Tan, Kok Kiong ^b  

^a UEST of China ^*  (China)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Complete stability; Discrete time; Global attractivity; Multistability; Nondivergence; Recurrent neural networks; Unsaturating piecewise linear activation functions

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; DISCRETE TIME CONTROL SYSTEMS; MATHEMATICAL MODELS; PIECEWISE LINEAR TECHNIQUES;

COMPLETE STABILITY; DISCRETE TIME;

RECURRENT NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; STATISTICAL MODEL; TIME;

LINEAR MODELS; NEURAL NETWORKS (COMPUTER); TIME FACTORS;

EID: 2442432590     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2004.824272     Document Type: Article

References (18)

1. L. O. Chua and L. Yang, "Cellular neural networks: Theory," IEEE Trans. Circuits Syst., vol. 35, pp. 1257-1272, 1988.
2. M. A. Cohen and S. Grossberg, "Absolute stability of global pattern formation and parallel memory storage by competitive neural networks," IEEE Trans. Syst., Man, Cybern., vol. 13, pp. 815-826, 1983.
3. R. Douglas, C. Koch, M. Mahowald, K. Martin, and H. Suarez, "Recurrent excitation in neocortical circuits," Science, vol. 269, pp. 981-985, 1995.
4. R. L. T. Hahnloser, "On the piecewise analysis of linear threshold neural networks," Neural Networks, vol. 11, pp. 691-697, 1998.
5. R. Hahnloser, R. Sarpeshkar, M. A. Mahowald, R. J. Douglas, and H. S. Seung, "Digital selection and analogue amplification coexist in a cortexinsired silicon circuits," Nature, vol. 405, pp. 947-951, 2000.
6. J. J. Hopfield, "Neurons with graded response have collective computational properties like those of two-state neurons," in Proc. Nat. Acad. Sci., vol. 81, 1984, pp. 3088-3092.
7. S. Hui and S. H. Zak, "Dynamical analysis of the brain-state-in-a-box (BSB) neural models," IEEE Trans. Neural Networks, vol. 3, pp. 86-94, Jan. 1992.
8. R. Perfetti, "A synthesis procedure for brain-state-in-a-box neural networks," IEEE Trans. Neural Networks, vol. 6, pp. 1071-1080, 1995.
9. A. N. Michel, J. Si, and G. Yen, "Analysis and synthesis of a class of discrete-time neural networks described on hypercubes," IEEE Trans. Neural Networks, vol. 2, pp. 32-46, Jan. 1991.
10. L. Jin, P. N. Nikiforuk, and M. M. Gupta, "Absolute stability conditions for discrete-time recurrent neural networks," IEEE Trans. Neural Networks, vol. 5, pp. 954-964, Nov. 1994.
11. M. J. Pérez-Ilzarbe, "Convergence analysis of a discrete-time recurrent neural networks to perform quadratic real optimization with bound constraints," IEEE Trans. Neural Networks, vol. 9, pp. 1344-1351, Nov. 1998.
12. J. Si and A. N. Michel, "Analysis and synthesis of a class of discrete-time neural networks with multilevel threshold neurons," IEEE Trans. Neural Networks, vol. 6, pp. 105-116, Jan. 1995.
13. H. Wersing, W. J. Beyn, and H. Ritter, "Dynamical stability conditions for recurrent neural networks with unsaturating piecewise linear transfer functions," Neural Comput., vol. 13, pp. 1811-1825, 2001.
14. C. W. Wu and L. O. Chua, "A more rigorous proof of complete stability of cellular neural networks," IEEE Trans. Circuits Systems I, vol. 44, pp. 370-371, Apr. 1997.
15. Z. Yi, P. A. Heng, and A. W. C. Fu, "Estimate of exponential convergence rate and exponential stability for neural networks," IEEE Trans. Neural Networks, vol. 10, pp. 1487-1493, Nov. 1999.
16. Z. Yi, P. A. Heng and P. F. Fung, "Winner-take-all discrete recurrent neural networks," IEEE Trans. Circuits Syst. II, vol. 47, pp. 1584-1589, Dec. 2000.
17. Z. Yi, K. K. Tan, and T. H. Lee, "Multistability analysis for recurrent neural networks with unsaturating piecewise linear transfer functions," Neural Comput., vol. 15, pp. 639-662, March 2003.
18. Z. Yi and K. K. Tan, "Dynamical stability conditions for lotka-volterra recurrent neural networks with delays," Phys. Rev. E, vol. 66, July 2002.