Selectable and unselectable sets of neurons in recurrent neural networks with saturated piecewise linear transfer function

IEEE Transactions on Neural Networks

Volumn 22, Issue 7, 2011, Pages 1021-1031

  Zhang, Lei ^a   Yi, Zhang ^a  

^a SICHUAN UNIVERSITY   (China)

Author keywords

Group selection; recurrent neural networks; saturated piecewise linear transfer functions; selectable sets; unselectable sets

Indexed keywords

DYNAMICAL PROPERTIES; EXTERNAL INPUT; GROUP SELECTION; PIECEWISE LINEAR; SELECTABLE SETS; STABLE EQUILIBRIUM POINTS; SUFFICIENT CONDITIONS; UNSELECTABLE SETS;

PIECEWISE LINEAR TECHNIQUES; TRANSFER FUNCTIONS;

RECURRENT NEURAL NETWORKS;

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; HUMAN; NERVE CELL; NERVE CELL INHIBITION; PHYSIOLOGY; STATISTICAL MODEL;

ANIMALS; HUMANS; LINEAR MODELS; MODELS, NEUROLOGICAL; NEURAL INHIBITION; NEURAL NETWORKS (COMPUTER); NEURONS;

EID: 79960112962     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2132762     Document Type: Article

References (34)

1. L. O. Chua and L. Yang, "Cellular neural networks: Applications," IEEE Trans. Circuits Syst., vol. 35, no. 10, pp. 1273-1290, Oct. 1988.
2. J. L. Elman, "Finding structure in time," Cognit. Sci., vol. 14, no. 2, pp. 179-211, Apr.-Jun. 1990.
3. J. J. Hopfield, "Neurons with graded response have collective computational properties like those of two-state neurons," Proc. Nat. Acad. Sci., vol. 81, no. 10, pp. 3088-3092, May 1984. (Pubitemid 14109528)
4. W.-H. Chen and W. X. Zheng, "A new method for complete stability analysis of cellular neural networks with time delay," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1126-1139, Jul. 2010.
5. M. Di Marco, M. Forti, and A. Tesi, "Complex dynamics in nearly symmetric three-cell cellular neural networks," Int. J. Bifur. Chaos, vol. 12, no. 6, pp. 1357-1362, 2002. (Pubitemid 34917165)
6. M. Forti, "Some extensions of a new method to analyze complete stability of neural networks," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1230-1238, Sep. 2002.
7. Z. G. Zeng and J. Wang, "Complete stability of cellular neural networks with time-varying delays," IEEE Trans. Circuits Syst. I, vol. 53, no. 4, pp. 944-955, Apr. 2006.
8. Y. He, M. Wu, and J. She, "An improved global asymptotic stability criterion for delayed cellular neural networks," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 250-252, Jan. 2006. (Pubitemid 43263957)
9. Z. Wang and H. Zhang, "Global asymptotic stability of reactiondiffusion Cohen-Grossberg neural networks with continuously distributed delays," IEEE Trans. Neural Netw., vol. 21, no. 1, pp. 39-49, Jan. 2010.
10. Z. Yi, P. A. Heng, and K. S. Leung, "Convergence analysis of cellular neural networks with unbounded delay," IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., vol. 48, no. 6, pp. 680-687, Jun. 2001. (Pubitemid 32609772)
11. Z. Yi and K. K. Tan, Convergence Analysis of Recurrent Neural Networks. Norwell, MA: Kluwer, 2004.
12. H. Zhang and Z. Wang, "Global asymptotic stability of delayed cellular neural networks," IEEE Trans. Neural Netw., vol. 18, no. 3, pp. 947-950, May 2007. (Pubitemid 46773762)
13. Y. Zhao, H. Gao, J. Lam, and K. Chen, "Stability analysis of discretetime recurrent neural networks with stochastic delay," IEEE Trans. Neural Netw., vol. 20, no. 8, pp. 1330-1339, Aug. 2009.
14. H. Jiang, L. Zhang, and Z. Teng, "Existence and global exponential stability of almost periodic solution for cellular neural networks with variable coefficients and time-varying delays," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1340-1351, Nov. 2005. (Pubitemid 41709635)
15. Y. Liu, Z. You, and L. Cao, "On the almost periodic solution of cellular neural networks with distributed delays," IEEE Trans. Neural Netw., vol. 18, no. 1, pp. 295-300, Jan. 2007. (Pubitemid 46062935)
16. L. Wang, W. Lu, and T. Chen, "Multistability and new attraction basins of almost-periodic solutions of delayed neural networks," IEEE Trans. Neural Netw., vol. 20, no. 10, pp. 1581-1593, Oct. 2009.
17. Z. Yi, P. A. Heng, and P. Vadakkepat, "Absolute periodicity and absolute stability of delayed neural networks," IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., vol. 49, no. 2, pp. 256-261, Feb. 2002. (Pubitemid 34291479)
18. Z. G. Zeng and J. Wang, "Multiperiodicity of discrete-time delayed neural networks evoked by periodic external inputs," IEEE Trans. Neural Netw., vol. 17, no. 5, pp. 1141-1151, Sep. 2006. (Pubitemid 46445173)
19. L. Zhang, Z. Yi, and J. Yu, "Multiperiodicity and attractivity of delayed recurrent neural networks with unsaturating piecewise linear transfer functions," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 158-167, Jan. 2008. (Pubitemid 351279234)
20. R. H. R. Hahnloser, R. Sarpeshkar, M. A. Mahowald, R. J. Douglas, and H. S. Seung, "Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit," Nature, vol. 405, pp. 947-951, Jun. 2000. (Pubitemid 30435050)
21. R. H. Hahnloser, H. S. Seung, and J. J. Slotine, "Permitted and forbidden sets in symmetric threshold-linear networks," Neural Comput., vol. 15, no. 3, pp. 621-638, Mar. 2003. (Pubitemid 37049819)
22. Z. Yi, L. Zhang, J. Yu, and K. K. Tan, "Permitted and forbidden sets in discrete-time linear threshold recurrent neural networks," IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 952-963, Jun. 2009.
23. X. Xie, R. H. Hahnloser, and H. S. Seung, "Selectively grouping neurons in recurrent networks of lateral inhibition," Neural Comput., vol. 14, no. 11, pp. 2627-2646, Nov. 2002.
24. L. O. Chua and L. Yang, "Cellular neural networks: Theory," IEEE Trans. Circuits Syst., vol. 35, no. 10, pp. 1257-1272, Oct. 1988.
25. G. Grassi, "On discrete-time cellular neural networks for associative memories," IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., vol. 48, no. 1, pp. 107-111, Jan. 2001.
26. G. Grassi, "A new approach to design cellular neural networks for associative memories," IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., vol. 44, no. 9, pp. 835-838, Sep. 1997. (Pubitemid 127768857)
27. R. Fantacci, M. Forti, M. Marini, and L. Pancani, "Cellular neural network approach to a class of communication problems," IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., vol. 46, no. 12, pp. 1457-1467, Dec. 1999. (Pubitemid 30558662)
28. H. Yang and L.-B. Yang, "Application of fuzzy cellular neural networks to Euclidean distance transformation," IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., vol. 44, no. 3, pp. 242-246, Mar. 1997. (Pubitemid 127768818)
29. P. Julian, R. Dogaru, and L. O. Chua, "A piecewise-linear simplicial coupling cell for CNN gray-level image processing," IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., vol. 49, no. 7, pp. 904-913, Jul. 2002. (Pubitemid 34861838)
30. T. Sziranyi and J. Zerubia, "Markov random field image segmentation using cellular neural network," IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., vol. 44, no. 1, pp. 86-89, Jan. 1997.
31. A. Zarandy, L. Orzo, E. Grawes, and F.Werblin, "CNN-based models for color vision and visual illusions," IEEE Trans. Circuits Syst. I: Fundam. Theory Appl., vol. 46, no. 2, pp. 229-238, Feb. 1999.
32. J.-C. Yen, J.-I. Guo, and H.-C. Chen, "A new k-winners-take-all neural network and its array architecture," IEEE Trans. Neural Netw., vol. 9, no. 5, pp. 901-912, Sep. 1998. (Pubitemid 128743655)
33. R. Horn and C. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985, pp. 185-186.
34. Z. H. Mao and S. G. Massaqoi, "Dynamics of winner-take-all competition in recurrent neural networks with lateral inhibition," IEEE Trans. Neural Netw., vol. 18, no. 1, pp. 55-69, Jan. 2007