Permitted and forbidden sets in discrete-time linear threshold recurrent neural networks

IEEE Transactions on Neural Networks

Volumn 20, Issue 6, 2009, Pages 952-963

  Yi, Zhang ^a   Zhang, Lei ^b   Yu, Jiali ^c   Tan, Kok Kiong ^d  

^a SICHUAN UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^d NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Complete convergence; Discrete time recurrent neural networks; Forbidden set; Linear threshold; Multiattractivity; Permitted set

Indexed keywords

COMPLETE CONVERGENCE; DISCRETE-TIME RECURRENT NEURAL NETWORKS; FORBIDDEN SET; LINEAR THRESHOLD; MULTIATTRACTIVITY; PERMITTED SET;

CONTINUOUS TIME SYSTEMS; SET THEORY; TRANSFER FUNCTIONS;

RECURRENT NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; FEEDBACK SYSTEM; METHODOLOGY; STATISTICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; FEEDBACK; LINEAR MODELS; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 67649365832     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2009.2014373     Document Type: Article

References (28)

1. R. Hahnloser, R. Sarpeshkar, M. Mahowald, R. Douglas, and H. S. Seung, "Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit," Nature, vol. 405, pp. 947-951, 2000.
2. R. H. Hahnloser, H. S. Seung, and J. J. Slotine, "Permitted and forbidden sets in symmetric threshold-linear networks," Neural Comput., vol. 15, pp. 621-638, 2003.
3. X. Xie, R. H. Hahnloser, and H. S. Seung, "Selectively grouping neurons in recurrent networks of lateral inhibition," Neural Comput., vol. 14, pp. 2627-2646, 2002.
4. R. Dougleas, C. Koch, M. Mahowald, K. Matin, and H. Suarez, "Recurrent excitation in neocortical circuits," Science, vol. 269, pp. 981-985, 1995.
5. R. Ben-Yishai, R. L. Bar-Or, and H. Sompolinsky, "Theory of orientation tuning in visual cortex," Proc. Nat. Acad. Sci., vol. 92, pp. 3844-3848, 1995.
6. B. Blumenfeld, D. Bibitchkov, and M. Tsodyks, "Neural network model of the primary visual cortex: From functional architecture to lateral connectivity and back," J. Comput. Neurosci., vol. 20, pp. 219-241, 2006.
7. H. J. Tang, K. C. Tan, and E. J. Teoh, "Dynamics analysis and analog associative memory of networks with LT neurons," IEEE Trans. Neural Netw., vol. 17, no. 2, pp. 409-418, Mar. 2006.
8. R. Hahnloser, "On the piecewise analysis of linear threshold neural networks,"Neural Netw., vol. 11, pp. 691-697, 1998.
9. H. Wersing, J. J. Steil, and H. Ritter, "A competitive layer model for feature binding and sensory segmentation," Neural Comput., vol. 13, pp. 357-387, 2001.
10. H. Wersing, W. J. Beyn, and H. Ritter, "Dynamical stability conditions for recurrent neural networks with unsaturating piecewise linear transfer functions," Neural Comput., vol. 13, pp. 1811-1825, 2001.
11. Z. Yi, K. K. Tan, and T. H. Lee, "Multistability analysis for recurrent neural networks with unsaturating piecewise linear transfer functions," Neural Comput., vol. 15, pp. 639-662, 2003.
12. Z. Yi and K. K. Tan, "Multistability of discrete-time recurrent neural networks with unsaturating piecewise linear activation functions," IEEE Trans. Neural Netw., vol. 15, no. 2, pp. 329-336, Mar. 2004.
13. H. J. Tang, K. C. Tan, and Z. Yi, Neural Networks: Computational Models and Applications. Heidelberg, Germany: Springer-Verlag, 2007.
14. Z. Yi and K. K. Tan, Convergence Analysis of Recurrent Neural Networks. Norwell, MA: Kluwer, 2004.
15. Z. Yi and K. K. Tan, "Dynamical stability conditions for Lotka-Volterra recurrent neural networks with delays," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 66, Jul. 2002, 011910.
16. Z. G. Zeng and J. Wang, "Complete stability of cellular neural networks with time-varying delays," IEEE Trans. Circuits Syst. I, Reg. Papers vol. 53, no. 4, pp. 944-955, Apr. 2006.
17. Z. G. Zeng and J. Wang, "Multiperiodicity and exponential attractivity evoked by periodic external inputs in delayed cellular neural networks," Neural Comput., vol. 18, pp. 848-870, 2006.
18. Z. G. Zeng and J. Wang, "Multiperiodicity of discret-time delayed neural networks evoked by periodic external inputs," IEEE Trans. Neural Netw., vol. 17, no. 5, pp. 1141-1151, Sep. 2006.
19. L. Zhang, Z. Yi, and J. Yu, "Multiperiodicity and attractivity of delayed recurrent neural networks with unsaturating piecewise linear transfer functions," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 158-167, Jan. 2008.
20. J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities," Proc. Nat. Acad. Sci. USA, vol. 79, pp. 2554-2558, 1982.
21. S. Hui and S. H. Zak, "Dynamical analysis of the brain-state-in-a-box (BSB) neural models," IEEE Trans. Neural Netw., vol. 3, no. 1, pp. 86-94, Jan. 1992.
22. L. Jin, P. N. Nikiforuk, and M. M. Gupta, "Absolute stability conditions for discrete-time recurrent neural networks," IEEE Trans. Neural Netw., vol. 5, no. 6, pp. 954-964, Nov. 1994.
23. A. N. Michel, J. Si, and G. Yen, "Analysis and synthesis of a class of discrete-time neural networks described on hypercubes," IEEE Trans. Neural Netw., vol. 2, no. 1, pp. 32-46, Jan. 1991.
24. M. J. Pérez-Ilzarbe, "Convergence analysis of a discrete-time recurrent neural networks to perform quadratic real optimization with bound constraints," IEEE Trans. Neural Networks, vol. 9, no. 6, pp. 1344-1351, 1998.
25. R. Perfetti, "A synthesis procedure for brain-state-in-a-box neural networks," IEEE Trans. Neural Netw., vol. 6, no. 5, pp. 1071-1080, Sep. 1995.
26. J. Si and A. N. Michel, "Analysis and synthesis of a class of discrete-time neural networks with multilevel threshold neurons," IEEE Trans. Neural Netw., vol. 6, no. 1, pp. 105-116, Jan. 1995.
27. S. Hu and J. Wang, "Global stability of a class of continuous-time recurrent neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 49, no. 9, pp. 1334-1347, Sep. 2002.
28. R. Horn and C. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985.