Dynamical Behaviors of Multiple Equilibria in Competitive Neural Networks with Discontinuous Nonmonotonic Piecewise Linear Activation Functions

IEEE Transactions on Cybernetics

Volumn 46, Issue 3, 2016, Pages 679-693

  Nie, Xiaobing ^a,b   Zheng, Wei Xing ^b  

^a SOUTHEAST UNIVERSITY   (China)

^b UNIVERSITY OF WESTERN SYDNEY   (Australia)

Author keywords

Competitive neural networks; discontinuous nonmonotonic piecewise linear activation functions; instability; multistability

Indexed keywords

DYNAMICS; FIXED POINT ARITHMETIC; PIECEWISE LINEAR TECHNIQUES;

ACTIVATION FUNCTIONS; COMPETITIVE NEURAL NETWORK; DISCONTINUOUS ACTIVATION FUNCTIONS; DYNAMICAL BEHAVIORS; FIXED POINT THEOREMS; MULTIPLE EQUILIBRIUM; PIECEWISE LINEAR ACTIVATIONS; UNSATURATED REGION;

CHEMICAL ACTIVATION;

EID: 84926030677     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2015.2413212     Document Type: Article

References (37)

1. M. A. Cohen and S. Grossberg, "Absolute stability of global pattern formation and parallel memory storage by competitive neural networks," IEEE Trans. Syst., Man, Cybern., vol. SMC-13, no. 5, pp. 815-825, Sep./Oct. 1983.
2. V. Murino, "Structured neural networks for pattern recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 28, no. 4, pp. 553-561, Aug. 1998.
3. K. Lin and C. Shih, "Multiple almost periodic solutions in nonautonomous delayed neural networks," Neural Comput., vol. 19, no. 12, pp. 3392-3420, Dec. 2007.
4. L. L. Wang, W. L. Lu, and T. P. Chen, "Multistability and new attraction basins of almost-periodic solutions of delayed neural networks," IEEE Trans. Neural Netw., vol. 20, no. 10, pp. 1581-1593, Oct. 2009.
5. E. Kaslik and S. Sivasundaram, "Impulsive hybrid discrete-time Hopfield neural networks with delays and multistability analysis," Neural Netw., vol. 24, no. 4, pp. 370-377, May 2011.
6. Z. K. Huang, Q. K. Song, and C. H. Feng, "Multistability in networks with self-excitation and high-order synaptic connectivity," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 57, no. 8, pp. 2144-2155, Aug. 2010.
7. X. B. Nie and J. D. Cao, "Multistability of second-order competitive neural networks with nondecreasing saturated activation functions," IEEE Trans. Neural Netw., vol. 22, no. 11, pp. 1694-1708, Nov. 2011.
8. M. D. Marco, M. Forti, M. Grazzini, and L. Pancioni, "Limit set dichotomy and multistability for a class of cooperative neural networks with delays," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 9, pp. 1473-1485, Sep. 2012.
9. L. L. Wang, W. L. Lu, and T. P. Chen, "Coexistence and local stability of multiple equilibria in neural networks with piecewise linear nondecreasing activation functions," Neural Netw., vol. 23, no. 2, pp. 189-200, Mar. 2010.
10. X. B. Nie, J. D. Cao, and S. M. Fei, "Multistability and instability of delayed competitive neural networks with nondecreasing piecewise linear activation functions," Neurocomputing, vol. 119, pp. 281-291, Nov. 2013.
11. Z. G. Zeng and W. X. Zheng, "Multistability of neural networks with time-varying delays and concave-convex characteristics," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 2, pp. 293-305, Feb. 2012.
12. Z. G. Zeng, T. W. Huang, and W. X. Zheng, "Multistability of recurrent neural networks with time-varying delays and the piecewise linear activation function," IEEE Trans. Neural Netw., vol. 21, no. 8, pp. 1371-1377, Aug. 2010.
13. L. Zhang, Z. Yi, and J. Li, "Multiperiodicity and attractivity of delayed recurrent neural networks with unsaturating piecewise linear transfer functions," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 158-167, Jan. 2008.
14. L. Zhang, Z. Yi, S. L. Zhang, and P. A. Heng, "Activity invariant sets and exponentially stable attractors of linear threshold discrete-time recurrent neural networks," IEEE Trans. Autom. Control, vol. 54, no. 6, pp. 1341-1347, Jun. 2009.
15. Z. K. Huang, Y. N. Raffoul, and C. Y. Cheng, "Scale-limited activating sets and multiperiodicity for threshold networks on time scales," IEEE Trans. Cybern., vol. 44, no. 4, pp. 488-499, Apr. 2014.
16. Y. Chen and W. X. Zheng, "Stability analysis of time-delay neural networks subject to stochastic perturbations," IEEE Trans. Cybern., vol. 43, no. 6, pp. 2122-2134, Dec. 2013.
17. Q. Ma, G. Feng, and S. Y. Xu, "Delay-dependent stability criteria for reaction-diffusion neural networks with time-varying delays," IEEE Trans. Cybern., vol. 43, no. 6, pp. 1913-1920, Dec. 2013.
18. G. Huang and J. D. Cao, "Delay-dependent multistability in recurrent neural networks," Neural Netw., vol. 23, no. 2, pp. 201-209, Mar. 2010.
19. Z. K. Huang, X. H. Wang, and C. H. Feng, "Multiperiodicity of periodically oscillated discrete-time neural networks with transient excitatory self-connections and sigmoidal nonlinearities," IEEE Trans. Neural Netw., vol. 21, no. 10, pp. 1643-1655, Oct. 2010.
20. L. L. Wang and T. P. Chen, "Multiple μ-stability of neural networks with unbounded time-varying delays," Neural Netw., vol. 53, pp. 109-118, May 2014.
21. L. L. Wang and T. P. Chen, "Multistability of neural networks with Mexican-hat-type activation functions," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 11, pp. 1816-1826, Nov. 2012.
22. Q. H. Zhang and A. Benveniste, "Wavelet networks," IEEE Trans. Neural Netw., vol. 3, no. 6, pp. 889-898, Nov. 1992.
23. Z. Zainuddin and O. Pauline, "Function approximation using artificial neural networks," Int. J. Syst. Appl. Eng. Develop., vol. 1, no. 4, pp. 173-178, 2007.
24. Z. Zainuddin and O. Pauline, "An effective and novel wavelet neural network approach in classifying type 2 diabetics," Neural Netw. World, vol. 22, no. 5, pp. 407-428, 2012.
25. M. Forti and P. Nistri, "Global convergence of neural networks with discontinuous neuron activations," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 50, no. 11, pp. 1421-1435, Nov. 2003.
26. J. J. Hopfield, "Neurons with graded response have collective computational properties like those of two-state neurons," Proc. Nat. Acad. Sci., vol. 81, no. 10, pp. 3088-3092, May 1984.
27. D. W. Tank and J. J. Hopfield, "Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit," IEEE Trans. Circuits Syst., vol. 33, no. 5, pp. 533-541, May 1986.
28. M. P. Kennedy and L. O. Chua, "Neural networks for nonlinear programming," IEEE Trans. Circuits Syst., vol. 35, no. 5, pp. 554-562, May 1988.
29. M. Forti, P. Nistri, and D. Papini, "Global exponential stability and global convergence in finite time of delayed neural networks with infinite gain," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1449-1463, Nov. 2005.
30. G. Huang and J. D. Cao, "Multistability of neural networks with discontinuous activation function," Commun. Nonlin. Sci. Numer. Simul., vol. 13, no. 10, pp. 2279-2289, Dec. 2008.
31. G. Bao and Z. G. Zeng, "Analysis and design of associative memories based on recurrent neural network with discontinuous activation functions," Neurocomputing, vol. 77, no. 1, pp. 101-107, Feb. 2012.
32. Y. J. Huang, H. G. Zhang, and Z. S. Wang, "Dynamical stability analysis of multiple equilibrium points in time-varying delayed recurrent neural networks with discontinuous activation functions," Neurocomputing, vol. 91, pp. 21-28, Aug. 2012.
33. Y. J. Huang, H. G. Zhang, and Z. S. Wang, "Multistability and multiperiodicity of delayed bidirectional associative memory neural networks with discontinuous activation functions," Appl. Math. Comput., vol. 219, no. 3, pp. 899-910, Oct. 2012.
34. A. Meyer-Baese, F. Ohl, and H. Scheich, "Singular perturbation analysis of competitive neural networks with different time scales," Neural Comput., vol. 8, no. 8, pp. 1731-1742, Nov. 1996.
35. A. Meyer-Baese, S. S. Pilyugin, and Y. Chen, "Global exponential stability of competitive neural networks with different time scales," IEEE Trans. Neural Netw., vol. 14, no. 3, pp. 716-719, May 2003.
36. A. Meyer-Baese and V. Thummler, "Local and global stability analysis of an unsupervised competitive neural network," IEEE Trans. Neural Netw., vol. 19, no. 2, pp. 346-351, Feb. 2008.
37. W. T. Tong, "Distribution of eigenvalues of a class of matrices," Acta. Math. Sinica, vol. 20, no. 4, pp. 272-275, 1977.