Discontinuous neural networks for finite-time solution of time-dependent linear equations

IEEE Transactions on Cybernetics

Volumn 46, Issue 10, 2015, Pages 2509-2520

  Di Marco, Mauro ^a   Forti, Mauro ^a   Nistri, Paolo ^a   Pancioni, Luca ^a  

^a UNIVERSITY OF SIENA   (Italy)

Author keywords

Discontinuous neural networks; Finite time convergence; Subdifferential; Time dependent (TD) linear equations

Indexed keywords

CONTROL NONLINEARITIES; DYNAMICAL SYSTEMS; FUNCTIONS; LINEAR EQUATIONS;

CONVERGENCE RESULTS; DISCONTINUOUS NONLINEARITIES; FINITE-TIME CONVERGENCE; INTERCONNECTION MATRICES; NON-SMOOTH ANALYSIS; SMALL PERTURBATIONS; SUBDIFFERENTIALS; TIME DEPENDENT;

NEURAL NETWORKS;

EID: 84943179406     PISSN: 21682267     EISSN: 21682275     Source Type: Journal    
DOI: 10.1109/TCYB.2015.2479118     Document Type: Article

References (51)

1. M. S. Bazaraa, H. D. Sherali, and C. M. Shetty, Solutions Manual to Accompany Nonlinear Programming: Theory and Algorithms. Hoboken, NJ, USA: Wiley, 2013.
2. S. Huffel and J. Vandewalle, "Analysis and properties of the generalized total least squares problem AX ≈ B when some or all columns in A are subject to error", SIAM J. Matrix Anal. Appl., vol. 10, no. 3, pp. 294-315, 1989.
3. S.-Y. Kung, "VLSI array processors", IEEE ASSP Mag., vol. 2, no. 3, pp. 4-22, Jul. 1985.
4. R. J. Steriti and M. A. Fiddy, "Regularized image reconstruction using SVD and a neural network method for matrix inversion", IEEE Trans. Signal Process., vol. 41, no. 10, pp. 3074-3077, Oct. 1993.
5. T. Sarkar, K. Siarkiewicz, and R. Stratton, "Survey of numerical methods for solution of large systems of linear equations for electromagnetic field problems", IEEE Trans. Antennas Propag., vol. 29, no. 6, pp. 847-856, Nov. 1981.
6. R. H. Sturges, "Analog matrix inversion", IEEE J. Robot. Autom., vol. 4, no. 2, pp. 157-162, Apr. 1988.
7. A. Cichocki and R. Unbehauen, "Neural networks for solving systems of linear equations and related problems", IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 39, no. 2, pp. 124-138, Feb. 1992.
8. A. Cichocki and R. Unbehauen, "Neural networks for solving systems of linear equations. II. Minimax and least absolute value problems", IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 39, no. 9, pp. 619-633, Sep. 1992.
9. A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing. Chichester, U. K.: Wiley, 1993.
10. J. Wang, "Recurrent neural networks for solving linear matrix equations", Comput. Math. Appl., vol. 26, no. 9, pp. 23-34, Nov. 1993.
11. L. V. Ferreira, E. Kaszkurewicz, and A. Bhaya, "Solving systems of linear equations via gradient systems with discontinuous righthand sides: Application to LS-SVM", IEEE Trans. Neural Netw., vol. 16, no. 2, pp. 501-505, Mar. 2005.
12. L. Hsu, E. Kaszkurewicz, and A. Bhaya, "Matrix-theoretic conditions for the realizability of sliding manifolds", Syst. Control Lett., vol. 40, no. 3, pp. 145-152, Jul. 2000.
13. Z. Zeng, X. Zhou, and B. Zhang, "A neural-network approach solving symmetric linear system", J. Inf. Comput. Sci., vol. 9, no. 8, pp. 2305-2311, 2012.
14. Y. Zhang and S. S. Ge, "Design and analysis of a general recurrent neural network model for time-varying matrix inversion", IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1477-1490, Nov. 2005.
15. J. Wang, "Recurrent neural networks for computing pseudoinverses of rank-deficient matrices", SIAM J. Sci. Comput., vol. 18, no. 5, pp. 1479-1493, 1997.
16. Y. Zhang, D. Jiang, and J. Wang, "A recurrent neural network for solving Sylvester equation with time-varying coefficients", IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1053-1063, Sep. 2002.
17. K. Chen, "Recurrent implicit dynamics for online matrix inversion", Appl. Math. Comput., vol. 219, no. 20, pp. 10218-10224, Jun. 2013.
18. S. Li and Y. Li, "Nonlinearly activated neural network for solving timevarying complex Sylvester equation", IEEE Trans. Cybern., vol. 44, no. 8, pp. 1397-1407, Aug. 2014.
19. Z. Wang and B. S. Peterson, "Constrained least absolute deviation neural networks", IEEE Trans. Neural Netw., vol. 19, no. 2, pp. 273-283, Feb. 2008.
20. H.-N. Lee and G. J. Pottie, "Fast adaptive equalization/diversity combining for time-varying dispersive channels", IEEE Trans. Commun., vol. 46, no. 9, pp. 1146-1162, Sep. 1998.
21. L. Ma, K. Dickson, J. McAllister, and J. McCanny, "QR decompositionbased matrix inversion for high performance embedded MIMO receivers", IEEE Trans. Signal Process., vol. 59, no. 4, pp. 1858-1867, Apr. 2011.
22. S. Teniou, M. Meribout, and K. Belarbi, "Real-time reconstruction of moving objects in an electrical capacitance tomography system using inter-frame correlation", IEEE Sensors J., vol. 12, no. 7, pp. 2517-2525, Jul. 2012.
23. Y. Zhang, K. Chen, and H.-Z. Tan, "Performance analysis of gradient neural network exploited for online time-varying matrix inversion", IEEE Trans. Autom. Control, vol. 54, no. 8, pp. 1940-1945, Aug. 2009.
24. M. Forti, P. Nistri, and M. Quincampoix, "Generalized neural network for nonsmooth nonlinear programming problems", IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 9, pp. 1741-1754, Sep. 2004.
25. Q. Liu and J. Wang, "Finite-time convergent recurrent neural network with a hard-limiting activation function for constrained optimization with piecewise-linear objective functions", IEEE Trans. Neural Netw., vol. 22, no. 4, pp. 601-613, Apr. 2011.
26. W. Bian and X. Chen, "Smoothing neural network for constrained non-Lipschitz optimization with applications", IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 399-411, Mar. 2012.
27. Q. Liu and J. Wang, "A one-layer recurrent neural network for constrained nonsmooth optimization", IEEE Trans. Syst. Man, Cybern. B, Cybern., vol. 41, no. 5, pp. 1323-1333, Oct. 2011.
28. W. Bian and X. Xue, "Subgradient-based neural networks for nonsmooth nonconvex optimization problems", IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 1024-1038, Jun. 2009.
29. M. Forti and P. Nistri, "Global convergence of neural networks with discontinuous neuron activations", IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 50, no. 11, pp. 1421-1435, Nov. 2003.
30. W. Lu and T. Chen, "New approach to synchronization analysis of linearly coupled ordinary differential systems", Phys. D, Nonlin. Phenom., vol. 213, no. 2, pp. 214-230, Jan. 2006.
31. D. Wang and L. Huang, "Periodicity and global exponential stability of generalized Cohen-Grossberg neural networks with discontinuous activations and mixed delays", Neural Netw., vol. 51, pp. 80-95, Mar. 2014.
32. G. Bao and Z. Zeng, "Analysis and design of associative memories based on recurrent neural network with discontinuous activation functions", Neurocomputing, vol. 77, no. 1, pp. 101-107, 2012.
33. Y. Huang, H. Zhang, and Z. Wang, "Dynamical stability analysis of multiple equilibrium points in time-varying delayed recurrent neural networks with discontinuous activation functions", Neurocomputing, vol. 91, pp. 21-28, Aug. 2012.
34. X. Hu and J. Wang, "Design of general projection neural networks for solving monotone linear variational inequalities and linear and quadratic optimization problems", IEEE Trans. Syst. Man, Cybern. B, Cybern., vol. 37, no. 5, pp. 1414-1421, Oct. 2007.
35. X. Liu and J. Cao, "Robust state estimation for neural networks with discontinuous activations", IEEE Trans. Syst. Man, Cybern. B, Cybern., vol. 40, no. 6, pp. 1425-1437, Dec. 2010.
36. Y. Wang and L. Huang, "Global stability analysis of competitive neural networks with mixed time-varying delays and discontinuous neuron activations", Neurocomputing, vol. 152, pp. 85-96, Mar. 2015.
37. Z. Cai, L. Huang, Z. Guo, L. Zhang, and X. Wan, "Periodic synchronization control of discontinuous delayed networks by using extended Filippov-framework", Neural Netw., vol. 68, pp. 96-110, Aug. 2015.
38. X. Nie and W. X. Zheng, "Dynamical behaviors of multiple equilibria in competitive neural networks with discontinuous nonmonotonic piecewise linear activation functions", IEEE Trans. Cybern., Doi: 10.1109/TCYB.2015.2413212.
39. A.-M. Zou, K. D. Kumar, Z.-G. Hou, and X. Liu, "Finite-time attitude tracking control for spacecraft using terminal sliding mode and Chebyshev neural network", IEEE Trans. Syst. Man, Cybern. B, Cybern., vol. 41, no. 4, pp. 950-963, Aug. 2011.
40. M. Di Marco, M. Forti, M. Grazzini, P. Nistri, and L. Pancioni, "Lyapunov method and convergence of the full-range model of CNNs", IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 55, no. 11, pp. 3528-3541, Dec. 2008.
41. J. P. Aubin and A. Cellina, Differential Inclusions. Set-Valued Maps and Viability Theory. Berlin, Germany: Springer, 1984.
42. J.-B. Hiriart-Urruty and C. Lemaréchal, Convex Analysis and Minimization Algorithms I: Part 1: Fundamentals. Berlin, Germany: Springer, 1996.
43. M. P. Kennedy and L. O. Chua, "Neural networks for nonlinear programming", IEEE Trans. Circuits Syst., vol. 35, no. 5, pp. 554-562, May 1988.
44. O. Faydasicok and S. Arik, "A new upper bound for the norm of interval matrices with application to robust stability analysis of delayed neural networks", Neural Netw., vol. 44, pp. 64-71, Aug. 2013.
45. X. Liao and K.-W. Wong, "Robust stability of interval bidirectional associative memory neural network with time delays", IEEE Trans. Syst. Man, Cybern. B, Cybern., vol. 34, no. 2, pp. 1142-1154, Apr. 2004.
46. M. Di Marco, M. Grazzini, and L. Pancioni, "Global robust stability criteria for interval delayed full-range cellular neural networks", IEEE Trans. Neural Netw., vol. 22, no. 4, pp. 666-671, Apr. 2011.
47. K. Wang and A. N. Michel, "Robustness and perturbation analysis of a class of nonlinear systems with applications to neural networks", IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 41, no. 1, pp. 24-32, Jan. 1994.
48. M. Di Marco, M. Forti, and M. Grazzini, "Robustness of convergence in finite time for linear programming neural networks", Int. J. Circuit Theory Appl., vol. 34, no. 3, pp. 307-316, May/Jun. 2006.
49. M. Di Marco, M. Forti, and A. Tesi, "Bifurcations and oscillatory behavior in a class of competitive cellular neural networks", Int. J. Bifurcat. Chaos, vol. 10, no. 6, pp. 1267-1293, Jun. 2000.
50. A. Bhaya and E. Kaszkurewicz, Control Perspectives on Numerical Algorithms and Matrix Problems, vol. 10. Philadelphia, PA, USA: SIAM, 2006.
51. M. Di Marco, M. Forti, P. Nistri, and L. Pancioni, "Nonsmooth neural network for convex time-dependent constraint satisfaction problems", IEEE Trans. Neural Netw. Learn. Syst., Doi: 10.1109/TNNLS.2015.2404773.