Nlç theory: checking and imposing stability of recurrent neural networks for nonlinear modeling

IEEE Transactions on Signal Processing

Volumn 45, Issue 11, 1997, Pages 2682-2691

  Suykens, Johan A K ^a   Vandewalle, Joos ^a   De Moor, Bart L R ^a  

^a Katholieke Universiteit Leuven   (Belgium)

Author keywords

Dynamic backpropagation; Global asymptotic stability; LMI's; Multilayer recurrent neural networks; NL? systems

Indexed keywords

ASYMPTOTIC STABILITY; BACKPROPAGATION;

LINEAR MATRIX INEQUALITY (LMI); NARENDRA'S DYNAMIC BACKPROPAGATION; RECURRENT NEURAL NETWORKS;

NEURAL NETWORKS;

EID: 0031272071     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/78.650094     Document Type: Article

References (28)

1. S. Billings, H. Jamaluddin, and S. Chen, "Properties of neural networks with applications to modeling nonlinear dynamical systems," Int. J. Contr., vol. 55, no. 1, pp. 193-224, 1992.
2. S. Boyd and C. Barratt, Linear Controller Design, Limits of Performance. Englewood Cliffs, NJ: Prentice-Hall, 1991.
3. S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan, "Linear matrix inequalities in system and control theory," SIAM, vol. 15, 1994.
4. R. Fletcher, Practical Methods of Optimization, 2nd ed. New York: Wiley, 1987.
5. P. Gahinet and A. Nemirovskii, "General-purpose LMI solvers with benchmarks," in Proc. Conf. Decision Contr., 1993, pp. 3162-3165.
6. P. E. Gill, W. Murray, and M. H. Wright, Practical Optimization. London, U.K.: Academic, 1981.
7. E. Kaszkurewicz and A. Bhaya, "Robust stability and diagonal Liapunov functions," SIAM J. Matrix Anal. Applicat., vol. 14, no. 2, pp. 508-520, 1993.
8. D. Liu and A. N. Michel, "Asymptotic stability of discrete time systems with saturation nonlinearities with applications to digital filters," IEEE Trans. Circuits Syst.. vol. 39, pp. 798-807, Oct. 1992.
9. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. Neural Networks, vol. 1, pp. 4-27, Jan. 1990.
10. ___, "Gradient methods for the optimization of dynamical systems containing neural networks," IEEE Trans. Neural Networks, vol. 2, pp. 252-262, Mar. 1991.
11. Y. Nesterov and A. Nemirovskii, "Interior point polynomial algorithms in convex programming," SIAM, vol. 13, 1994.
12. M. L. Overton, "On minimizing the maximum eigenvalue of a symmetric matrix," SIAM J. Matrix Anal. Applicat., vol. 9, no. 2, pp. 256-268, 1988.
13. A. Packard and J. Doyle, "The complex structured singular value," Automatica, vol. 29, no. 1, pp. 71-109, 1993.
14. E. Polak and Y. Wardi, "Nondifferentiable optimization algorithm for designing control systems having singular value inequalities," Automatica, vol. 18, no. 3, pp. 267-283, 1982.
15. R. Reed, "Pruning algorithms-A survey," IEEE Trans. Neural Networks, vol. 4, pp. 740-747, Sept. 1993.
16. P. Regalia, Adaptive IIR Filtering in Signal Processing and Control. New York: Marcel Dekker, 1995.
17. J. Shynk, "Adaptive IIR filtering," IEEE Acoust., Speech, Signal Processing Mag., pp. 4-21, 1989.
18. J. Sjöberg et al., "Nonlinear black-box modeling in system identification: A unified overview," Automatica, vol. 31, no. 12, pp. 1691-1724, 1995.
19. J. A. K. Suykens, B. De Moor, and J. Vandewalle, "Nonlinear system identification using neural state space models, applicable to robust control design," Int. J. Contr., vol. 62, no. 1, pp. 129-152, 1995.
20. J. A. K. Suykens, J. P. L. Vandewalle, and B. L. R. De Moor, Artificial Neural Networks for Modeling and Control of Nonlinear Systems. Boston: Kluwer, 1995.
21. J. A. K. Suykens and J. Vandewalle, "Learning a simple recurrent neural state space model to behave like Chua's double scroll," IEEE Trans. Circuits Syst., vol. 42, pp. 499-502, Aug. 1995.
22. -, "Control of a recurrent neural network emulator for the double scroll," IEEE Trans. Circuits Syst., vol. 43, pp. 511-514, June 1996.
23. -, "Discrete time interconnected cellular neural networks within NL? theory," Int. J. Circuit Theory Applicat. (Special Issue on Cellular Neural Networks), vol. 24, pp. 25-36, 1996.
24. J. A. K. Suykens, B. L. R. De Moor, and J. Vandewalle, "NL? theory: A neural control framework with global asymptotic stability criteria," Neural Networks, vol. 10, no. 4, pp. 615-637, 1997.
25. The Math Works Inc., "Optimization toolbox (version 4.1), user's guide;" also "Robust control toolbox (version 4.1), user's guide," Mattab, 1996.
26. A. C. Tsoi and A. D. Back, "Locally recurrent globally feedforward networks: A critical review of architectures," IEEE Trans. Neural Networks, vol. 5, pp. 229-239, Apr. 1994.
27. L. Vandenberghe and S. Boyd, "A primal-dual potential reduction method for problems involving matrix inequalities," Math. Programming, vol. 69, pp. 205-236, 1995.
28. M. Vidyasagar, Nonlinear Systems Analysis. Englewood Cliffs, NJ: Prentice-Hall, 1993.