Training recurrent neurocontrollers for robustness with derivative-free Kalman filter

IEEE Transactions on Neural Networks

Volumn 17, Issue 6, 2006, Pages 1606-1616

  Prokhorov, Danil V ^a,b  

^a FORD MOTOR COMPANY   (United States)

^b TOYOTA TECHNICAL CENTER   (United States)

Author keywords

Derivative free Kalman filter; Neurocontroller; Recurrent neural network (RNN); Training for robustness

Indexed keywords

ALGORITHMS; CONTROL SYSTEMS; KALMAN FILTERING; MATHEMATICAL MODELS; PERTURBATION TECHNIQUES; ROBUSTNESS (CONTROL SYSTEMS); UNCERTAIN SYSTEMS;

DERIVATIVE-FREE KALMAN FILTER; NEUROCONTROLLER;

RECURRENT NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; INFORMATION RETRIEVAL; METHODOLOGY; SIGNAL PROCESSING; SYSTEMS THEORY;

ALGORITHMS; INFORMATION STORAGE AND RETRIEVAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED; SYSTEMS THEORY;

EID: 34547129948     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2006.880580     Document Type: Article

References (35)

1. M. Norgaard, N. K. Poulsen, and O. Ravn, "New developments in state estimation for nonlinear systems," Automatica, vol. 36, pp. 1627-1638, 2000.
2. L. A. Feldkamp, T. M. Feldkamp, and D. V. Prokhorov, "Neural network training with the nprKF," in Proc. Int. Joint Conf. Neural Netw., Washington, D.C., 2001, pp. 109-114.
3. L. A. Feldkamp, T. M. Feldkamp, and D. V. Prokhorov, "Recurrent neural network training by nprKF joint estimation," in Proc. Int. Joint Conf. Neural Netw., Hawaii, 2002, pp. 2086-2091.
4. D. V. Prokhorov, G. V. Puskorius, and L. A. Feldkamp, J. Kolen and S. Kremer, Eds., "Dynamical Neural Networks for Control," in A Field Guide to Dynamical Recurrent Networks. Piscataway, NJ: IEEE Press, 2001, pp. 257-289.
5. T. Hayakawa, W. Haddad, J. Bailey, and N. Hovakimyan, "Passivity-based neural network adaptive output feedback control for nonlinear nonnegative dynamical systems," IEEE Trans. Neural Netw., vol. 16, no. 2, pp. 387-398, Mar. 2005.
6. D. Wang and J. Huang, "Neural network-based adaptive dynamic surface control for a class of uncertain nonlinear systems in strict-feedback form," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 195-202, Jan. 2005.
7. D. White and D. Sofge, Eds., Handbook of Intelligent Control. New York: Van Nostrand, 1992.
8. K. S. Narendra, "Neural networks for control: Theory and practice," Proc. IEEE, vol. 84, no. 10, pp. 1385-1406, Oct. 1996.
9. T. Hrycej, Neurocontrol: Towards an Industrial Control Methodology. New York: Wiley, 1997.
10. M. Agarwal, "A systematic classification of neural-network-based control," IEEE Control Syst. Mag., vol. 17, no. 2, pp. 75-93, Apr. 1997.
11. O. Adetona, E. Garcia, and L. H. Keel, "A new method for control of discrete nonlinear dynamic systems using neural networks," IEEE Trans. Neural Netw., vol. 11, no. 1, pp. 102-112, Jan. 2000.
12. Q. Zhu and L. Guo, "Stable adaptive neurocontrol for nonlinear discrete-time systems," IEEE Trans. Neural Netw., vol. 15, no. 3, pp. 653-662, May 2004.
13. J. Suykens, J. Vandewalle, and B. De Moor, Artificial Neural Networks for Modeling and Control of Non-Linear Systems. Norwell, MA: Kluwer, 1996.
14. I. Arsie, C. Pianese, and M. Sorrentino, Nonlinear recurrent neural networks for air fuel ratio control in SI engines Soc. Automot. Eng. (SAE) Tech. Paper 2004-01-1364, 2004.
15. D. Mandic and J. Chambers, Recurrent Neural Networks for Prediction. New York: Wiley, 2001.
16. H.-G. Zimmermann, R. Neuneier, and R. Grothmann, A. Soofi and L. Cao, Eds., "Modeling of Dynamical Systems by Error Correction Neural Networks," in Modeling and Forecasting Financial Data: Techniques of Nonlinear Dynamics. Norwell, MA: Kluwer, 2002, pp. 237-263.
17. E. Wan and A. Nelson, "Dual Kalman Filtering Methods for Nonlinear Prediction, Estimation, and Smoothing," in Advances in Neural Information Processing Systems 9. Cambridge, MA: MIT Press, 1997.
18. E. N. Sanchez, A. Y. Alanis, and J. Rico, "Electric load demand prediction using neural networks trained by Kalman filtering," in Proc. Int. Joint Conf. Neural Netw., Budapest, Hungary, 2004, pp. 2771-2776.
19. J. A. Perez-Ortizand, J. Schmidhuber, F. A. Gers, and D. Eck, "Improving long-term online prediction with decoupled extended Kalman filters," in Proc. Int. Conf. Artif. Neural Netw. (ICANN), Berlin, Germany, 2002, pp. 1055-1060.
20. S. Younger, P. Conwell, and N. Cotter, "Fixed-weight on-line learning," IEEE Trans. Neural Netw., vol. 10, no. 2, pp. 272-283, Mar. 1999.
21. D. Prokhorov, L. Feldkamp, and I. Tyukin, "Adaptive behavior with fixed weights in RNN: Overview," in Proc. Int. Joint Conf. Neural Netw., Hawaii, 2002, pp. 2018-2022.
22. L. A. Feldkamp and G. V. Puskorius, "Training controllers for robustness: Multi-stream DEKF," in Proc. Int. Joint Conf. Neural Netw., Orlando, FL, 1994, pp. 2377-2382.
23. P. J. Werbos, "Backpropagation through time: What it does and how to do it," Proc. IEEE, vol. 78, no. 10, pp. 1550-1560, Oct. 1990.
24. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems containing neural networks," IEEE Trans. Neural Netw., vol. 1, no. 1, pp. 4-27, Jan. 1990.
25. K. S. Narendra, "Gradient methods for the optimization of dynamical systems containing neural networks," IEEE Trans. Neural Netw., vol. 2, no. 2, pp. 252-262, Mar. 1991.
26. D. Prokhorov, "Backpropagation through time and derivative adaptive critics: A common framework for comparison," in Learning and Approximate Dynamic Programming. Piscataway, NJ: IEEE Press, 2004.
27. L. A. Feldkamp and G. V. Puskorius, "A signal processing framework based on dynamic neural networks with application to problems in adaptation, filtering and classification," Proc. IEEE, vol. 86, no. 11, pp. 2259-2277, Nov. 1998.
28. S. Haykin, Ed., Kalman Filtering and Neural Networks. New York: Wiley, 2002.
29. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes in C: The Art of Scientific Computing, 2nd ed. New York: Cambridge Univ. Press, 1992.
30. K. S. Narendra and S. Mukhopadhyay, "Adaptive control of nonlinear multivariable systems using neural networks," Neural Netw., vol. 7, no. 5, pp. 737-752, 1994.
31. J. C. Spall and J. A. Cristion, "A neural network controller for systems with unmodeled dynamics with applications to wastewater treatment," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 27, no. 3, pp. 369-375, Jun. 1997.
32. P. Dupont, V. Hayward, B. Armstrong, and F. Altpeter, "Single state elastoplastic friction models," IEEE Trans. Autom. Control, vol. 47, no. 5, pp. 787-792, May 2002.
33. N. Barabanov and D. Prokhorov, "A new method for stability analysis of nonlinear discrete-time systems," IEEE Trans. Autom. Control, vol. 48, no. 12, pp. 2250-2255, Dec. 2003.
34. I. Tyukin, D. Prokhorov, and V. Terekhov, "Adaptive control with non-convex parameterization," IEEE Trans. Autom. Control, vol. 48, no. 4, pp. 554-567, Apr. 2003.
35. A. Barron, "Universal approximation bounds for superpositions of a sigmoidal function," IEEE Trans. Inf. Theory, vol. 39, no. 3, pp. 930-945, May 1993.