Neurocontrol of Nonlinear Dynamical Systems with Kalman Filter Trained Recurrent Networks

IEEE Transactions on Neural Networks

Volumn 5, Issue 2, 1994, Pages 279-297

  Puskorius, Gintaras V ^a   Feldkamp, Lee A ^a  

^a FORD MOTOR COMPANY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; COMPUTER ARCHITECTURE; COMPUTER SIMULATION; KALMAN FILTERING; LEARNING SYSTEMS; NONLINEAR CONTROL SYSTEMS; PARAMETER ESTIMATION; SENSITIVITY ANALYSIS; SIGNAL NOISE MEASUREMENT; SPEED CONTROL; STATE SPACE METHODS;

GRADIENT DESCENT LEARNING ALGORITHMS; KALMAN FILTER TRAINED RECURRENT NETWORKS; NEUROCONTROL; NONLINEAR DYNAMICAL SYSTEMS; RECURRENT NETWORK ARCHITECTURE;

NEURAL NETWORKS;

EID: 0028401031     PISSN: 10459227     EISSN: 19410093     Source Type: Journal    
DOI: 10.1109/72.279191     Document Type: Article

References (28)

1. G. V. Puskorius and L. A. Feldkamp, “Recurrent network training with the decoupled extended Kalman filter algorithm,” in Proceedings of the 1992 SPIE Conference on the Science of Artificial Neural Networks, Orlando, 1992, vol. 1710, pp. 461–473.
2. G. V. Puskorius and L. A. Feldkamp, “Automotive engine idle speed control with recurrent neural networks,” in Proceedings of the 1993 American Control Conference, San Francisco, 1993, pp. 311–316.
3. R. J. Williams, “Adaptive state representation and estimation using recurrent connectionist networks,” in Neural Networks for Control, W. T. Miller III, R. S. Sutton, and P. J. Werbos, Eds. Cambridge, MA: MIT Press, 1990, chap. 4, pp. 97–114.
4. R. J. Williams and D. Zipser, “A learning algorithm for continually running fully recurrent neural networks,” Neural Computation, vol. 1, pp. 270–280, 1989.
5. P. J. Werbos, “Backpropagation through time: What it does and how to do it,” Proceedings of the IEEE vol. 78, no. 10, pp. 1550–1560, 1990.
6. R. J. Williams and J. Peng, “An efficient gradient-based algorithm for on-line training of recurrent network trajectories,” Neural Computation, vol. 2, pp. 490–501, 1990.
7. S. Singhal and L. Wu, “Training multilayer perceptrons with the extended Kalman algorithm,” in Advances in Neural Information Processing Systems I. Denver 1988, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufmann, 1989, pp. 133–140.
8. S. C. Douglas and T. H.-Y. Meng, “Linearized least-squares training of multilayer feedforward neural networks,” in International Joint Conference on Neural Networks. Seattle, 1991, vol. I, pp. 307–312.
9. G. V. Puskorius and L. A. Feldkamp, “Decoupled extended Kalman filter training of feedforward layered networks,” in International Joint Conference on Neural Networks, Seattle 1991, vol. I, pp. 771–777.
10. D. W. Ruck, S. K. Rogers, M. Kabrisky, P. S. Maybeck and M. E. Oxley, “Comparative analysis of backpropagation and the extended Kalman filter for training multilayer perceptrons,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, no. 6, pp. 686–690, 1992.
11. K. S. Narendra and K. Parthasarathy, “Identification and control of dynamical systems using neural networks,” IEEE Transactions on Neural Networks, vol. 1, no. 1, pp. 4—27, 1990.
12. K. S. Narendra and K. Parthasarathy, “Gradient methods for the optimization of dynamical systems containing neural networks,” IEEE Transactions on Neural Networks, vol. 2, no. 2, pp. 252–262, 1991.
13. R. J. Williams, “Some observations on the use of the extended Kalman filter as a recurrent network learning algorithm,” Technical Report NU-CCS-92-1, Boston: Northeastern University, College of Computer Science, 1992.
14. R. J. Williams, “Training recurrent networks using the extended Kalman filter,” in International Joint Conference on Neural Neworks, Baltimore 1992, vol. IV, pp. 241–246.
15. B. Fernandez, A. G. Parlos, and W. K. Tsai, “Nonlinear dynamic system identification using artificial neural networks (ANNs),” in International Joint Conference on Neural Networks, San Diego 1990, vol. II, pp. 133–141.
16. S. Shah, F. Palmieri, and M. Datum, “Optimal filtering algorithms for fast learning in feedforward neural networks,” Neural Networks, vol. 5, pp. 779–787, 1992.
17. M. B. Matthews, “Neural network nonlinear adaptive filtering using the extended Kalman filter algorithm,” in Proceedings of the International Neural Networks Conference, Paris 1990, vol. I, pp. 115–119.
18. M. M. Livstone, J. A. Farrell, and W. L. Baker, “A computationally efficient algorithm for training recurrent connectionist networks,” in Proceedings of the 1992 American Control Conference, Chicago, 1992, vol. II, pp. 555–561.
19. G. V. Puskorius and L. A. Feldkamp, “Model reference adaptive control with recurrent networks trained by the dynamic DEKF algorithm,” in International Joint Conference on Neural Networks, Baltimore, 1992), vol. II, pp. 106–113.
20. M. I. Jordan, “Supervised learning and systems with excess degrees of freedom,” in Proceedings of the 1988 Connectionists Summer School, Pittsburgh, 1988, D. Touretzky, G. Hinton and T. Sejnowski, Eds. San Mateo, CA: Morgan Kaufmann, pp. 62–75.
21. M. I. Jordan, “Generic constraints on underspecified target trajectories,” in International Joint Conference on Neural Networks, Washington D.C., 1989, vol. I, pp. 217–225.
22. L. A. Feldkamp, G. V. Puskorius, L. I. Davis, Jr., and F. Yuan, “Neural control systems trained by dynamic gradient methods for automotive applications,” in International Joint Conference on Neural Networks, Baltimore, 1992, vol. II, pp. 798–804.
23. L. I. Davis, Jr., G. V. Puskorius, F. Yuan, and L. A. Feldkamp, “Neural network modeling and control of an anti-lock brake system,” in Proceedings Intelligent Vehicle '92 Symposium, Detroit, 1992, pp. 179–184.
24. A. G. Barto, R. S. Sutton, and C. W. Anderson, “Neuronlike elements that can solve difficult learning control problems,” IEEE Transactions on Systems, Man and Cybernetics, vol. 13, no. 5, pp. 835–846, 1983).
25. L. H. Ungar, “A bioreactor benchmark for adaptive network-based process control,” in Neural Networks for Control, W. T. Miller, III, R. S. Sutton, and P. J. Werbos, Eds. Cambridge, MA: MIT Press, chap. 16, pp. 387—402 and Appendix A, 1990, pp. 476–480. [Note errors in the equations on page 477].
26. P. Agrawal, C. Lee, H. C. Lim, and D. Ramkrishna, “Theoretical Investigations of dynamic behavior of isothermal continuous stirred tank biological reactors,” Chemical Engineering Science vol. 37, no. 3, pp. 453–462, 1982.
27. B. K. Powell and J. A. Cook, “Nonlinear low frequency phenomenological engine modeling and analysis,” Proceedings of the 1987 American Control Conference, vol. 1, pp. 336–340, 1987; J. A. Cook and B. K. Powell, “Modeling of an internal combustion engine for control analysis,” IEEE Control Systems Magazine, vol. 8, no. 4, 20–26, 1988.
28. G. Vachtsevanos, S. S. Farinwata, and D. K. Pirovolou, “Fuzzy logic control of an automotive engine,” IEEE Control Systems Magazine, vol. 13, no. 3, 62–68, 1993.