Adaptive critic learning techniques for automotive engine control

Proceedings of the American Control Conference

Volumn 5, Issue , 2004, Pages 4066-4071

  Javaherian, Hossein ^a   Liu, Derong ^b   Zhang, Yi ^b   Kovalenko, Olesia ^b  

^a GENERAL MOTORS CORPORATION   (United States)

^b University of Illinois   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMOTIVE ENGINE CONTROL; ENGINE TORQUE; NEURAL NETWORK CONTROLLERS; REAL-TIME VEHICLES;

CONTROL SYSTEMS; COSTS; DYNAMIC PROGRAMMING; HEURISTIC METHODS; NEURAL NETWORKS; OPTIMAL CONTROL SYSTEMS; TORQUE;

AUTOMOTIVE ENGINEERING;

EID: 8744288519     PISSN: 07431619     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACC.2004.182586     Document Type: Conference Paper

References (36)

1. C. Alippi, C. de Russis, and V. Piuri, "A neural-network based control solution to air-fuel ratio control for automotive fuel-injection systems," IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews, vol. 33, pp. 259268, May 2003.
2. S. N. Balakrishnan and V. Biega, "Adaptive-critic-based neural networks for aircraft optimal control," Journal of Guidance, Control, and Dynamics, vol. 19, pp. 893-898, July-Aug. 1996.
3. R. E. Bellman, Dynamic Programming, Princeton, NJ: Princeton University Press, 1957.
4. D. P. Bertsekas, Dynamic Programming and Optimal Control, Belmont, MA: Athena Scientific, 1995.
5. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming, Belmont, MA: Athena Scientific, 1996.
6. F. E. Coats, Jr. and R. D. Fruechte, "Dynamic engine models for control development - Part II: Application to idle speed control," International Journal of Vehicle Design, Special Publication SP4, pp. 75-88, 1983.
7. J. A. Cook and B. K. Powell, "Modeling of an internal combustion engine for control analysis," IEEE Control Systems Magazine, vol. 8, pp. 20-26, Aug. 1988.
8. C. Cox, S. Stepniewski, C. Jorgensen, R. Sacks, and C. Lewis, "On the design of a neural network autolander," International Journal of Robust and Nonlinear Control, vol. 9, pp. 1071-1096, Dec. 1999.
9. J. Dalton and S. N. Balakrishnan, "A neighboring optimal adaptive critic for missile guidance," Mathematical and Computer Modeling, vol. 23, pp. 175-188, Jan. 1996.
10. H. Demuth and M. Beale, Neural Network Toolbox User's Guide, Natick, MA: MathWorks, 1998 (Version 3).
11. D. J. Dobner, "A mathematical engine model for development of dynamic engine control," SAE Paper No. 800054, 1980.
12. D. J. Dobner, "Dynamic engine models for control development - Part I: Non-linear and linear model formation," International Journal of Vehicle Design, Special Publication SP4, pp. 54-74, 1983.
13. S. E. Dreyfus and A. M. Law, The Art and Theory of Dynamic Programming, New York, NY: Academic Press, 1977.
14. Y. Fukuoka, H. Matsuki, H. Minamitani, and A. Ishida, "A modified back-propagation method to avoid false local minima," Neural Networks, vol. 11, no. 6, pp. 1059-1072, 1998.
15. N. V. Kulkarni and K. KrishnaKumar, "Intelligent engine control using an adaptive critic," IEEE Transactions on Control Systems Technology, vol. 11, pp. 164-173, Mar. 2003.
16. G. G. Lendaris and C. Paintz, "Training strategies for critic and action neural networks in dual heuristic programming method," Proceedings of the 1997 IEEE International Conference on Neural Networks, Houston, TX, June 1997, pp. 712-717.
17. F. L. Lewis and V. L. Syrmos, Optimal Control, New York, NY: John Wiley, 1995.
18. X. Li and S. Yurkovich, "Sliding mode control of delayed systems with application to engine idle speed control," IEEE Transactions on Control Systems Technology, vol. 9, pp. 802-810, Nov. 2001.
19. D. Liu, X. Xiong, and Y. Zhang, "Action-dependent adaptive critic designs," Proceedings of the INNS-IEEE International Joint Conference on Neural Networks, Washington, DC, July 2001, pp. 990-995.
20. J. J. Moskwa and J. K. Hedrick, "Nonlinear algorithms for automotive engine control," IEEE Control Systems Magazine, vol. 10, pp. 88-93, Apr. 1990.
21. D. V. Prokhorov, Adaptive Critic Designs and Their Applications, Ph.D. Dissertation, Texas Tech University, Lubbock, TX, Oct. 1997.
22. D. V. Prokhorov, R. A. Santiago, and D. C. Wunsch, "Adaptive critic designs: A case study for neurocontrol," Neural Networks, vol. 8, pp. 1367-1372, 1995.
23. D. V. Prokhorov and D. C. Wunsch, "Adaptive critic designs," IEEE Transactions on Neural Networks, vol. 8, pp. 997-1007, Sept. 1997.
24. P. F. Puleston, S. Spurgeon, and G. Monsees, "Automotive engine speed control: A robust nonlinear control framework," IEE Proceedings-Control Theory and Applications, vol. 148, pp. 8187, Jan. 2001.
25. G. V. Puskorius, L. A. Feldkamp, and L. I. Davis, "Dynamic neural network methods applied to on-vehicle idle speed control," Proceedings of the IEEEvol. 84, pp. 1407-1420, Oct. 1996.
26. J. Si and Y.-T. Wang, "On-line learning control by association and reinforcement," IEEE Transactions on Neural Networks, vol. 12, pp. 264-276, Mar. 2001.
27. R. S. Sutton, "Learning to predict by the methods of temporal differences," Machine Learning, vol. 3, pp. 9-44, 1988.
28. G. J. Vachtsevanos, S. S. Farinwata, and D. K. Pirovolou, "Fuzzy logic control of an automotive engine," IEEE Control Systems Magazine, vol. 13, pp. 62-68, June 1993.
29. N. A. Visnevski and D. V. Prokhorov, "Control of a nonlinear multivariable system with adaptive critic desings," Proceedings of the Artificial Neural Networks in Engineering Conference, St. Louis, MO, Nov. 1996, pp. 559-565.
30. P. J. Werbos, "Advanced forecasting methods for global crisis warning and models of intelligence," General Systems Yearbook, vol. 22, pp. 25-38, 1977.
31. P. J. Werbos, "Building and understanding adaptive systems: A statistical/numerical approach to factory automation and brain research," IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-17, pp. 7-20, Jan./Feb. 1987.
32. P. J. Werbos, "A menu of designs for reinforcement learning over time," in Neural Networks for Control (Chapter 3), Edited by W. T. Miller, R. S. Sutton, and P. J. Werbos, Cambridge, MA: The MIT Press, 1990.
33. P. J. Werbos, T. McAvoy, and T. Su, "Neural networks, system identification, and control in the chemical process industries," in Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches (Chapter 10), Edited by D. A. White and D. A. Sofge, New York, NY: Van Nostrand Reinhold, 1992.
34. P. J. Werbos, "Approximate dynamic programming for real-time control and neural modeling," in Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches (Chapter 13), Edited by D. A. White and D. A. Sofge, New York, NY: Van Nostrand Reinhold, 1992.
35. P. J. Werbos and X. Pang, "Generalized maze navigation: SRN critics solve what feedforward or Hebbian nets cannot," Proceedings of the SPIE, vol. 2878, pp. 2-9, 1996.
36. M. Won, S. B. Choi, and J. K. Hedrick, "Air-to-fuel ratio control of spark ignition engines using Gaussian network sliding control," IEEE Transactions on Control Systems Technology, vol. 6, pp. 678-687, Sept. 1998.