A learning algorithm for optimal internal combustion engine calibration in real time

2007 Proceedings of the ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, DETC2007

Volumn 6 PART A, Issue , 2008, Pages 91-100

  Malikopoulos, Andreas A ^a   Papalambros, Panos Y ^a   Assanis, Dennis N ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Fuel economy; Internal combustion engine calibration; Learning algorithms; Markov Decision Process (MDP); Reinforcement learning; Sequential decision making under uncertainty; Simulation based optimization

Indexed keywords

DESIGN AUTOMATION CONFERENCE (DAC); DRIVING STYLES; ELECTRONIC CONTROL UNIT (ECU); ENGINE ACCELERATION; ENGINE CALIBRATION; ENGINE OPERATIONS; ENGINE PERFORMANCES; INTERNAL COMBUSTION; INTERNATIONAL DESIGNS; NEW APPROACHES; OPERATING POINTS; OPTIMAL VALUES; PERFORMANCE INDEX (PI); POLLUTANT EMISSIONS; REAL TIME; SPARK IGNITION (SI); SPARK-IGNITION (SI) ENGINES; STATIC CORRELATION; TECHNICAL CONFERENCES;

AIR POLLUTION; ARCHITECTURAL DESIGN; AUTOMATION; AUTOMOBILE DRIVERS; AUTOMOBILE ENGINES; CALIBRATION; COMBUSTION; COMBUSTION EQUIPMENT; COMPUTER AIDED DESIGN; COMPUTER NETWORKS; COMPUTERS; CORRELATION METHODS; DIESEL ENGINES; ELECTRIC SPARKS; ELECTRONICS INDUSTRY; ENGINEERING; FUEL ECONOMY; FUELS; INDUSTRIAL ELECTRONICS; INDUSTRIAL ENGINEERING; INTEGER PROGRAMMING; INTERNAL COMBUSTION ENGINES; LEAKAGE (FLUID); LEARNING ALGORITHMS; LEARNING SYSTEMS; MACHINE DESIGN; MECHANIZATION; MULTITASKING; POWER ELECTRONICS; ROBOTICS; SET THEORY; SMOKE; TECHNOLOGY; THERMOCHEMISTRY; VARIATIONAL TECHNIQUES; VEHICLES;

AUTOMOBILE PARTS AND EQUIPMENT;

EID: 44849113822     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1115/DETC2007-34718     Document Type: Conference Paper

References (42)

1. Rask, E. and Sellnau, M., "Simulation-Based Engine Calibration: Tools, Techniques, and Applications," SAE Transactions-Journal of Engines, v. 113, 2004, SAE 2004-01-1264.
2. Atkinson, C. and Mott, G., "Dynamic Model-Based Calibration Optimization: An Introduction and Application to Diesel Engines," SAE World Congress, Detroit, Michigan, April 11-14, 2005, SAE 2005-01-0026.
3. Rakopoulos, C. D., Giakoumis, E. G., Hountalas, D. T., and Rakopoulos, D. C., "The Effect of Various Dynamic, Thermodynamic and Design Parameters on the Performance of a Turbocharged Diesel Engine Operating under Transient Load Conditions," SAE 2004 World Congress and Exhibition, Detroit, Michigan, April 8-11, 2004, SAE 2004-01-0926.
4. Wijetunge, R. S., Brace, C. J., Hawley, J. G., Vaughan, N. D., Horroocks, R. W., and Bird, G. L., "Dynamic Behavior of a High-Speed, Direct-Injection Diesel Engine," SAE Transactions-Journal of Engines, v. 108, 1999, SAE 1999-01-0829.
5. Clark, N. N., Gautam, M., Rapp, B. L., Lyons, D. W., Graboski, M. S., McCormick, R. L., Alleman, T. L., and National, P. N., "Diesel and CNG Transit Bus Emissions Characterization by Two Chassis Dynamometer Laboratories: Results and Issues," SAE Transactions-Journal of Fuels and Lubricants, v. 108, 1999, SAE 1999-01-1469.
6. Samulski, M. J. and Jackson, C. C., "Effects of Steady-State and Transient Operation on Exhaust Emissions from Nonroad and Highway Diesel Engines," SAE Transactions-Journal of Engines, v. 107, 1998, SAE 982044.
7. Green, R. M., "Measuring the Cylinder-to-Cylinder EGR Distribution in the Intake of a Diesel Engine During Transient Operation," SAE Transactions-Journal of Engines, v. 109, 2000, SAE 2000-01-2866.
8. Hagena, J. R., Filipi, Z. S., and Assanis, D. N., "Transient Diesel Emissions: Analysis of Engine Operation During a Tip-In," SAE 2006 World Congress, Detroit, Michigan, April 3-6, 2006, SAE 2006-01-1151.
9. Papalambros, P. Y and Wilde, D. J., Principles of Optimal Design: Modeling and Computation, 2nd edition, Cambridge University Press, July 2000.
10. Clarke, G. M. and Kempson, R. E., Introduction to the Design and Analysis of Experiments, Hodder Arnold, November 1996.
11. Hicks, C. R. and Turner, K. V., Fundamental Concepts in the Design of Experiments, 5th edition, Oxford University Press, USA, March 1999.
12. Diamond, W J., Practical Experiment Designs : for Engineers and Scientists, 3rd edition, John Wiley & Sons, February 2001.
13. Edwards, S. P., Grove, D. M., and Wynn, H. P., Statistics for Engine Optimization, 1st edition, John Wiley & Sons Canada, December 2000.
14. Regner, G., Teng, H., Wieren, P. V., Park, J. I., Park, S. Y., and Yeom, D. J., "Performance Analysis and Valve Event Optimization for SI Engines Using Fractal Combustion Model," Powertrain and Fluid Systems Conference and Exhibition, Toronto, Ontario, Canada, September 16-19, 2006, SAE 2006-01-3238.
15. Ghauri, A., Richardson, S. H., and Nightingale, C. J. E., "Variation of Both Symmetric and Asymmetric Valve Events on a 4-Valve SI Engine and the Effects on Emissions and Fuel Economy," SAE 2000 World Congress, Detroit, Michigan, March 6-9, 2000, SAE 2000-01-1222.
16. Amann, M., Buckingham, J., and Kono, N., "Evaluation of HCCI Engine Potentials in Comparison to Advanced Gasoline and Diesel Engines," Powertrain and Fluid Systems Conference and Exhibition, Toronto, Ontario, Canada, September 16-19, 2006, SAE 2006-01-3249.
17. Jankovic, M. and Magner, S., "Fuel Economy Optimization in Automotive Engines," Proceedings of the 2006 American Control Conference, Minneapolis, MN, USA, 2006.
18. Guerrier, M. and Cawsey, P., "The Development of Model-Based Methodologies for Gasoline IC Engine Calibration," SAE Transactions-Journal of Engines, v. 113, 2004, SAE 2004-01-1466.
19. Stuhler, H., Kruse, T., Stuber, A., Gschweitl, K., Piock, W., Pfluegl, H., and Lick, P., "Automated Model-Based GDI Engine Calibration Adaptive Online DoE Approach," SAE 2002 World Congress, Detroit, Michigan, March 3-7, 2002, SAE 2002-01-0708.
20. Roepke, K. and Fischer, M., "Efficient Layout and Calibration of Variable Valve Trains," SAE Transactions-Journal of Engines, v. 110, 2001, SAE 2001-01-0668.
21. Ayeb, M., Theuerkauf, H. J., and Winsel, T., "SI Engine Emissions Model Based on Dynamic Neural Networks and D- Optimality," SAE World Congress, Detroit, Michigan, April 11-14, 2005, SAE 2005-01-0019.
22. Brahma, I., He, Y., and Rutland, C. J., "Improvement of Neural Network Accuracy for Engine Simulations," Powertrain and Fluid Systems Conference and Exhibition, Pittsburgh, Pennsylvania, September 27-30, 2003, SAE 2003-01-3227.
23. Lowe, D. and Zapart, K., "Validation of Neural Networks in Automotive Engine Calibration," Proceedings of the Fifth International Conference on Artificial Neural Networks, Cambridge, UK, 1997.
24. Meyer, S. and Greff, A., "New Calibration Methods and Control Systems with Artificial Neural Networks," SAE 2002 World Congress, Detroit, Michigan, March 4-7, 2002, SAE 2002-01-1147.
25. Wu, B., Prucka, R. G., Filipi, Z. S., Kramer, D. M., and OhI, G. L., "Cam-Phasing Optimization Using Artificial Neural Networks as Surrogate Models-Fuel Consumption and NOx Emissions," SAE 2006 World Congress, Detroit, Michigan, April 3-6, 2006, SAE 2006-01-1512.
26. Wu, B., Prucka, R. G., Filipi, Z. S., Kramer, D. M., and Ohl, G. L., "Cam-Phasing Optimization Using Artificial Neural Networks as Surrogate Models-Maximizing Torque Output," SAE Transactions-Journal of Engines, v. 114, 2005, SAE 2005-01-3757.
27. Puterman, M. L., Markov Decision Processes: Discrete Stochastic Dynamic Programming, 2nd Rev. edition, Wiley-Interscience, 2005.
28. Sennott, L. I., Stochastic Dynamic Programming and the Control of Queueing Systems, 1st edition, Wiley-Interscience, September 1998.
29. Bertsekas, D. P., Dynamic Programming and Optimal Control (Volumes 1 and 2), Athena Scientific, September 2001.
30. Bellman, R., Dynamic Programming. Princeton, NJ, Princeton University Press, 1957.
31. Bertsekas, D. P. and Tsitsiklis, J. N., Neuro-Dynamic Programming (Optimization and Neural Computation Series, 3), 1st edition, Athena Scientific, May 1996.
32. Sutton, R. S. and Barto, A. G., Reinforcement Learning: An Introduction (Adaptive Computation and Machine Learning), The MIT Press, March 1998.
33. Wheeler, R. and Narenda, K., "Decentralized Learning in Finite Markov Chains," IEEE Transactions on Automatic Control, vol. 31(6), pp. 373-376, 1986.
34. Sutton, R. S., "Learning to Predict by the Methods of Temporal Difference," Machine Learning, vol. 3, pp. 9-44, 1988.
35. Watkins, C. J., Learning from Delayed Rewards, PhD Thesis, Kings College, Cambridge, England, May 1989.
36. Iwata, K., Ito, N., Yamauchi, K., and Ishii, N., "Combining Exploitation-Based and Exploration-Based Approach in Reinforcement Learning," Proceedings of the Intelligent Data Engineering and Automated - IDEAL 2000, Hong Kong, China, 2000.
37. Ishii, S., Yoshida, W., and Yoshimoto, J., "Control of Exploitation-Exploration Meta-Parameter in Reinforcement Learning," Journal of Neural Networks, vol. 15, pp. 665-87, 2002.
38. Chan-Geon, P. and Sung-Bong, Y., "Implementation of the Agent Using Universal On-Line Q-learning by Balancing Exploration and Exploitation in Reinforcement Learning," Journal of KISS: Software and Applications, vol. 30, pp. 672-80, 2003.
39. Miyazaki, K. and Yamamura, M., "Marco Polo: a Reinforcement Learning System Considering Tradeoff Exploitation and Exploration under Markovian Environments," Journal of Japanese Society for Artificial Intelligence, vol. 12, pp. 78-89, 1997.
40. Kaelbling, L. P., Littman, M. L., and Moore, A. W., "Reinforcement Learning: a Survey," Journal of Artificial Intelligence Research, vol. 4.
41. Heywood, J., Internal Combustion Engine Fundamentals, 1st edition, McGraw-Hill, April 1988.
42. TESIS, 〈http://www.tesis.de/en/〉.