A rollout control algorithm for discrete-time stochastic systems

ASME 2010 Dynamic Systems and Control Conference, DSCC2010

Volumn 2, Issue , 2010, Pages 711-717

  Malikopoulos, Andreas A ^a  

^a GENERAL MOTORS CORPORATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ASSOCIATED COSTS; AUTONOMOUS INTELLIGENT SYSTEMS; COGNITIVE MODEL; CONTROL ACTIONS; CONTROLLED MARKOV CHAINS; DECISION MAKING PROCESS; DISCRETE-TIME STOCHASTIC SYSTEMS; GROWING DEMAND; LONG-TERM GOALS; LOOK-AHEAD; ONLINE DECISION-MAKING; SUBOPTIMAL CONTROL; THEORETICAL BOUNDS; TIME STEP;

ALGORITHMS; COGNITIVE SYSTEMS; DECISION MAKING; INTELLIGENT SYSTEMS; MARKOV PROCESSES; STOCHASTIC MODELS;

DISCRETE TIME CONTROL SYSTEMS;

EID: 79958238509     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1115/DSCC2010-4047     Document Type: Conference Paper

References (27)

1. Bertsekas, D. P., Dynamic Programming and Optimal Control (Volumes 1 and 2), Athena Scientific, September 2001.
2. Bertsekas, D. P. and Shreve, S. E., Stochastic Optimal Control: The Discrete-Time Case, 1st edition, Athena Scientific, February 2007.
3. Bellman, R., Dynamic Programming. Princeton, NJ, Princeton University Press, 1957.
4. Bertsekas, D. P. and Tsitsiklis, J. N., Neuro-Dynamic Programming (Optimization and Neural Computation Series, 3), 1st edition, Athena Scientific, May 1996.
5. Bertsekas, D. P., Tsitsiklis, J. N., and Wu, C., "Rollout Algorithms for Comninatorial Optimization, " Heuristics, vol. 3, pp. 245-262, 1997.
6. Bertsekas, D. P. and Castanon, D. A., "Rollout Algorithms for Stochastic Scheduling Problems, " Heuristics, vol. 5, pp. 89- 108, 1999.
7. Secomandi, N., "Comparing Neuro-Dynamic Programming Algorithms for the Vehicle Routing Problem with Stochastic Demands, " Computers and Operations Research, vol. 27, pp. 1201-1225, 2000. (Pubitemid 30398145)
8. McGovern, A., Moss, E., and Barto, A., "Building a Basic Building Block Scheduler Using Reinforcement Learning and Rollouts, " Machine Learning, vol. 49, pp. 141-160, 2002. (Pubitemid 34325683)
9. Bertsimas, D. and Popescu, I., "Revenue Management in a Dynamic Network Environment, " Transportation Science, vol. 37, pp. 257-277, 2003.
10. Tu, F. and Pattipati, K. R., "Rollout Strategies for Sequential Fault Diagnosis, " IEEE Trans on Systems, Man and Cybernetics, Part A, pp. 86-99, 2003.
11. Abramson, B., "Expected-Outcome: A General Model of Static Evaluation, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, pp. 182-193, 1990. (Pubitemid 20666142)
12. Tesauro, G. and Galperin, G., "On-line Policy Improvement Using Monte-Carlo Search, " Advances in Neural Information Processing, vol. 9, pp. 1068-1074, 1996.
13. Morari, M. and Lee, J. H., "Model Predictive Control: Past, Present, and Future, " Computers and Chemical Engineering, vol. 23, pp. 667-682, 1999. (Pubitemid 29210323)
14. Mayne, D. Q., Rawlings, J. B., Rao, C. V., and Scokaert, P. O. M., "Constrained Model Predictive Control: Stability and Optimality, " Automatica, vol. 36, pp. 789-814, 2000. (Pubitemid 30587683)
15. Rawlings, J. B., "Tutorial Overview of Model Predictive Control, " Control Systems Magazine, vol. 20, pp. 38-52, 2000.
16. Findeisen, R., Imsland, L., Allgower, F., and Foss, B. A., "State and Output Feedback Nonlinear Model Predictive Control: An Overview, " European Journal of Control, vol. 9, pp. 190-205, 2003.
17. Qin, S. J. and Badgwell, T. A., "A Survey of Industrial Model Predictive Control Technology, " Control Engineering Practice, vol. 11, pp. 733-764, 2003. (Pubitemid 36906334)
18. Sutton, R. S. and Barto, A. G., Reinforcement Learning: An Introduction (Adaptive Computation and Machine Learning), The MIT Press, March 1998.
19. Gosavi, A., Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning, 1st edition, Springer, June 30, 2003.
20. Borkar, V. S., "A Learning Algorithm for Discrete-Time Stochastic Control, " Probability in the Engineering and Information Sciences, vol. 14, pp. 243-258, 2000. (Pubitemid 33211056)
21. Kaelbling, L. P., Littman, M. L., and Moore, A. W., "Reinforcement Learning: A Survey, " Journal of Artificial Intelligence Research, vol. 4, 1996.
22. Malikopoulos, A. A., Real-Time, Self-Learning Identification and Stochastic Optimal Control of Advanced Powertrain Systems, Ph.D. Dissertation, Department of Mechanical Engineering, University of Michigan, Ann Arbor, USA, 2008.
23. Malikopoulos, A. A., Papalambros, P. Y., and Assanis, D. N., "A Real-Time Computational Learning Model for Sequential Decision-Making Problems Under Uncertainty, " ASME J. Dyn. Sys., Meas., Control, vol. 131, 4, pp. 041010-(8), 2009.
24. Malikopoulos, A. A., Assanis, D. N., and Papalambros, P. Y., "Real-Time Self-Learning Optimization of Diesel Engine Calibration, " ASME J. Eng. Gas Turbines Power, vol. 131, 2, pp. 022803(7), 2009.
25. Kushner, H. J., Introduction to Stochastic Control, Holt, Rinehart and Winston, 1971.
26. Kumar, P. R. and Varaiya, P., Stochastic Systems, Prentice Hall, June 1986.
27. Malikopoulos, A. A., "Convergence Properties of a Computational Learning Model for Unknown Markov Chains, " ASME J. Dyn. Sys., Meas., Control, vol. 131, No. 4, pp. 041011(7), 2009.