Variable resolution discretization for high-accuracy solutions of optimal control problems

IJCAI International Joint Conference on Artificial Intelligence

Volumn 2, Issue , 1999, Pages 1348-1355

  Munos, Remi ^a   Moore, Andrew ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCH-MARK PROBLEMS; MARKOV DECISION PROCESSES; NEAR-OPTIMAL POLICIES; OPTIMAL CONTROL PROBLEM; SPLITTING CRITERION; TOP-DOWN APPROACH; VARIABLE RESOLUTION; VARIABLE RESOLUTION DISCRETIZATION;

ABSTRACTING; ARTIFICIAL INTELLIGENCE; CYTOLOGY; MARKOV PROCESSES; OPTIMAL CONTROL SYSTEMS; OPTIMIZATION;

CELLS;

EID: 84880680664     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. A. G. Barto, R S. Sutton, and C W. Anderson. Neuronlike Adaptive elements that that can learn difficult Control Problems. IEEE Trans, on Systems Man and Cybernetics, 13(5):835-846, 1983.
2. D. Chapman and L. P. Kaelbling. Learning from Delayed Reinforcement In a Complex Domain. In IJCAI-91, 1991.
3. Wendell H. Fleming and H. Mete Soner. Controlled Markov Processes and Viscosity Solutions, Applications of Mathematics. Springer-Verlag, 1993.
4. Harold J Kushner and Dupuis. Numerical Methods for Stochastic Control Problems in Continuous Time. Applications of Mathematics. Springer-Verlag, 1992.
5. A. McCallum. Instance-Based Utile Distinctions for Reiforcement Learning with Hidden State. In Machine Learning (proceedings of the twelfth international conference), San Francisco, CA, 1995. Morgan Kaufmann.
6. A. W. Moore and C. G. Atkeson. The Parti-game Algorithm for Variable Resolution Reinforcement Learning in Multidimensional State-spaces. Machine Learning, 21, 1995.
7. A. W. Moore. Variable Resolution Dynamic Programming: Efficiently Learning Action Maps in Multivariate Real-valued State-spaces. In L. Birnbaum and G. Collins, editors, Machine Learning: Proceedings of the Eighth International Workshop. Morgan Kaufmann, June 1991.
8. Remi Munos and Andrew Moore. Barycentric interpolators for continuous space and time reinforcement learning. Neural Information Processing Systems, 1998.
9. Remi Munos and Andrew Moore. Variable resolution discretization in optimal control. Robotics Institute Technical Report, CMU, 1999.
10. Remi Munos. A study of reinforcement learning in the continuous case by the means of viscosity solutions. To appear in Machine Learning Journal, 1999.
11. Martin L. Puterman. Markov Decision Processes, Discrete Stochastic Dynamic Programming A Wiley-Interscience Publication, 1994.
12. J. Simons, H. Van Brussel, J De Schutter, and J. Verhaert. A Self-Learning Automaton with Variable Resolution for High Precision Assembly by Industrial Robots. IEEE Trans, on Automatic Control, 27(5):1109-1113, October 1982.
13. R. S. Sutton Generalization in Reinforcement Learning: Successful Examples Using Sparse Coarse Coding In D Touret-zky, M. Mozer, and M. Hasselmo, editors, Neural Information Processing Systems 8, 1996.
14. Richard S. Sutton. Generalization in reinforcement learning : Successful examples using sparse coarse coding. Advances in Neural Information Processing Systems, 8, 1996