Exploiting model uncertainty estimates for safe dynamic control learning

Advances in Neural Information Processing Systems

Volumn , Issue , 1997, Pages 1047-1053

  Schneider, Jeff G ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DYNAMIC PROGRAMMING; REGRESSION ANALYSIS; REINFORCEMENT LEARNING; UNCERTAINTY ANALYSIS;

CATASTROPHIC FAILURES; CONTINUOUS STATE; CONTROL PROBLEMS; DYNAMIC CONTROLS; LEARNING CONTROL; LOCALLY-WEIGHTED REGRESSION MODEL; MODEL UNCERTAINTIES; UNCERTAINTY ESTIMATES;

REACTOR CORES;

EID: 0141708339     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. C. Atkeson. Using local models to control movement. In Advances in Neural Information Processing Systems, 1989.
2. C. Atkeson. Using local trajectory optimizers to speed up global optimization in dynamic programming. In Advances in Neural Information Processing Systems (NIPS-6), 1993.
3. C. Atkeson. Local methods for active learning. Invited talk at AAAI Fall Symposium on Active Learning, 1995.
4. Y. Bar-Shalom and E. Tse. Concepts and Methods in Stochastic Control. Academic Press, 1976.
5. A. Barto, R. Sutton, and C. Anderson. Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man, and Cybernetics, 1983.
6. W. Cleveland and S. Delvin. Locally weighted regression: An approach to regression analysis by local fitting. Journal of the American Statistical Association, pages 596-610, September 1988.
7. S. Davies. Applying grid-based interpolation to reinforcement learning. In Neural Information Processing Systems 9, 1996.
8. M. DeGroot. Optimal Statistical Decisions. McGraw-Hill, 1970.
9. P. Dyer and S. McReynolds. The Computation and Theory of Optimal Control. Academic Press, 1970.
10. G. Gordon. Stable function approximation in dynamic programming. In The 12th International Conference on Machine Learning, 1995.
11. D. Kendrick. Stochastic Control for Economic Models. McGraw-Hill, 1981.
12. A. Moore and C. Atkeson. Prioritized sweeping: Reinforcement learning with less data and less real time. Machine Learning, 13(1):103-130, 1993.
13. A. Moore and J. Schneider. Memory based stochastic optimization. In Advances in Neural Information Processing Systems (NIPS-8), 1995.
14. A. Moore. Fast robust adaptive control by learning only forward models Advances in Neural Information Processing Systems 4 1992.
15. S. Schaal and C. Atkeson. Assessing the quality of learned local models. In Advances in Neural Information Processing Systems (NIPS-6), 1993.
16. R. Sutton. First results with dyna, an intergrated architecture for learning, planning, and reacting. In AAAI Spring Symposium on Planning in Uncertain, Unpredictable, or Changing Environments, 1990.