Approximate dynamic programming with Gaussian processes

Proceedings of the American Control Conference

Volumn , Issue , 2008, Pages 4480-4485

  Deisenroth, Marc P ^a,b   Peters, Jan ^b   Rasmussen, Carl E ^a,b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CHLORINE COMPOUNDS; DYNAMIC PROGRAMMING; FEEDBACK; GAUSSIAN DISTRIBUTION; MATHEMATICAL PROGRAMMING; SET THEORY; STANDARDS; STATE FEEDBACK; STATE SPACE METHODS; SYSTEMS ENGINEERING; TRELLIS CODES;

APPROXIMATE DYNAMIC PROGRAMMING; CLOSED LOOPS; CONTROL DOMAINS; CURSE OF DIMENSIONALITY; DYNAMIC PROGRAMMING ALGORITHMS; FINITE SET OF STATES; GAUSSIAN PROCESSES; NON-LINEAR CONTROL; NONLINEAR CONTROL PROBLEMS; OPTIMAL CONTROL; OPTIMAL SOLUTIONS; OPTIMAL STATES; PENDULUM SWING-UP; RECURSION; SAMPLE POINTS; STANDARD METHODS; STATE SPACES; TEMPORAL SAMPLING; VALUE FUNCTIONS;

GAUSSIAN NOISE (ELECTRONIC);

EID: 52449085771     PISSN: 07431619     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACC.2008.4587201     Document Type: Conference Paper

References (13)

1. D. P. Bertsekas, Dynamic Programming and Optimal Control, 3rd ed., Athena Scientific, 2005, vol. 1.
2. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Athena Scientific, 1996.
3. D. Ormoneit and Ś. Sen, "Kernel-Based Reinforcement Learning," Machine Learning, vol. 49, no. 2-3, pp. 161-178, November 2002.
4. N. Jong and P. Stone, "Kernel-Based Models for Reinforcement Learning," in ICML Workshop on Kernel Machines and Reinforcement Learning, Pittsburgh, PA, USA, June 2006.
5. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. The MIT Press, 2006.
6. J. Kocijan, R. Murray-Smith, C. E. Rasmussen, and A. Girard, "Gaussian Process Model Based Predictive Control," in Proceedings of the 2004 American Control Conference (ACC 2004), Boston, MA, USA, June-July 2004, pp. 2214-2219.
7. A. Girard, C. E. Rasmussen, J. Quiñonero Candela, and R. Murray-Smith, "Gaussian Process Priors with Uncertain Inputs - Application to Multiple-Step Ahead Time Series Forecasting," in Advances in Neural Information Processing Systems 15.The MIT Press, 2003, pp. 529-536.
8. C. E. Rasmussen and M. Kuss, "Gaussian Processes in Reinforcement Learning," in Advances in Neural Information Processing Systems 16. The MIT Press, June 2004, pp. 751-759.
9. Y. Engel, S. Mannor, and R. Meir, "Reinforcement Learning with Gaussian Processes," in Proceedings of the 22nd International Conference on Machine Learning (ICML-2005), vol. 22, Bonn, Germany, August 2005, pp. 201-208.
10. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. The MIT Press, 1998.
11. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, "Adaptive Mixtures of Local Experts," Neural Computation, vol. 3, pp. 79-87, 1991.
12. T. P. Minka, "A Family of Algorithms for Approximate Bayesian Inference," Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, MA, USA, January 2001.
13. C. G. Atkeson, "Using Local Trajectory Optimizers to Speed up Global Optimization in Dynamic Programming," in Advances in Neural Information Processing Systems 6. Morgan Kaufmann, 1994, pp. 503-521.