Eligibility traces through colored noises

2010 International Congress on Ultra Modern Telecommunications and Control Systems and Workshops, ICUMT 2010

Volumn , Issue , 2010, Pages 458-465

  Geist, Matthieu ^a   Pietquin, Olivier ^a  

^a UMI Georgia Tech CNRS 2958   (France)

Author keywords

Colored noise; Neural networks; Reinforcement learning; Statistical modeling; Value function approximation

Indexed keywords

NEURAL NETWORKS; REINFORCEMENT LEARNING; STATISTICAL METHODS; STOCHASTIC SYSTEMS;

COLORED NOISE; ELIGIBILITY TRACES; GAUSSIAN PROCESSES; MONTE CARLO ESTIMATES; NONLINEAR PARAMETERIZATIONS; STATISTICAL MODELING; TEMPORAL DIFFERENCES; VALUE FUNCTION APPROXIMATION;

WHITE NOISE;

EID: 79951485912     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICUMT.2010.5676597     Document Type: Conference Paper

References (17)

1. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction (Adaptive Computation and Machine Learning), 3rd ed. The MIT Press, March 1998.
2. Y. Engel, S. Mannor, and R. Meir, "Bayes Meets Bellman: The Gaussian Process Approach to Temporal Difference Learning," in Proceedings of the International Conference on Machine Learning (ICML 03), 2003, pp. 154-161.
3. M. Geist, O. Pietquin, and G. Fricout, "Kalman Temporal Differences: the deterministic case," in IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL 2009), Nashville, TN, USA, April 2009.
4. L. C. Baird, "Residual Algorithms: Reinforcement Learning with Function Approximation," in Proceedings of the International Conference on Machine Learning (ICML 95), 1995, pp. 30-37.
5. Y. Engel, S. Mannor, and R. Meir, "Reinforcement Learning with Gaussian Processes," in Proceedings of International Conference on Machine Learning (ICML-05), 2005.
6. R. E. Kalman, "A new approach to linear filtering and prediction problems," Transactions of the ASME-Journal of Basic Engineering, vol. 82, no. Series D, pp. 35-45, 1960.
7. S. J. Julier and J. K. Uhlmann, "Unscented filtering and nonlinear estimation," Proceedings of the IEEE, vol. 92, no. 3, pp. 401-422, 2004.
8. M. Geist, O. Pietquin, and G. Fricout, "Tracking in Reinforcement Learning," in Proceedings of the 16th International Conference on Neural Information Processing (ICONIP 2009). Bangkok (Thailande): Springer, 2009.
9. A. Antos, C. Szepesvári, and R. Munos, "Learning near-optimal policies with Bellman-residual minimization based fitted policy iteration and a single sample path," Machine Learning, vol. 71, no. 1, pp. 89-129, April 2008.
10. Y. Engel, "Algorithms and Representations for Reinforcement Learning," Ph.D. dissertation, Hebrew University, April 2005.
11. J. A. Boyan, "Least-squares temporal difference learning," in Proceedings of the 16th International Conference on Machine Learning (ICML 99). Morgan Kaufmann, San Francisco, CA, 1999, pp. 49-56.
12. D. Simon, Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches, 1st ed. Wiley & Sons, August 2006.
13. R. van der Merwe, "Sigma-point kalman filters for probabilistic inference in dynamic state-space models," Ph.D. dissertation, OGI School of Science & Engineering, Oregon Health & Science University, Portland, OR, USA, April 2004.
14. P. E. Gill, G. H. Golub, W. Murray, and M. A. Saunders, "Methods for Modifying Matrix Factorization," Mathematics of Computation, vol. 28, no. 126, pp. 505-535, April 1974.
15. M. G. Lagoudakis and R. Parr, "Least-squares policy iteration," Journal of Machine Learning Research, vol. 4, pp. 1107-1149, 2003.
16. M. Geist and O. Pietquin, "Managing Uncertainty within Value Function Approximation in Reinforcement Learning," in Active Learning and Experimental Design workshop (collocated with AISTATS 2010), Sardinia, Italy, May 2010.
17. J. N. Tsitsiklis and B. Van Roy, "An analysis of temporal-difference learning with function approximation," IEEE Transactions on Automatic Control, vol. 42, pp. 674-690, 1997.