Regularized least squares temporal difference learning with nested ℓ 2 and ℓ 1 penalization

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7188 LNAI, Issue , 2012, Pages 102-114

  Hoffman, Matthew W ^a   Lazaric, Alessandro ^b   Ghavamzadeh, Mohammad ^b   Munos, Rémi ^b  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b INRIA   (France)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE VALUE FUNCTION; APPROXIMATION SPACES; CENTRAL PROBLEMS; HIGH-DIMENSIONAL FEATURE SPACE; LEAST SQUARE; NUMBER OF SAMPLES; OVERFITTING; POLICY EVALUATION; PREDICTION PERFORMANCE; PROJECTION OPERATOR; REGULARIZED LEAST SQUARES; REGULARIZED METHOD; TEMPORAL DIFFERENCE LEARNING;

ARTIFICIAL INTELLIGENCE;

REINFORCEMENT LEARNING;

EID: 84861687861     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-29946-9_13     Document Type: Conference Paper

References (15)

1. Antos, A., Szepesvári, C., Munos, R.: Learning near-optimal policies with Bellmanresidual minimization based fitted policy iteration and a single sample path. Machine Learning 71(1) (2008)
2. Bradtke, S., Barto, A.: Linear least-squares algorithms for temporal difference learning. Machine Learning 22, 33-57 (1996)
3. Bunea, F., Tsybakov, A., Wegkamp, M.: Sparsity oracle inequalities for the lasso. Electronic Journal of Statistics 1, 169-194 (2007)
4. Efron, B., Hastie, T., Johnstone, I., Tibshirani, R.: Least angle regression. Annals of Statistics 32(2) (2004)
5. Farahmand, A., Ghavamzadeh, M., Szepesvari, C., Mannor, S.: Regularized policy iteration. In: Advances in Neural Information Processing Systems 21 (2009)
6. Friedman, J., Hastie, T., Höfling, H., Tibshirani, R.: Pathwise coordinate optimization. The Annals of Applied Statistics 1(2), 302-332 (2007)
7. Friedman, J., Hastie, T., Tibshirani, R.: The elements of statistical learning. Springer, Heidelberg (2001)
8. 1-penalized projected bellman residual. In: European Workshop on Reinforcement Learning (2011)
9. Ghavamzadeh, M., Lazaric, A., Munos, R., Hoffman, M.: Finite-sample analysis of Lasso-TD. In: Proceedings of the International Conference on Machine Learning (2011)
10. Johns, J., Painter-Wakefield, C., Parr, R.: Linear complementarity for regularized policy evaluation and improvement. In: Advances in Neural Information Processing Systems 23 (2010)
11. Kolter, J.Z., Ng, A.Y.: Regularization and feature selection in least-squares temporal difference learning. In: Proceedings of the International Conference on Machine Learning (2009)
12. Lagoudakis, M.G., Parr, R.: Least-squares policy iteration. Journal of Machine Learning Research 4 (2003)
13. Schmidt, M.: Graphical Model Structure Learning with l1-Regularization. Ph.D. thesis, University of British Columbia (2010)
14. Sutton, R., Barto, A.: Reinforcement Learning: An Introduction. MIT Press (1998)
15. Tibshirani, R.: Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological) 58(1), 267-288 (1996)