Analyzing feature generation for value-function approximation

ACM International Conference Proceeding Series

Volumn 227, Issue , 2007, Pages 737-744

  Parr, Ronald ^a   Painter Wakefield, Christopher ^a   Li, Lihong ^b   Littman, Michael ^b  

^a Duke University   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC NOISE; APPROXIMATION THEORY; ERROR ANALYSIS; FUNCTION EVALUATION;

BASIS FUNCTIONS; BELLMAN-ERROR;

FEATURE EXTRACTION;

EID: 34547982545     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1273496.1273589     Document Type: Conference Paper

References (15)

1. Atkeson, C. G., Moore, A. W., & Schaal, S. (1997). Locally weighted learning. Artificial Intelligence Review, 11, 11-73.
2. Boyan, J. A., & Moore, A. W. (1995). Generalization in reinforcement learning: Safely approximating the value function. Advances in Neural Information Processing Systems 7 (pp. 369-376). Cambridge, MA: The MIT Press.
3. Bradtke, S., & Barto, A. (1996). Linear least-squares algorithms for temporal difference learning. Machine Learning, 2, 33-58.
4. Freund, Y., & Schapire, R. (1995). A decision-theoretic generalization of on-line learning and an application to boosting. Proc. of the Second European Conference on Computational Learning Theory. LNCS.
5. Keller, P., Mannor, S., & Precup, D. (2006). Automatic basis function construction for approximate dynamic programming and reinforcement learning. Proceedings of the Twenty-third International Conference on Machine Learning.
6. Koller, D., & Parr, R. (1999). Computing factored value functions for policies in structured MDPs. Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence (IJCAI-99) (pp. 1332-1339). Morgan Kaufmann.
7. Lagoudakis, M., & Parr, R. (2003). Least squares policy iteration. Journal of Machine Learning Research, 4, 1107-1149.
8. Mahadevan, S., & Maggioni, M. (2006). Proto-value functions: A Laplacian framework for learning representation and control in Markov decision processes (Technical Report 2006-35). University of Massachusetts, Amherst.
9. Mallat, S. G., & Zhang, Z. (1993). Matching pursuits with time-frequency dictionaries. IEEE Transactions on Signal Processing, 41.
10. Menache, I., Mannor, S., & Shimkin, N. (2005). Basis function adaptation in temporal difference reinforcement learning. Annals of Operations Research, 134.
11. Munos, R. (2003). Error bounds for approximate policy iteration. Proceedings of the Twentieth International Conference on Machine Learning.
12. Sutton, R. S. (1988). Learning to predict by the methods of temporal differences. Machine Learning, 3, 9-44.
13. Van Roy, B. (1998). Learning and value function approximation in complex decision processes. Doctoral dissertation, Massachusetts Institute of Technology.
14. Vapnik, V., Golowich, S., & Smola, A. (1997). Support vector method for function approximation, regression estimation, and signal processing. Advances in Neural Information Processing Systems 9 (pp. 281-287). Cambridge, MA: MIT Press.
15. Yu, H., & Bertsekas, D. (2006). Convergence results for some temporal difference methods based on least squares (Technical Report LIDS-2697). Laboratory for Information and Decision Systems, Massachusetts Institute of Technology.