Representation policy iteration

Proceedings of the 21st Conference on Uncertainty in Artificial Intelligence, UAI 2005

Volumn , Issue , 2005, Pages 372-379

  Mahadevan, Sridhar ^a  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; ARTIFICIAL INTELLIGENCE; EIGENVALUES AND EIGENFUNCTIONS; FOURIER ANALYSIS; FUNCTIONS; MARKOV PROCESSES; TOPOLOGY;

APPROXIMATE VALUE FUNCTION; APPROXIMATION METHODS; CONSTRUCTIVE METHODS; LARGE-SCALE TOPOLOGY; MARKOV DECISION PROCESSES; OPTIMAL POLICIES; RIEMANNIAN MANIFOLD; VALUE FUNCTION APPROXIMATION;

ITERATIVE METHODS;

EID: 34547966269     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. S. Axler, P. Bourdon, andW. Ramey. Harmonic Function Theory. Springer, 2001.
2. M. Belkin and P. Niyogi. Semi-supervised learning on Riemannian manifolds. Machine Learning, 56:209-239, 2004.
3. C. Boutilier, T. Dean, and S. Hanks. Decisiontheoretic planning: Structural assumptions and com-putational leverage. Journal of Artificial Intelligence Research, 11:1-94, 1999. (Pubitemid 129628760)
4. F. Chung. Spectral Graph Theory. American Mathematical Society, 1997.
5. R. Coifman and M Maggioni. Diffusion wavelets. Technical Report Tech. Rep. YALE/DCS/TR-1303, Yale University, 2004. to appear in Appl. Comp. Harm. Anal.
6. C. Guestrin, D. Koller, R. Parr, and S. Venkataraman. Efficient solution algorithms for factored MDPs. Journal of AI Research, 19:399-468, 2003. (Pubitemid 41525926)
7. D. Koller and R. Parr. Policy iteration for factored MDPs. In Proceedings of the 16th Conference on Uncertainty in AI, 2000.
8. M. Lagoudakis and R. Parr. Least-squares policy iteration. Journal of Machine Learning Research, 4:1107-1149, 2003.
9. M. Maggioni and S. Mahadevan. Fast direct policy evaluation using multiscale analysis of markov diffusion processes, 2005. Submitted to NIPS.
10. S. Mahadevan. Proto-value functions: Developmental reinforcement learning. In Proceedings of the 22nd International Conference on Machine Learning, 2005.
11. S. Mahadevan. Samuel meets Amarel: Automating value function approximation using global state space analysis. In National Conference on Artificial Intelligence (AAAI), 2005.
12. S. Mahadevan and M. Maggioni. Value function approximation using diffusion wavelets and laplacian eigenfunctions, 2005. Submitted to NIPS.
13. N. Menache, N. Shimkin, and S. Mannor. Basis function adaptation in temporal difference reinforcement learning. Annals of Operations Research, 134:215-238, 2005. (Pubitemid 40550047)
14. A. Ng, M. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. In NIPS, 2002.
15. R. Patrascu, P. Poupart, D. Schuurmans, C. Boutilier, and C. Guestrin. Greedy linear value function approximation for factored markov decision processes. In AAAI, 2002.
16. M. L. Puterman. Markov decision processes. Wiley Interscience, New York, USA, 1994.
17. S Rosenberg. The Laplacian on a Riemannian Manifold. Cambridge University Press, 1997.
18. J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE PAMI, 22:888-905, 2000.
19. R. Sutton and A. G. Barto. An Introduction to Reinforcement Learning. MIT Press, 1998.