Structure learning in ergodic factored MDPs without knowledge of the transition function's in-degree

Proceedings of the 28th International Conference on Machine Learning, ICML 2011

Volumn , Issue , 2011, Pages 737-744

  Chakraborty, Doran ^a   Stone, Peter ^a  

^a University of Texas at Austin   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EMPIRICAL RESULTS; ERGODICS; IN-DEGREE; MODEL-BASED OPC; PLANNING HORIZONS; PRIOR KNOWLEDGE; SAMPLE COMPLEXITY; STRUCTURE LEARNING ALGORITHM; STRUCTURE-LEARNING; TRANSITION FUNCTIONS;

LEARNING SYSTEMS;

LEARNING ALGORITHMS;

EID: 80053436895     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. Brafman, Ronen I. and Tennenholtz, Moshe. R-max - a general polynomial time algorithm for near-optimal reinforcement learning. Journal of Machine Learning Research, 3:213-231, 2003.
2. Degris, Thomas, Sigaud, Olivier, and Wuillemin, Pierre-Henri. Learning the structure of Factored Markov Decision Processes in reinforcement learning problems. In Proceedings of the 23rd International Conference on Machine learning' 06, pp. 257-264.
3. Diuk, Carlos, Li, Lihong, and Leffler, Bethany R. The adaptive k-meteorologists problem and its application to structure learning and feature selection in reinforcement learning. In Proceedings of the 26th International Conference on Machine Learning'09, pp. 249-256.
4. Guestrin, Carlos, Patrascu, Relu, and Schuurmans, Dale. Algorithm-directed exploration for model-based reinforcement learning in Factored MDPs. In Proceedings of the 19th International Conference on Machine Learning'02, pp. 235-242.
5. Guestrin, Carlos, Koller, Daphne, Parr, Ronald, and Venkataraman, Shobha. Efficient solution algorithms for Factored MDPs. Journal of the Artificial Intelligence Research, pp. 399-468, 2003.
6. Kearns, Michael and Singh, Satinder. Near-optimal reinforcement learning in polynomial time. Machine Learning, pp. 209-232, 2002.
7. Kearns, Michael J. and Koller, Daphne. Efficient reinforcement learning in Factored MDPs. In Proceedings of the 16th International Joint Conference on Artificial Intelligence' 99, pp. 740-747.
8. Strehl, Alexander L., Diuk, Carlos, and Littman, Michael L. Efficient structure learning in Factored-State MDPs. In Proceedings of the 22nd National Conference on Artificial intelligence, pp. 645-650.
9. Sutton, Richard S. and Barto, Andrew G. Reinforcement Learning: An Introduction. MIT Press, 1998.