Planning with predictive state representations

Proceedings of the 2004 International Conference on Machine Learning and Applications, ICMLA '04

Volumn , Issue , 2004, Pages 304-311

  James, Michael R ^a   Singh, Satinder ^b   Littman, Michael L ^b  

^a UNIVERSITY OF MICHIGAN   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INCREMENTAL PRUNING (IP) ALGORITHMS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESSES (POMDP); PREDICTIVE STATE REPRESENTATION (PSR) MODELS; Q-LEARNING ALGORITHMS; STOCHASTIC DYNAMICAL SYSTEMS;

APPROXIMATION THEORY; DECISION THEORY; DISCRETE TIME CONTROL SYSTEMS; ITERATIVE METHODS; MARKOV PROCESSES; MATHEMATICAL MODELS; PROBABILITY; SET THEORY; STOCHASTIC CONTROL SYSTEMS;

LEARNING ALGORITHMS;

EID: 21244494809     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. J.S. Albus. A theory of cerebellar function. Mathematical Biosciences, 10:25-61, 1971.
2. A. Cassandra. Tony's pomdp page. http://www.cs.brown.edu/research/ai/ pomdp/index.html, 1999.
3. Anthony Cassandra, Michael L. Littman, and Nevin L. Zhang. Incremental Pruning: A simple, fast, exact method for partially observable Markov decision processes. In Dan Geiger and Prakash Pundalik Shenoy, editors, Proceedings of the Thirteenth Annual Conference on Uncertainty in Artificial Intelligence (UAI-97), pages 54-61, San Francisco, CA, 1997. Morgan Kaufmann Publishers.
4. Anthony R. Cassandra, Leslie Pack Kaelbling, and Michael L. Littman. Acting optimally in partially observable stochastic domains. In Proceedings of the Twelfth National Conference on Artificial Intelligence (AAAI-94), volume 2, pages 1023-1028, Seattle, Washington, USA. 1994. AAAI Press/MIT Press.
5. R. H. Crites and Andrew G. Barto. Improving elevator performace using reinforcement learning. In Advances in Neural Information Processing Systems: Proceedings of the 1995 Conference, pages 1017-1023, 1996.
6. Masoumeh T. Izadi and Doina Precup. A planning algorithm for predictive state representations. In Eighteenth International Joint Conference on Artificial Intelligence, 2003.
7. Michael L. Littman, Richard S. Sutton, and Satinder Singh. Predictive representations of state. In Advances In Neural Information Processing Systems 14, 2001.
8. Michael Lederman Littman. Algorithms for sequential decision making. Technical Report CS-96-09, 1996.
9. Satinder Singh, Michael L. Littman, Nicholas K. Jong, David Pardoe, and Peter Stone. Learning predictive state representations. In The Twentieth International Conference, on Machine Learning (ICML-2003), 2003.
10. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: an introduction. MIT press, 1998.
11. Gerald Tesauro. Td-gammon, a self-teaching backgammon program, achieves master-level play. Communications of the ACM, 38:58-68, 1995.
12. C.J.C.H. Watkins. Learning from Delayed Rewards. PhD thesis, Cambridge University, 1989.
13. Nevin L. Zhang and Wenju Liu. Planning in stochastic domains: Problem characteristics and approximation. Technical Report HKUST-CS96-31, 1996.