Learning predictive state representations in dynamical systems without reset

ICML 2005 - Proceedings of the 22nd International Conference on Machine Learning

Volumn , Issue , 2005, Pages 985-992

  Wolfe, Britton ^a   James, Michael R ^a   Singh, Satinder ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EM ALGORITHM; PREDICTIVE STATE REPRESENTATIONS (PSRS); PSR-MODEL LEARNING ALGORITHM;

ALGORITHMS; COMPUTER SIMULATION; DISCRETE TIME CONTROL SYSTEMS; MATHEMATICAL MODELS; SYSTEMS ANALYSIS;

LEARNING SYSTEMS;

EID: 31844453029     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. Cassandra, A. (1999). Tony's pomdp file repository page, http://www.cs.brown.edu/research/ai/pomdp/examples/index.html.
2. Jaeger, H. (1998). Discrete-time, discrete-valued observable operator models: A tutorial (Technical Report 42). German National Research Center for Information Technology.
3. James, M. R., & Singh, S. (2004). Learning and discovery of predictive state representations in dynamical systems with reset. Proceedings of ICML 2004 (pp. 417-424).
4. Littman, M. L., Sutton, R. S., & Singh, S. (2002). Predictive representations of state. In Advances in neural information processing systems 14, 1555-1561.
5. Murphy, K. (2004). Hidden markov model (hmm) toolbox for matlab. http://www.ai.mit.edu/~murphyk/Software/HMM/hmm.html.
6. Rosencrantz, M., Gordon, G., & Thrun, S. (2004). Learning low dimensional predictive representations. Proceedings of ICML 2004 (pp. 695-702).
7. Rudary, M., & Singh, S. (2004). A nonlinear predictive state representation. In Advances in neural information processing systems 16, 791-798.
8. Singh, S., James, M. R., & Rudary, M. (2004). Predictive state representations: A new theory for modeling dynamical systems. Proceedings of UAI 2004 (pp. 512-519).
9. Singh, S., Littman, M., Jong, N., Pardoe, D., & Stone, P. (2003). Learning predictive state representations. Proceedings of ICML 2003 (pp. 712-719).
10. Singh, S., & Sutton, R. S. (1996). Reinforcement learning with replacing eligibility traces. Machine Learning, 22, 123-158.
11. Sutton, R. S., & Tanner, B. (2005). Temporal-difference networks. In Advances in neural information processing systems 17, 1377-1384.