Improving approximate value iteration using memories and predictive state representations

Proceedings of the National Conference on Artificial Intelligence

Volumn 1, Issue , 2006, Pages 375-381

  James, Michael R ^a   Wessling, Ton ^b   Vlassis, Nikos ^b  

^a TOYOTA TECHNICAL CENTER   (United States)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

DYNAMICAL SYSTEMS; EXECUTION TIME; MEMORY PSRS (MPSRS); PREDICTIVE STATE REPRESENTATIONS (PSRS);

ARTIFICIAL INTELLIGENCE; MARKOV PROCESSES; PLANNING; PUBLIC POLICY; TECHNOLOGY; VALUE ENGINEERING;

ITERATIVE METHODS;

EID: 33750704593     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Cassandra, A. 1999. Tony's pomdp page. http://www.cs.brown.edu/research/ ai/pomdp/index.html.
2. Izadi, M. T.; Rajwade, A. V.; and Precup, D. 2005. Using core beliefs for point-based value iteration. In IJCAI.
3. Jaeger, H. 2000. Observable operator processes and conditioned continuation representations. Neural Computation 12(6):1371-1398.
4. James, M. R., and Singh, S. 2005. Planning in models that combine memory with predictive representations of state. In 20th National Conference on Artificial Intelligence.
5. James, M. R.; Singh, S.; and Littman, M. L. 2004. Planning with predictive state representations. In The 2004 International Conference on Machine Learning and Applications.
6. James, M. R.; Singh, S.; and Wolfe, B. 2005. Combining memory and landmarks with predictive state representations. In The 2005 International Joint Conference on Artificial Intelligence.
7. Littman, M. L.; Sutton, R. S.; and Singh, S. 2001. Predictive representations of state. In Advances In Neural Information Processing Systems 14.
8. Pineau, J.; Gordon, G.; and Thrun, S. 2003. Point-based value iteration: An anytime algorithm for POMDPs. In Proc. 18th Int. Joint Conf. on Artificial Intelligence.
9. Shani, G.; Brafman, R.; and Shimony, S. 2005. Model-based online learning of POMDPs. In ECML.
10. Singh, S.; James, M. R.; and Rudary, M. R. 2004. Predictive state representations, a new theory for modeling dynamical systems. In 20th Conference on Uncertainty in Artificial Intelligence.
11. Spaan, M., and Vlassis, N. 2005. Perseus: Randomized point-based value iteration for pomdps. Journal of Artificial Intelligence Research 24:195-220.
12. Sutton, R. S., and Tanner, B. 2004. Temporal-difference networks. In Advances in Neural Information Processing Systems 17.
13. Wolfe, B.; James, M. R.; and Singh, S. 2005. Learning predictive state representations in dynamical systems without reset. In 22nd International Conference on Machine Learning.