On discovery and learning of models with predictive representations of state for agents with continuous actions and observations

Proceedings of the International Conference on Autonomous Agents

Volumn , Issue , 2007, Pages 1136-1143

  Wingate, David ^a   Singh, Satinder ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Dynamical system modeling; Information theory; Predictive representations of state

Indexed keywords

CONTINUOUS OBSERVATIONS; KERNEL DENSITY ESTIMATIONS; MATRIXES; MODEL PARAMETERS; MODELING METHODS; PREDICTIVE REPRESENTATIONS OF STATE; PREDICTIVE STATE REPRESENTATIONS; SUFFICIENT STATISTICS; SYSTEM DYNAMICS;

AGENTS; AUTONOMOUS AGENTS; DYNAMICAL SYSTEMS; DYNAMICS; FUZZY CLUSTERING; INFORMATION THEORY; UNCERTAIN SYSTEMS;

LEARNING ALGORITHMS;

EID: 60349110114     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1329125.1329352     Document Type: Conference Paper

References (18)

1. T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley-Interscience, 1991.
2. Y. Engel, S. Mannor, and R. Meir. Bayes meets bellman: The gaussian process approach to temporal difference learning. In ICML, 2003.
3. K. E. Hild, D. Erdogmus, and J. C. Principe. Blind source separation using renyi's mutual information. IEEE Signal Processing Letters, 8(6):174-176, 2001.
4. M. R. James and S. Singh. Learning and discovery of predictive state representations in dynamical systems with reset. In ICML, pages 417-424, 2004.
5. J. Kapur. Measures of Information and their Application. John Wiley, 1994.
6. M. L. Littman, R. S. Sutton, and S. Singh. Predictive representations of state. In NIPS, pages 1555-1561, 2002.
7. P. McCracken and M. Bowling. Online discovery and learning of predictive state representations. In NIPS, pages 875-882, 2006.
8. J. C. Principe, D. Xu, and J. W. Fisher. Information theoretic learning, pages 265-319, 1999.
9. E. J. Rafols, M. B. Ring, R. S. Sutton, and B. Tanner. Using predictive representations to improve generalization in reinforcement learning. In IJCAI, pages 835-840, 2005.
10. M. Rudary and S. Singh. Predictive linear-Gaussian models of controlled stochastic dynamical systems. In ICML, 2006.
11. M. Rudary, S. Singh, and D. Wingate. Predictive linear-Gaussian models of stochastic dynamical systems. In UAI, pages 501-508, 2005.
12. S. Singh, M. R. James, and M. R. Rudary. Predictive state representations: A new theory for modeling dynamical systems. In UAI, pages 512-519, 2004.
13. K. Tbrkkola. Feature extraction by non-parametric mutual information maximization. Journal of Machine Learning Research, (3):1415-1438, 2003.
14. E. Wiewiora. Learning predictive representations from a history. In ICML, pages 964-971, 2005.
15. D. Wingate and S. Singh. Kernel predictive linear Gaussian models for nonlinear stochastic dynamical systems. In ICML, 2006.
16. D. Wingate and S. Singh. Mixtures of predictive linear Gaussian models for nonlinear stochastic dynamical systems. In AAAI, 2006.
17. D. Wingate, V. Soni, B. Wolfe, and S. Singh. Relational knowledge with predictive representations of state. In IJCAI, 2007.
18. B. Wolfe, M. R. James, and S. Singh. Learning predictive state representations in dynamical systems without reset. In ICML, pages 980-987, 2005.