System identification based on online variational bayes method and its application to reinforcement learning

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2714, Issue , 2003, Pages 123-131

  Yoshimoto, Junichiro ^a,b   Ishii, Shin ^a,b   Sato, Masa Aki ^a,c  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^b NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^c ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; FREE ENERGY; LEARNING ALGORITHMS; NEURAL NETWORKS; RELIGIOUS BUILDINGS; STATE SPACE METHODS;

ITS APPLICATIONS; LINE FREE ENERGIES; LINEAR STATE SPACE MODEL; PARTIALLY OBSERVABLE ENVIRONMENTS; REINFORCEMENT LEARNING METHOD; SYSTEM IDENTIFICATION METHODS; VARIATIONAL BAYES; VARIATIONAL-BAYES METHOD;

REINFORCEMENT LEARNING;

EID: 33646231363     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-44989-2_16     Document Type: Article

References (8)

1. Attias, H.: A variational Bayesian framework for graphical models, Advances in Neural Information Processing Systems 12, pp. 206-212 (2000).
2. Dempster, A. P. et al.: Maximum likelihood from incomplete data via the EM algorithm, Journal of Royal Statistical Society B, Vol. 39, pp. 1-38 (1977).
3. Früwirth-Schnatter, S.: Bayesian model descrimination and Bayes factors for linear Gaussian state space models, Journal of Royal Statistical Society B, Vol. 57, pp. 237-246 (1995).
4. Ghahramani, Z. and Beal, M. J.: Propagation Algorithms for Variational Bayesian Learning, Advances in Neural Information Processing Systems 13 (2001).
5. Konda, V. R.: Actor-Critic Algorithms, PhD Thesis, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology (2002).
6. Roweis, S. and Ghahramani, Z.: A Unifying Review of Linear Gaussian Models, Neural Computation, Vol. 11, pp. 305-345 (1999).
7. Sato, M.: Online model selection based on the variational Bayes, Neural Computation, Vol. 13, No. 7, pp. 1649-1681 (2001).
8. Singh, S. P. et al.: Learning without state-estimation in partially observable Markovian decision processes, Proceedings of the 11th International Conference on Machine Learning, pp. 284-292 (1994).