Episodic reinforcement learning by logistic reward-weighted regression

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5163 LNCS, Issue PART 1, 2008, Pages 407-416

  Wierstra, Daan ^a   Schaul, Tom ^a   Peters, Jan ^b   Schmidhuber, Juergen ^a,c  

^a DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^c TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE CONTROL; EXPECTATION-MAXIMIZATION ALGORITHMS; LOGISTIC REGRESSIONS; NONSTATIONARY; PARTIALLY OBSERVABLE MARKOV DECISION PROBLEMS; POLICY SEARCH; TRAINING ALGORITHMS; VALUE FUNCTIONS; WEIGHTED REGRESSION;

BACKPROPAGATION; EDUCATION; LEARNING ALGORITHMS; REGRESSION ANALYSIS; REINFORCEMENT; REINFORCEMENT LEARNING;

RECURRENT NEURAL NETWORKS;

EID: 58849088597     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-87536-9_42     Document Type: Conference Paper

References (15)

1. Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artificial Intelligence 101 (1998)
2. Aoki, M.: Optimization of Stochastic Systems. Academic Press, New York (1967)
3. Baxter, J., Bartlett, P.: Infinite-horizon policy-gradient estimation. Journal of Artificial Intelligence Research 15, 319-350 (2001)
4. Wierstra, D., Foerster, A., Peters, J., Schmidhuber, J.: Solving deep memory pomdps with recurrent policy gradients. In: de Sá, J.M., Alexandre, L.A., Duch, W., Mandic, D.P. (eds.) ICANN 2007. LNCS, vol. 4668, pp. 697-706. Springer, Heidelberg (2007)
5. Peters, J., Schaal, S.: Reinforcement learning by reward-weighted regression for operational space control. In: Proceedings of the International Conference on Machine Learning (ICML) (2007)
6. Dayan, P., Hinton, G.E.: Using expectation-maximization for reinforcement learning. Neural Computation 9(2), 271-278 (1997)
7. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Computation 9(8), 1735-1780 (1997)
8. Hochreiter, S., Bengio, Y., Frasconi, P., Schmidhuber, J.: Gradient flow in recurrent nets: the difficulty of learning long-term dependencies. In: Kremer, S.C., Kolen, J.F. (eds.) A Field Guide to Dynamical Recurrent Neural Networks. IEEE Press, Los Alamitos (2001)
9. Schmidhuber, J.: RNN overview (2004), http://www.idsia.ch/~juergen/rnn. html
10. Werbos, P.: Back propagation through time: What it does and how to do it. Proceedings of the IEEE 78, 1550-1560 (1990)
11. Chernoff, H., Moses, L.E.: Elementary Decision Theory. Dover Publications (1987)
12. Kleinbaum, D.G., Klein, M., Pryor, E.R.: Logistic Regression, 2nd edn. Springer, Heidelberg (2002)
13. James, M.R., Singh, S., Littman, M.L.: Planning with predictive state representations. In: Proceedings 2004 International Conference on Machine Learning and Applications, pp. 304-311 (2004)
14. Bowling, M., McCracken, P., James, M., Neufeld, J., Wilkinson, D.: Learning predictive state representations using non-blind policies. In: ICML 2006: Proceeding's of the 23rd international conference on Machine learning, pp. 129-136. ACM, New York (2006)
15. Bakker, B.: Reinforcement learning with long short-term memory. In: Advances in Neural Information Processing Syst., vol. 14 (2002)