Feedforward neural networks in reinforcement learning applied to high-dimensional motor control

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2533, Issue , 2002, Pages 403-413

  Coulom, Rémi ^a  

^a Laboratoire Leibniz IMAG   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION ALGORITHMS; GRADIENT METHODS; MACHINE LEARNING; REINFORCEMENT LEARNING;

ARTICULATED ROBOTS; BACKPROPAGATION NETWORK; CONTROL VARIABLE; GRADIENT DESCENT; HIGH-DIMENSIONAL; HIGH-DIMENSIONAL PROBLEMS; INDEPENDENT STATE; LOW DIMENSIONAL;

FEEDFORWARD NEURAL NETWORKS;

EID: 84942750244     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-36169-3_32     Document Type: Conference Paper

References (22)

1. Charles W. Anderson. Strategy learning with multilayer connectionist representations. In Proceedings of the Fourth International Workshop on Machine Learning, pages 103–114, Irvine, CA, 1987. Morgan Kaufmann.
2. Andrew R. Barron. Universal approximation bounds for superpositions of a sigmoidal function. IEEE Transactions on Information Theory, 39(3):930–945, Maym 1993.
3. Richard Bellman. Dynamic Programming. Princeton University Press, Princeton, New Jersey, 1957.
4. Dimitri P. Bertsekas and John N. Tsitsiklis. Neuro-Dynamic Programming. Athena Scientific, Belmont, MA, 1996.
5. Christopher M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, 1995.
6. Kenji Doya. Reinforcement learning in continuous time and space. Neural Computation, 12:243–269, 2000.
7. Scott E. Fahlman. An empirical study of learning speed in back-propagation networks. Technical Report CMU-CS-88-162, Carnegie-Mellon University, 1988.
8. Leslie Pack Kaelbling, Michael L. Littman, and Andrew W. Moore. Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4:237–285, 1996.
9. Yann Le Cun, Leon Bottou, Genevieve B. Orr, and Klaus-Robert Müller. Efficient BackProp. In Genevieve B. Orr and Klaus-Robert M¨uller, editors, Neural Networks: Tricks of the Trade. Springer, 1998.
10. Martin F. Møller. A scaled conjugate gradient algorithm for fast supervised learning. Neural Networks, 6:525–533, 1993.
11. Jun Morimoto and Kenji Doya. Hierarchical reinforcement learning of lowdimensional subgoals and high-dimensional trajectories. In Proceedings of the Fifth International Conference on Neural Information Processing, pages 850–853, 1998.
12. Ralph Neuneier and Hans-Georg Zimmermann. How to train neural networks. In Genevieve B. Orr and Klaus-Robert M¨uller, editors, Neural Networks: Tricks of the Trade. Springer, 1998.
13. Genevieve B. Orr and Todd K. Leen. Using curvature information for fast stochastic search. In Advances in Neural Information Processing Systems 9. MIT Press, 1997.
14. Martin Riedmiller and Heinrich Braun. A direct adaptive method for faster backpropagation learning: The RPROP algorithm. In Proceedings of the IEEE International Conference on Neural Networks, 1993.
15. Stefan Schaal and Christopher G. Atkeson. Robot juggling: An implementation of memory-based learning. Control Systems Magazine, 14:57–71, 1994.
16. Stefan Schaal, Christopher G. Atkeson, and Sethu Vijayakumar. Real-time robot learning with locally weighted statistical learning. In International Conference on Robotics and Automation (ICRA2000), 2000.
17. Nicol N. Schraudolph. Local gain adaptation in stochastic gradient descent. In Proceedings of the 9th International Conference on Artificial Neural Networks, London, 1999. IEE.
18. Richard S. Sutton. Learning to predict by the methods of temporal differences. Machine Learning, 3:9–44, 1988.
19. Richard S. Sutton. Generalization in reinforcement learning: Successful examples using sparse coarse coding. In Advances in Neural Information Processing Systems 8, pages 1038–1044. MIT Press, 1996.
20. Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998.
21. Gerald Tesauro. Temporal difference learning and TD-Gammon. Communications of the ACM, 38(3):58-68, March 1995.
22. Scott E. Weaver, Leemon C. Baird, and Marios M. Polycarpou. Preventing unlearning during on-line training of feedforward networks. In Proceedings of the International Symposium of Intelligent Control, 1998.