Reinforcement learning with via-point representation

Neural Networks

Volumn 17, Issue 3, 2004, Pages 299-305

  Miyamoto, Hiroyuki ^a,b   Morimoto, Jun ^c   Doya, Kenji ^c   Kawato, Mitsuo ^c  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^b KYUSHU INSTITUTE OF TECHNOLOGY   (Japan)

^c ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

Author keywords

Cart pole; Hierarchical reinforcement learning; Motor control; Robotics; Swing up; Via point

Indexed keywords

COMPUTER SIMULATION; HIERARCHICAL SYSTEMS; NEURAL NETWORKS; ROBOT APPLICATIONS;

MOTOR CONTROL; SPATIAL SCALES;

LEARNING SYSTEMS;

ANALYTICAL ERROR; ARCHITECTURE; ARTICLE; COMPUTER SIMULATION; LEARNING; MATHEMATICAL ANALYSIS; MOTOR CONTROL; PRIORITY JOURNAL; REINFORCEMENT; ROBOTICS;

COMPUTER SIMULATION; FEEDBACK, PSYCHOLOGICAL; HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REINFORCEMENT (PSYCHOLOGY);

EID: 1642352667     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2003.11.004     Document Type: Article

References (22)

1. Atkeson C.G., Schaal S. Learning tasks from a single demonstration. In IEEE International Conference on Robotics and Automation. 2:1997;1706-1712.
2. Atkeson, C. G., & Schaal, S (1997) Robot learning from demonstration. In International Conference on Machine Learning (ICML97).
3. Barto A.G., Sutton R.S., Anderson C.W. Neuronlike adaptive elements that can solve difficult learning control problems. In IEEE Transactions on Systems, Man, and Cybernetics. 3:1983;834-846.
4. Doya K. Temporal difference learning in continuous time and space. Touretzky D.S., Mozer M.C., Hasselmo M.E. Advances in neural information processing systems. 8:1996;1073-1079 MIT Press, Cambridge, MA.
5. Doya K. Efficient nonlinear control with actor-tutor architecture. Mozer M.C., Jordan M.I. Advances in neural information processing systems. 9:1997;1012-1018 MIT Press, Cambridge, MA.
6. Doya K. Reinforcement learning in continuous time and space. Neural Computation. 12:2000;243-269.
7. Flash T., Hogan N. The coordination of arm movements: An experimentally confirmed mathematical model. Journal of Neuroscience. 5:1985;1688-1703.
8. Gullapalli V. A stochastic reinforcement learning algorithm for learning real-valued functions. Neural Networks. 3:1990;671-692.
9. Harris C.M., Wolpert D.M. Signal-dependent noise determines motor planning. Nature. 394:(20):1998;780-784.
10. Hoff B., Arbib M.A. Models of trajectory formation and temporal interaction of reach and grasp. Journal of Motor Behavior. 25:(3):1993;175-192.
11. Kawato M. Optimization and learning in neural networks for formation and control of coordinated movement. Meyer D., Kornblum S. Attention and performance, XIV: synergies in experimental psychology, artificial intelligence, and cognitive neuroscience - A silver jubilee. 1992;821-849 MIT Press, Cambridge, MA.
12. McGovern, A., Sutton, R.S (1998) Macro-actions in reinforcement learning: An empirical analysis. Technical Report 98-70, University of Massachusetts, Department of Computer Science.
13. McGovern A., Precup A.D., Ravindran B., Singh S., Sutton R.S. Hierarchical optimal control of MDPs. In Proceedings of the Tenth Yale Workshop on Adaptive and Learning Systems. 1998;. pp. 186-191.
14. Miyamoto H., Kawato M. A tennis serve and upswing learning robot based on dynamic optimization theory. Neural Networks. 11:(7-8):1998;1331-1344.
15. Miyamoto H., Schaal S., Gandolfo F., Gomi H., Koike Y., Osu R., Nakano E., Wada Y., Kawato M. A Kendama learning robot based on dynamic optimization theory. Neural Networks. 9:(8):1996;1281-1302.
16. Morimoto J., Doya K. Reinforcement learning of dynamic motor sequence: learning to stand up. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. 3:1998;1721-1726.
17. Schaal S. Is imitation learning the way to humanoid robots? Trends in Cognitive Sciences. 3:(6):1999;233-242.
18. Sutton R.S., Barto A.G. Reinforcement learning, an introduction. A Bradford Book. 1998;MIT Press, Cambridge, MA.
19. Todorov, E. V (1998) Studies of goal directed movements. PhD thesis. Massachusetts Institute of Technology.
20. Uno Y., Kawato M., Suzuki R. Formation and control of optimal trajectory in human multijoint arm movement - minimum torque-change model. Biological Cybernetics. 61:1989;89-101.
21. Uno Y., Suzuki R., Kawato M. Minimum muscle-tension-change model which reproduces human arm movement. Proceedings of the 4th Symposium on Biological and Physiological Engineering. 1989;. in Japanese.
22. Wada Y., Kawato M. A neural network model for arm trajectory formation using forward and inverse dynamics models. Neural Networks. 6:(7):1993;919-932.