Learning reaching strategies through reinforcement for a sensor-based manipulator

Neural Networks

Volumn 11, Issue 2, 1998, Pages 359-376

  Martín, Pedro ^a   Millán, José Del R ^b  

^a UNIVERSITAT JAUME I   (Spain)

^b JOINT RESEARCH CENTRE   (Italy)

Author keywords

Differential inverse kinematics; Multilink manipulators; Neural networks; Reaching strategies; Reactive systems; Reinforcement learning

Indexed keywords

CALCULATIONS; COLLISION AVOIDANCE; INVERSE KINEMATICS; MANIPULATORS; NEURAL NETWORKS; ROBOTIC ARMS; SENSORS;

DIFFERENTIAL INVERSE KINEMATICS; MANIPULATOR FORWARD KINEMATICS; MULTILINK MANIPULATORS; MULTILINK ROBOT ARM; REINFORCEMENT LEARNING;

LEARNING SYSTEMS;

ARTICLE; AVOIDANCE BEHAVIOR; FEEDBACK SYSTEM; LEARNING; NERVE CELL NETWORK; NONHUMAN; PRIORITY JOURNAL; REACTION ANALYSIS; REINFORCEMENT; ROBOTICS; SIMULATION; TASK PERFORMANCE;

EID: 0032029373     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(97)00137-8     Document Type: Article

References (19)

1. Baginski, B., & Eldracher, M. (1994). Path planning with neural subgoal search. In Proceedings of the IEEE World Congress on Computational Intelligence (pp. 2732-2736).
2. Barraquand J., Latombe J.C. Robot motion planning: a distributed representation approach. The International Journal of Robotics Research. 10:1991;628-649.
3. Barto A.G., Sutton R.S., Anderson C.W. Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man and Cybernetics. 13:1983;834-846.
4. Barto, A.G., Sutton, R.S. and Watkins, C.J.C.H. (1990). Learning and sequential decision making. In M. Gabriel and J.W. Moore (Eds.), Learning and computational neuroscience: foundations of adaptive networks (pp. 539-602). Cambridge, MA: MIT Press.
5. Brooks R.A. A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation. 2:1986;14-23.
6. Cichosz P. Truncating temporal differences: on the efficient implementation of TD(l) for reinforcement learning. Journal of Artificial Intelligence Research. 2:1995;287-318.
7. Cichosz, P. and Mulawka, J.J. (1995). Fast and efficient reinforcement learning with truncated temporal differences. In Proceedings of the 12th International Conference on Machine Learning (pp. 99-107). San Francisco: Morgan Kaufman.
8. Hwang Y.K., Ahuja N. Gross motion planning - a survey. ACM Computing Surveys. 24:1992;219-291.
9. Jordan M.I., Rumelhart D.E. Forward models: supervised learning with a distal teacher. Cognitive Science. 16:1992;307-354.
10. Khatib O. Real time obstacle avoidance for manipulators and mobile robots. The International Journal of Robotics Research. 5:1986;90-98.
11. Kindermann J., Linden A. Inversion of neural networks by gradient descent. Journal of Parallel Computing. 14:1992;277-286.
12. Lozano-Pérez T. A simple motion-planning algorithm for general robot manipulators. IEEE Journal of Robotics and Automation. 3:1987;224-238.
13. Millán J. del R. Reinforcement learning of goal-directed obstacle-avoiding reaction strategies in an autonomous mobile robot. Robotics and Autonomous Systems. 15:1995;275-299.
14. Millán J. del R. Rapid, safe and incremental learning of navigation strategies. IEEE Transactions on Systems, Man and Cybernetics - Part B. 26:1996;408-420.
15. Millán J. del R., Torras C. A reinforcement connectionist approach to robot path finding in non-maze-like environments. Machine Learning. 8:1992;363-395.
16. Sutton R.S. Learning to predict by the methods of temporal differences. Machine Learning. 3:1988;9-44.
17. Tham, C.K. and Prager, R.W. (1994). A modular Q-learning architecture for manipulator task decomposition. In Proceedings of the 11th International Conference on Machine Learning (pp. 309-317). San Francisco: Morgan Kaufman.
18. Whitney D. The mathematics of coordinated control of prosthetic arms and manipulators. ASME Journal of Dynamics Systems, Mathematics, and Control. 94:1972;303-309.
19. Williams R.J. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning. 8:1992;229-256.