Robot arm reaching through neural inversions and reinforcement learning

Robotics and Autonomous Systems

Volumn 31, Issue 4, 2000, Pages 227-246

  Martín, Pedro ^a   Millán, José Del R ^b  

^a UNIVERSITAT JAUME I   (Spain)

^b JOINT RESEARCH CENTRE   (Italy)

Author keywords

Differential inverse kinematics; Neural networks; Reaching motions; Redundant manipulators; Reinforcement learning

Indexed keywords

EID: 0000056079     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0921-8890(99)00100-1     Document Type: Article

References (39)

1. A. Ahmad, A. Guez, On the solution to the inverse kinematics problem, in: Proceedings of the IEEE International Conference on Robotics and Automation, Cincinnati, OH, 1990, pp. 1692-1697.
2. J. Baillieul, Kinematic programming alternatives for redundant manipulators, in: Proceedings of the IEEE International Conference on Robotics and Automation, St. Louis, MO, 1985, pp. 722-728.
3. D.R. Baker, C.W. Wampler, On the inverse kinematics of redundant manipulators, International Journal of Robotics Research 7 (1988) 3-21.
4. A.G. Barto, R.S. Sutton, C.W. Anderson, Neuronlike adaptive elements that can solve difficult learning control problems, IEEE Transactions on Systems, Man, and Cybernetics 13 (1983) 834-846.
5. A.G. Barto, R.S. Sutton, C.J.C.H. Watkins, Learning and sequential decision making, in: M. Gabriel, J.W. Moore (Eds.), Learning and Computational Neuroscience: Foundations of Adaptive Networks, MIT Press, Cambridge, MA, 1990, pp. 539-602.
6. D. Bullock, S. Grossberg, F.H. Guenther, A self-organizing neural model of motor equivalent reaching and tool use by a multijoint arm, Journal of Cognitive Neuroscience 5 (1993) 408-435.
7. P. Chiacchio, S. Chiaverini, L. Sciavicco, B. Siciliano, Closed-loop inverse kinematics schemes for constrained redundant manipulators with task space augmentation and task priority strategy, International Journal of Robotics Research 10 (1991) 410-424.
8. H. Cruse, Constraints for joint angle control of the human arm, Biological Cybernetics 54 (1986) 125-132.
9. H. Cruse, M. Brüwer, The human arm as a redundant manipulator: The control of path and joint angles, Biological Cybernetics 57 (1987) 137-144.
10. H. Cruse, M. Brúwer, J. Dean, Control of three- and four-joint arm movement: Strategies for a manipulator with redundant degrees of freedom, Journal of Motor Behavior 25 (1993) 131-139.
11. J. Dean, M. Brúwer, Control of human arm movements in two dimensions: Paths and joint control in avoiding simple linear obstacles, Experimental Brain Research 97 (1994) 497-514.
12. D. DeMers, K. Kreutz-Delgado, Inverse kinematics of dextrous manipulators, in: O. Omidvar, P. van der Smagt (Eds.), Neural Systems for Robotics, Academic Press, San Diego, CA, 1997, pp. 75-116.
13. H. Ding, S.K. Tso, Minimum infinity-norm kinematic solution for redundant robots using neural networks, in: Proceedings of the IEEE International Conference on Robotics and Automation, Leuven, Belgium, 1998, pp. 1719-1724.
14. J.C. Fiala, Neural network models of motor timing and coordination, Ph.D. Thesis, Boston University, 1995.
15. F.H. Guenther, A neural network model of speech acquisition and motor equivalent speech production, Biological Cybernetics 72 (1994) 43-53.
16. F.H. Guenther, D.M. Barreca, Neural models for flexible control of redundant systems, in: P.G. Morasso, V. Sanguineti (Eds.), Self-organization, Computational Maps and Motor Control, Elsevier, Amsterdam, 1997, pp. 383-421.
17. J.J. Hopfield, D. Tank, Computing with neural circuits: A model, Science 233 (1986) 624-633.
18. M.I. Jordan, D.E. Rumelhart, Forward models: Supervised learning with a distal teacher, Cognitive Science 16 (1992) 307-354.
19. O. Khatib, Real time obstacle avoidance for manipulators and mobile robots, The International Journal of Robotics Research 5 (1986) 90-98.
20. J. Kindermann, A. Linden, Inversion of neural networks by gradient descent, Journal of Parallel Computing 14 (1992) 277-286.
21. M. Kuperstein, Neural model of adaptive hand-eye coordination for single postures, Science 239 (1988) 1308-1311.
22. S. Lee, R.M. Kil, Redundant arm kinematic control with recurrent loop, Neural Networks 7 (1994) 643-659.
23. A. Liegeois, Automatic supervisory control for the configuration and behavior of multibody mechanisms, IEEE Transactions on System, Man, and Cybernetics 7 (1977) 868-871.
24. P. Martín, J. del R. Millán, Reinforcement learning of sensor-based reaching strategies for a two-link manipulator, in: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Osaka, Japan, 1996, pp. 1345-1352.
25. P. Martín, J. del R. Millán, A modular reinforcement-based neural controller for a three-link manipulator, in: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Grenoble, France, 1997, pp. 785-791.
26. P. Martín, J. del R. Millán, Learning reaching strategies through reinforcement for a sensor-based manipulator, Neural Networks 11 (1998) 359-376.
27. P. Martín, J. del R. Millán, Reinforcement learning of collision-free motions for a robot arm with a sensing skin, in: Proceedings of the Eighth International Conference on Artificial Neural Networks, 1998, pp. 1109-1114.
28. J. Moody, C.J. Darken, Fast learning in networks of locally-tuned processing units, Neural Computation 1 (1989) 281-294.
29. P. Morasso, Spatial control of arm movements, Experimental Brain Research 42 (1981) 223-227.
30. A. Ramdane-Cherif, D.Y. Meddah, V. Perdereau, M. Drouin, Inverse kinematic solution based on Lyapunov function for redundant and non-redundant robots, in: Proceedings of the IEEE International Symposium on Computational Intelligence in Robotics and Automation, 1997, pp. 226-231.
31. D.A. Rosenbaum, S.E. Engelbrecht, M.M. Bushe, L.D. Loukopoulos, Knowledge model for selecting and producing reaching movements, Journal of Motor Behavior 25 (1993) 217-227.
32. V. Ruiz de Angulo, C. Torras, Self-calibration of a space robot, IEEE Transactions on Neural Networks 8 (1997) 951-963.
33. P.N. Sabes, M.I. Jordan, Obstacle avoidance and a perturbation sensitivity model for motor planning, Journal of Neuroscience 17 (1997) 7119-7128.
34. L. Sciavicco, B. Siciliano, Modeling and Control of Robot Manipulators, McGraw-Hill, New York, 1996, pp. 88-105.
35. J.F. Soechting, C.A. Buneo, U. Herrmann, M. Flanders, Moving effortlessly in three dimensions: Does Donders' law apply to arm movement?, Journal of Neuroscience 15 (1995) 6271-6280.
36. R.S. Sutton, Learning to predict by the methods of temporal differences, Machine Learning 3 (1988) 9-44.
37. J.A. Walter, K.J. Schulten, Implementation of self-organizing neural networks for visuo-motor control of an industrial robot, IEEE Transactions on Neural Networks 4 (1993) 86-96.
38. D. Whitney, The mathematics of coordinated control of prosthetic arms and manipulators, ASME Journal of Dynamics Systems, Mathematics, and Control 94 (1972) 303-309.
39. R.J. Williams, Simple statistical gradient-following algorithms for connectionist reinforcement learning, Machine Learning 8 (1992) 229-256.