Learning at the level of synergies for a robot weightlifter

Robotics and Autonomous Systems

Volumn 54, Issue 8, 2006, Pages 706-717

  Rosenstein, Michael T ^a   Barto, Andrew G ^a   Van Emmerik, Richard E A ^b  

^a University of Massachusetts Amherst   (United States)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

Coordination; Exploiting dynamics; Optimization; Robot learning; Synergy

Indexed keywords

COMPUTER CONTROL SYSTEMS; DEGREES OF FREEDOM (MECHANICS); KINEMATICS; LEARNING SYSTEMS; MOBILE ROBOTS; OPTIMIZATION;

COORDINATION; EXPLOITING DYNAMICS; ROBOT MOTOR COORDINATION; SYNERGY;

ROBOT APPLICATIONS;

EID: 33746556861     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2006.03.002     Document Type: Article

References (35)

1. Anderson R.W. Biased random-walk learning: A neurobiological correlate to trial-and-error. In: Omidvar O., and Dayhoff J. (Eds). Neural Networks and Pattern Recognition (1998), Academic Press, San Diego, CA 221-244
2. Barto A.G., Fagg A.H., Sitkoff N., and Houk J.C. A cerebellar model of timing and prediction in the control of reaching. Neural Computation 11 3 (1999) 565-594
3. Bernstein N.A. The Co-ordination and Regulation of Movements (1967), Pergamon Press, Oxford
4. Bernstein N.A. On dexterity and its development. In: Latash M.L., and Turvey M.T. (Eds). Dexterity and Its Development (1996), Lawrence Erlbaum Associates, Mahwah, NJ 1-244
5. Berthier N.E., Rosenstein M.T., and Barto A.G. Approximate optimal control as a model for motor learning. Psychological Review 112 (2005) 329-346
6. Berthouze L., and Lungarella M. Motor skill acquisition under environmental perturbations: On the necessity of alternate freezing and freeing of degrees of freedom. Adaptive Behavior 12 1 (2004) 47-64
7. Beveridge G.S.G., and Schechter R.S. Optimization: Theory and Practice (1970), McGraw-Hill, New York
8. Bizzi E., Hogan N., Mussa-Ivaldi F.A., and Giszter S. Does the nervous system use equilibrium-point control to guide single and multiple joint movements?. Behavioral and Brain Sciences 15 (1992) 501-613
9. L.S. Crawford, Learning control of complex skills, Ph.D. Thesis, University of California at Berkeley, 1998
10. Easton T.A. On the normal use of reflexes. American Scientist 60 (1972) 591-599
11. Feldman A.G. Once more on the equilibrium-point hypothesis (λ model) for motor control. Journal of Motor Behavior 18 (1986) 17-54
12. Greene P.H. Problems of organization of motor systems. In: Rosen R., and Snell F.M. (Eds). Progress In Theoretical Biology vol. 2 (1972), Academic Press, New York 303-338
13. Huber M., and Grupen R.A. A feedback control structure for on-line learning tasks. Robotics and Autonomous Systems 22 3-4 (1997) 303-315
14. Kaelbling L.P., Littman M.L., and Moore A.W. Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4 (1996) 237-285
15. Katayama M., and Kawato M. Virtual trajectory and stiffness ellipse during multijoint arm movement predicted by neural inverse models. Biological Cybernetics 69 5-6 (1993) 353-362
16. Kelso J., Southard D.L., and Goodman D. On the nature of human interlimb coordination. Science 203 (1979) 1029-1031
17. Levine W., and Loeb G. The neural control of limb movement. IEEE Control Systems Magazine 12 6 (1992) 38-47
18. Luus R., and Jaakola T. Optimization by direct search and systematic reduction of the size of the search region. AIChE Journal 19 (1973) 760-766
19. McDonald P.V., Van Emmerik R.E.A., and Newell K.M. The effects of practice on limb kinematics in a throwing task. Journal of Motor Behavior 21 3 (1989) 245-264
20. Miyamoto H., Morimoto J., Doya K., and Kawato M. Reinforcement learning with via-point representation. Neural Networks 17 3 (2004) 299-305
21. Morimoto J., and Doya K. Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning. In: Langley P. (Ed). Proceedings of the Seventeenth International Conference on Machine Learning (2000), Morgan Kaufmann, San Francisco 623-630
22. Rosenstein M.T., and Grupen R.A. Velocity-dependent dynamic manipulability. Proceedings of the IEEE International Conference on Robotics and Automation (2002), IEEE, Piscataway, NJ 2424-2429
23. Schmidt R.A. A schema theory of discrete motor skill learning. Psychological Review 82 4 (1975) 225-260
24. Spong M.W. The swing up control problem for the acrobot. IEEE Control Systems Magazine 15 1 (1995) 49-55
25. Sutton R.S., and Barto A.G. Reinforcement Learning: An Introduction (1998), MIT Press, Cambridge, MA
26. Swann W.H. Direct search methods. In: Murray W. (Ed). Numerical Methods For Unconstrained Optimization (1972), Academic Press, New York 13-28
27. Todorov E., and Jordan M.I. Optimal feedback control as a theory of motor coordination. Nature Neuroscience 5 (2002) 1226-1235
28. Turvey M.T. Preliminaries to a theory of action with reference to vision. In: Shaw R., and Bransford J. (Eds). Perceiving, Acting, and Knowing (1977), Lawrence Erlbaum Associates, Hillsdale, NJ 211-265
29. Turvey M.T. Coordination. American Psychologist 45 8 (1990) 938-953
30. Van Emmerik R.E.A. Kinematic adaptations to perturbations as a function of practice in rhythmic drawing movements. Journal of Motor Behavior 24 1 (1992) 117-131
31. Van Ingen Schenau G.J., Van Soest A.J., Gabreels F.J.M., and Horstink M.W.I.M. The control of multi-joint movements relies on detailed internal representations. Human Movement Science 14 4-5 (1995) 511-538
32. Vereijken B., Van Emmerik R.E.A., Whiting H.T.A., and Newell K.M. Free(z)ing degrees of freedom in skill acquisition. Journal of Motor Behavior 24 1 (1992) 133-142
33. Walker M.W., and Orin D.E. Efficient dynamic computer simulation of robotic mechanisms. ASME Journal of Dynamic Systems, Measurement and Control 104 (1982) 205-211
34. Wang C.-Y.E., Timoszyk W.K., and Bobrow J.E. Payload maximization for open chained manipulators: Finding weightlifting motions for a Puma 762 robot. IEEE Transactions on Robotics and Automation 17 2 (2001) 218-224
35. Watkins C.J.C.H., and Dayan P. Q-learning. Machine Learning 8 3-4 (1992) 279-292