Evidence for composite cost functions in arm movement planning: An inverse optimal control approach

PLoS Computational Biology

Volumn 7, Issue 10, 2011, Pages

  Berret, Bastien ^a   Chiovetto, Enrico ^a,b   Nori, Francesco ^a   Pozzo, Thierry ^a,c,d  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^b UNIVERSITY OF TÜBINGEN   (Germany)

^c INSTITUT UNIVERSITAIRE DE FRANCE   (France)

^d INSERM   (France)

Author keywords

[No Author keywords available]

Indexed keywords

COSTS; DEGREES OF FREEDOM (MECHANICS); INVERSE PROBLEMS;

ARM MOVEMENTS; BASIC PRINCIPLES; CONTROL APPROACH; COST-FUNCTION; INVERSE-OPTIMAL CONTROL; MOTOR BEHAVIOURS; MOTOR CONTROL; MOVEMENT PLANNING; NATURAL MOVEMENTS; OPTIMAL CONTROL THEORY;

COST FUNCTIONS;

ADULT; ARM MOVEMENT; ARTICLE; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; ENERGY EXPENDITURE; EVIDENCE BASED MEDICINE; FEMALE; FUNCTIONAL STATUS; HUMAN; HUMAN EXPERIMENT; INTERMETHOD COMPARISON; INTERNAL CONSISTENCY; JOINT FUNCTION; MALE; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MOTOR CONTROL; NORMAL HUMAN; PROCESS OPTIMIZATION; TASK PERFORMANCE; VALIDATION PROCESS; ADOLESCENT; ARM; AUDIOVISUAL EQUIPMENT; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY;

ADOLESCENT; ADULT; ARM; FEMALE; HUMANS; MALE; MODELS, ANATOMIC; MOVEMENT; YOUNG ADULT;

EID: 80055085712     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1002183     Document Type: Article

References (66)

1. Soechting JF, Lacquaniti F, (1981) Invariant characteristics of a pointing movement in man. J Neurosci 1: 710-720.
2. Lacquaniti F, Soechting JF, (1982) Coordination of arm and wrist motion during a reaching task. J Neurosci 2: 399-408.
3. Atkeson CG, Hollerbach JM, (1985) Kinematic features of unrestrained vertical arm movements. J Neurosci 5: 2318-2330.
4. Papaxanthis C, Pozzo T, Schieppati M, (2003) Trajectories of arm pointing movements on the sagittal plane vary with both direction and speed. Exp Brain Res 148: 498-503.
5. Soechting JF, Flanders M, (1991) Arm movements in three-dimensional space: computation, theory, and observation. Exerc Sport Sci Rev 19: 389-418.
6. Lacquaniti F, Terzuolo C, Viviani P, (1983) The law relating the kinematic and figural aspects of drawing movements. Acta Psychol (Amst) 54: 115-130.
7. Engelbrecht S, (2001) Minimum principles in motor control. J Math Psychol 45: 497-542.
8. Todorov E, (2004) Optimality principles in sensorimotor control. Nat Neurosci 7: 907-915.
9. Nelson WL, (1983) Physical principles for economies of skilled movements. Biol Cybern 46: 135-147.
10. Desmurget M, Pélisson D, Rossetti Y, Prablanc C, (1998) From eye to hand: planning goal-directed movements. Neurosci Biobehav Rev 22: 761-788.
11. Flash T, Hogan N, (1985) The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci 5: 1688-1703.
12. Uno Y, Kawato M, Suzuki R, (1989) Formation and control of optimal trajectory in human multijoint arm movement. minimum torque-change model. Biol Cybern 61: 89-101.
13. Harris CM, Wolpert DM, (1998) Signal-dependent noise determines motor planning. Nature 394: 780-784.
14. Cruse H, Brüwer M, (1987) The human arm as a redundant manipulator: the control of path and joint angles. Biol Cybern 57: 137-144.
15. Rosenbaum DA, Loukopoulos LD, Meulenbroek RG, Vaughan J, Engelbrecht SE, (1995) Planning reaches by evaluating stored postures. Psychol Rev 102: 28-67.
16. Vaughan J, Rosenbaum DA, Diedrich FJ, Moore CM, (1996) Cooperative selection of movements: the optimal selection model. Psychol Res 58: 254-273.
17. Gielen S, (2009) Review of Models for the Generation of Multi-Joint Movements in 3-D. Adv Exp Med Biol 629: 523-550.
18. Gribble PL, Mullin LI, Cothros N, Mattar A, (2003) Role of cocontraction in arm movement accuracy. J Neurophysiol 89: 2396-2405.
19. Missenard O, Mottet D, Perrey S, (2008) The role of cocontraction in the impairment of movement accuracy with fatigue. Exp Brain Res 185: 151-156.
20. Liu D, Todorov E, (2007) Evidence for the flexible sensorimotor strategies predicted by optimal feedback control. J Neurosci 27: 9354-9368.
21. Todorov E, (2007) Optimal control theory. In: Doya K, Ishii S, Pouget A, Rao RPN, editors. Bayesian Brain: Probabilistic Approaches to Neural Coding Cambridge, Mass MIT Press pp. 269-298.
22. Papaxanthis C, Pozzo T, McIntyre J, (2005) Kinematic and dynamic processes for the control of pointing movements in humans revealed by short-term exposure to microgravity. Neuroscience 135: 371-383.
23. Murray RM, Sastry SS, Zexiang L, (1994) A Mathematical Introduction to Robotic Manipulation. Boca Raton, FL CRC Press.
24. Van der Helm FCT, Rozendaal LA, (2000) Musculoskeletal systems with intrinsic and proprioceptive feedback. In: Winters JM, Crago P, editors. Neural control of posture and movement New York Springer pp. 164-174.
25. Mombaur K, Truong A, Laumond JP, (2009) From human to humanoid locomotion- an inverse optimal control approach. Auton Robots 28: 369-383.
26. Wada Y, Kaneko Y, Nakano E, Osu R, Kawato M, (2001) Quantitative examinations for multi joint arm trajectory planning-using a robust calculation algorithm of the minimum commanded torque change trajectory. Neural Netw 14: 381-393.
27. Ben-Itzhak S, Karniel A, (2008) Minimum acceleration criterion with constraints implies bang-bang control as an underlying principle for optimal trajectories of arm reaching movements. Neural Comput 20: 779-812.
28. Todorov E, Jordan MI, (1998) Smoothness maximization along a predefined path accurately predicts the speed profiles of complex arm movements. J Neurophysiol 80: 696-714.
29. Richardson MJE, Flash T, (2002) Comparing smooth arm movements with the two-thirds power law and the related segmented-control hypothesis. J Neurosci 22: 8201-8211.
30. Nakano E, Imamizu H, Osu R, Uno Y, Gomi H, et al. (1999) Quantitative examinations of internal representations for arm trajectory planning: minimum commanded torque change model. J Neurophysiol 81: 2140-2155.
31. Biess A, Liebermann DG, Flash T, (2007) A computational model for redundant human threedimensional pointing movements: integration of independent spatial and temporal motor plans simplifies movement dynamics. J Neurosci 27: 13045-13064.
32. Soechting JF, Buneo CA, Herrmann U, Flanders M, (1995) Moving effortlessly in three dimensions: does donders' law apply to arm movement? J Neurosci 15: 6271-6280.
33. Nishii J, Murakami T, (2002) Energetic optimality of arm trajectory. Proc of Int Conf on Biomechanics of Man pp. 30-33.
34. Berret B, Darlot C, Jean F, Pozzo T, Papaxanthis C, et al. (2008) The inactivation principle: mathematical solutions minimizing the absolute work and biological implications for the planning of arm movements. PLoS Comput Biol 4: e1000194.
35. Todorov E, Jordan MI, (2002) Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226-1235.
36. Guigon E, Baraduc P, Desmurget M, (2007) Computational motor control: redundancy and invariance. J Neurophysiol 97: 331-347.
37. Calinon S, Guenter F, Billard A, (2007) On learning, representing and generalizing a task in a humanoid robot. IEEE Trans Syst Man Cybern B Cybern 37: 286-298.
38. Calinon S, (2009) Robot Programming by Demonstration: A Probabilistic Approach. EPFL/CRC Press.
39. Vanden Berghen F, Bersini H, (2005) CONDOR, a new parallel, constrained extension of powell's UOBYQA algorithm: Experimental results and comparison with the DFO algorithm. J Comput Appl Math 181: 157-175.
40. Powell MJD, (2002) UOBYQA: Unconstrained optimization by quadratic approximation. Math Program 92: 555-582.
41. Benson DA, Huntington GT, Thorvaldsen TP, Rao AV, (2006) Direct trajectory optimization and costate estimation via an orthogonal collocation method. J Guid Control Dyn 29: 1435-1440.
42. Garg D, Patterson MA, Hager WW, Rao AV, Benson DA, et al. (2010) A unified framework for the numerical solution of optimal control problems using pseudospectral methods. Automatica 46: 1843-1851.
43. Rao AV, Benson DA, Darby CL, Patterson MA, Francolin C, et al. (2010) Algorithm 902: Gpops, a matlab software for solving multiple-phase optimal control problems using the gauss pseudospectral method. ACM Trans Math Softw 37: 1-39.
44. Gill PE, Murray W, Saunders MA, (2005) Snopt: An sqp algorithm for large-scale constrained optimization. SIAM Review 47: 99-131.
45. Pontryagin LS, Boltyanskii VG, Gamkrelidze RV, Mishchenko EF, (1964) The Mathematical Theory of Optimal Processes. Pergamon Press 360.
46. Rosenbaum DA, Meulenbroek RG, Vaughan J, (2001) Planning reaching and grasping movements: theoretical premises and practical implications. Motor Control 5: 99-115.
47. Kiani R, Shadlen MN, (2009) Representation of confidence associated with a decision by neurons in the parietal cortex. Science 324: 759-764.
48. Körding K, (2007) Decision theory: what "should" the nervous system do? Science 318: 606-610.
49. Trommershäuser J, Maloney LT, Landy MS, (2008) Decision making, movement planning and statistical decision theory. Trends Cogn Sci 12: 291-297.
50. Körding KP, Wolpert DM, (2004) The loss function of sensorimotor learning. Proc Natl Acad Sci U S A 101: 9839-9842.
51. Körding KP, Fukunaga I, Howard IS, Ingram JN, Wolpert DM, (2004) A neuroeconomics approach to inferring utility functions in sensorimotor control. PLoS Biol 2: e330.
52. Terekhov AV, Pesin YB, Niu X, Latash ML, Zatsiorsky VM, (2010) An analytical approach to the problem of inverse optimization with additive objective functions: an application to human prehension. J Math Biol 61: 423-453.
53. Terekhov AV, Zatsiorsky VM, (2011) Analytical and numerical analysis of inverse optimization problems: conditions of uniqueness and computational methods. Biol Cybern 104: 75-93.
54. Kalman R, (1964) When is a linear control system optimal? ASME Transactions, Journal of Basic Engineering 86: 51-60.
55. Boyd S, Ghaoui LE, Feron E, Balakrishnan V, (1994) Linear matrix inequalities in system and control theory. Volume 15:193 Philadelphia SIAM.
56. Ng AY, Russell S, (2000) Algorithms for inverse reinforcement learning. Proc 17th International Conf. on Machine Learning pp. 663-670.
57. Desmurget M, Jordan M, Prablanc C, Jeannerod M, (1997) Constrained and unconstrained movements involve different control strategies. J Neurophysiol 77: 1644-1650.
58. Biess A, Flash T, Liebermann D, (2011) Riemannian geometric approach to human arm dynamics, movement optimization, and invariance. Phys Rev E Stat Nonlin Soft Matter Phys 83: 031927.
59. Alexander RM, (1996) Optima for animals. Princeton University Press, 176.
60. Weibel ER, Taylor CR, Bolis L, (1998) Principles of Animal Design: The Optimization and Symmorphosis Debate. Cambridge, UK Cambridge University Press.
61. Bernard C, (1879) Leçons sur les phénomènes de la vie communs aux animaux et aux végétaux, volume 1. University of Michigan Library 448.
62. Cannon WB, (1932) The Wisdom of the Body. New York Norton.
63. Nishii J, (2000) Legged insects select the optimal locomotor pattern based on the energetic cost. Biol Cybern 83: 435-442.
64. Marshall RN, Wood GA, Jennings LS, (1989) Performance objectives in human movement: A review and application to the stance phase of normal walking. Hum Mov Sci 8: 571-594.
65. Todorov E, Li W, Pan X, (2005) From task parameters to motor synergies: A hierarchical framework for approximately-optimal control of redundant manipulators. J Robot Syst 22: 691-710.
66. Winter D, (1990) Biomechanics and Motor Control of Human Movement. New York John Wiley & Sons.