Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system

Neural Computation

Volumn 17, Issue 5, 2005, Pages 1084-1108

  Todorov, Emanuel ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; ARM; ARTICLE; ARTIFACT; BIOLOGICAL MODEL; CENTRAL NERVOUS SYSTEM; EFFERENT NERVE; FEEDBACK SYSTEM; HUMAN; INNERVATION; MOVEMENT (PHYSIOLOGY); NORMAL DISTRIBUTION; PHYSIOLOGY; SENSORY NERVE; STATISTICAL MODEL; STATISTICS;

AFFERENT PATHWAYS; ALGORITHMS; ANIMALS; ARM; ARTIFACTS; CENTRAL NERVOUS SYSTEM; EFFERENT PATHWAYS; FEEDBACK; HUMANS; LINEAR MODELS; MODELS, NEUROLOGICAL; MOVEMENT; NORMAL DISTRIBUTION; STOCHASTIC PROCESSES;

EID: 17444420654     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/0899766053491887     Document Type: Article

References (41)

1. Anderson, F., & Pandy, M. (2001). Dynamic optimization of human walking. J Biomech. Eng, 123(5), 381-390.
2. Beghi, A., & D'Alessandro, D. (1998). Discrete-time optimal control with control-dependent noise and generalized Riccati difference equations. Automation, 34, 1031-1034.
3. Bensoussan, A. (1992). Stochastic control of partially observable systems. Cambridge: Cambridge University Press.
4. Bertsekas, D., & Tsitsiklis, J. (1997). Neuro-dynamic programming. Belmont, MA: Athena Scientific.
5. Burbeck, C., & Yap, Y. (1990). Two mechanisms for localization? Evidence for separation-dependent and separation-independent processing of position information. Vision Research, 30(5), 739-750.
6. Chow, C., & Jacobson, D. (1971). Studies of human locomotion via optimal programming. Math Biosciences, 10, 239-306.
7. Davis, M., & Vinter, R. (1985). Stochastic modelling and control. London: Chapman and Hall.
8. El Ghaoui, L. (1995). State-feedback control of systems of multiplicative noise via linear matrix inequalities. Systems and Control Letters, 24, 223-228.
9. Flash, T., & Hogan, N. (1985). The coordination of arm movements: An experimentally confirmed mathematical model. Journal of Neuroscience, 5(7), 1688-1703.
10. Harris, C., & Wolpert, D. (1998). Signal-dependent noise determines motor planning. Nature, 394, 780-784.
11. Hatze, H., & Buys, J. (1977). Energy-optimal controls in the mammalian neuromuscular system. Biol. Cybern., 27(1), 9-20.
12. Hoff, B. (1992). A computational description of the organization of human reaching and prehension. Unpublished doctoral dissertation, University of Southern California.
13. Jacobson, D., & Mayne, D. (1970). Differential dynamic programming. New York: Elsevier.
14. Jones, K., Hamilton, A., & Wolpert, D. (2002). Sources of signal-dependent noise during isometric force production. Journal of Neurophysiology, 88, 1533-1544.
15. Kleinman, D. (1969). Optimal stationary control of linear systems with control-dependent noise. IEEE Transactions on Automatic Control, AC-14(6), 673-677.
16. Kording, K., & Wolpert, D. (2004). The loss function of sensorimotor learning. Proceedings of the National Academy of Sciences, 101, 9839-9842.
17. Kuo, A. (1995). An optimal control model for analyzing human postural balance. IEEE Transactions on Biomedical Engineering, 42, 87-101.
18. Kushner, H., & Dupuis, P. (2001). Numerical methods for stochastic optimal control problems in continuous time (2nd ed.). New York: Springer.
19. Li, W., & Todorov, E. (2004). Iterative linear-quadratic regulator design for nonlinear biological movement systems. In First International Conference on Informatics in Control, Automation and Robotics, vol. 1, 222-229. N.P.: INSTICC Press.
20. Loeb, G., Levine, W., & He, J. (1990). Understanding sensorimotor feedback through optimal control. Cold Spring Harb. Symp. Quant. Biol, 55, 791-803.
21. McLane, P. (1971). Optimal stochastic control of linear systems with state- and control-dependent disturbances. IEEE Transactions on Automatic Control, AC-16(6), 793-798.
22. Meyer, D., Abrams, R., Kornblum, S., Wright, C., & Smith, J. (1988). Optimality in human motor performance: Ideal control of rapid aimed movements. Psychological Review, 95, 340-370.
23. Moore, J., Zhou, X., & Lim, A. (1999). Discrete time LQG controls with control dependent noise. Systems and Control Letters, 36, 199-206.
24. Nelson, W. (1983). Physical principles for economies of skilled movements. Biological Cybernetics, 46, 135-147.
25. Pakshin, P. (1978). State estimation and control synthesis for discrete linear systems with additive and multiplicative noise. Avtomatika i Telemetrika, 4, 75-85.
26. Phillis, Y. (1985). Controller design of systems with multiplicative noise. IEEE Transactions on Automatic Control, AC-30(10), 1017-1019.
27. Rami, M., Chen, X., & Moore, J. (2001). Solvability and asymptotic behavior of generalized Riccati equations arising in indefinite stochastic LQ problems. IEEE Transactions on Automatic Control, 46(3), 428-440.
28. Schmidt, R., Zelaznik, H., Hawkins, B., Frank, J., & Quinn, J. (1979). Motor-output variability: A theory for the accuracy of rapid motor acts. Psychol Rev., 86(5), 415-451.
29. Sutton, G., & Sykes, K. (1967). The variation of hand tremor with force in healthy subjects. Journal of Physiology, 191(3), 699-711.
30. Sutton, R., & Barto, A. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
31. Todorov, E. (1998). Studies of goal-directed movements. Unpublished doctoral dissertation, Massachusetts Institute of Technology.
32. Todorov, E. (2002). Cosine tuning minimizes motor errors. Neural Computation, 14(6), 1233-1260.
33. Todorov, E. (2004). Optimality principles in sensorimotor control. Nature Neuroscience, 7(9), 907-915.
34. Todorov, E., & Jordan, M. (2002a). A minimal intervention principle for coordinated movement. In S. Becker, S. Thrun, & K. Obermayer (Eds.), Advances in neural information processing systems, 15 (pp. 27-34). Cambridge, MA: MIT Press.
35. Todorov, E., & Jordan, M. (2002b). Optimal feedback control as a theory of motor coordination. Nature Neuroscience, 5(11), 1226-1235.
36. Todorov, E., & Li, W. (2004). A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems. Manuscript submitted for publication.
37. Uno, Y., Kawato, M., & Suzuki, R. (1989). Formation and control of optimal trajectory in human multijoint arm movement: Minimum torque-change model. Biological Cybernetics, 61, 89-101.
38. Whitaker, D., & Latham, K. (1997). Disentangling the role of spatial scale, separation and eccentricity in Weber's law for position. Vision Research, 37(5), 515-524.
39. Whittle, P. (1990). Risk-sensitive optimal control. New York: Wiley.
40. Willems, J. L., & Willems, J. C. (1976). Feedback stabilizability for stochastic systems with state and control dependent noise. Automatica, 1976, 277-283.
41. Winter, D. (1990). Biomechanics and motor control of human movement. New York: Wiley.