Bayesian decision theory in sensorimotor control

Trends in Cognitive Sciences

Volumn 10, Issue 7, 2006, Pages 319-326

  Körding, Konrad P ^a   Wolpert, Daniel M ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN DECISION THEORY; HUMAN BEHAVIOR; POTENTIAL COSTS; SENSORIMOTOR CONTROL;

BEHAVIORAL RESEARCH; CONTROL SYSTEM ANALYSIS; OPTIMAL CONTROL SYSTEMS; PROBLEM SOLVING; SENSORS; SIGNAL PROCESSING;

DECISION THEORY;

BAYES THEOREM; BEHAVIOR; COGNITION; MOTOR CONTROL; PERCEPTION; REVIEW; SENSORIMOTOR INTEGRATION;

BRAIN; COGNITION; DECISION THEORY; EFFICIENCY; FEEDBACK; GENERALIZATION (PSYCHOLOGY); HUMANS; MODELS, STATISTICAL; MOVEMENT; PERCEPTION; PSYCHOMOTOR PERFORMANCE; VISION; VISION, OCULAR;

EID: 33746260457     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tics.2006.05.003     Document Type: Review

References (68)

1. Barlow H.B., et al. Human contrast discrimination and the threshold of cortical neurons. J. Opt. Soc. Am. A 4 (1987) 2366-2371
2. Scott S.H., and Loeb G.E. The computation of position sense from spindles in mono- and multiarticular muscles. J. Neurosci. 14 (1994) 7529-7540
3. Clamann H.P. Statistical analysis of motor unit firing patterns in a human skeletal muscle. Biophys. J. 9 (1969) 1233-1251
4. Matthews P.B. Relationship of firing intervals of human motor units to the trajectory of post-spike after-hyperpolarization and synaptic noise. J. Physiol. 492 (1996) 597-628
5. Cox R.T. Probability, frequency and reasonable expectation. Am. J. Phys. 17 (1946) 1-13
6. Freedman D.A. Some issues in the foundation of statistics. Found. Sci. 1 (1995) 19-83
7. MacKay D.J.C. Information Theory, Inference, and Learning Algorithms (2003), Cambridge University Press
8. Jaynes E.T. Bayesian Methods: General Background (1986), Cambridge Univ. Press
9. Yuille A., and Bulthoff H.H. Bayesian decision theory and psychophysics. In: Knill D., and Richards W. (Eds). Perception as Bayesian Inference (1996), Cambridge University Press 123-161
10. Brainard D.H., and Freeman W.T. Bayesian color constancy. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 14 (1997) 1393-1411
11. Russell S., and Wefald E. Principles of metareasoning. Artif. Intell. 49 (1991) 400-411
12. Körding K.P., and Wolpert D.M. Bayesian integration in sensorimotor learning. Nature 427 (2004) 244-247
13. Singh K., and Scott S.H. A motor learning strategy reflects neural circuitry for limb control. Nat. Neurosci. 6 (2003) 399-403
14. Körding K.P., et al. Bayesian Integration in force estimation. J. Neurophysiol. 92 (2004) 3161-3165
15. Miyazaki M., et al. Testing Bayesian models of human coincidence timing. J. Neurophysiol. 94 (2005) 395-399
16. Knill, D. and Richards, W., eds (1996) Perception as Bayesian Inference, Cambridge University Press
17. Yuille, A. and Kersten, D. (2006) Vision as Bayesian inference: analysis by synthesis? Trends Cogn. Sci. DOI:10.1016/j.tics.2006.05.002
18. Geisler W.S., and Kersten D. Illusions, perception and Bayes. Nat. Neurosci. 5 (2002) 508-510
19. Kersten D., and Yuille A. Bayesian models of object perception. Curr. Opin. Neurobiol. 13 (2003) 150-158
20. Kersten D., et al. Object perception as Bayesian inference. Annu. Rev. Psychol. 55 (2004) 271-304
21. Adams W.J., et al. Experience can change the 'light-from-above' prior. Nat. Neurosci. 7 (2004) 1057-1058
22. Brewster D. On the optical illusion of the conversion of cameos into intaglios and of intaglios into cameos, with an account of other analogous phenomena. Edinburgh J. Sci. 4 (1826) 99-108
23. Adelson E.H. Perceptual organization and the judgment of brightness. Science 262 (1993) 2042-2044
24. Langer M.S., and Bulthoff H.H. A prior for global convexity in local shape-from-shading. Perception 30 (2001) 403-410
25. Stocker, A. and Simoncelli, E. Noise characteristics and prior expectations in human visual speed perception. Nat. Neurosci. (in press)
26. Howe C.Q., and Purves D. Range image statistics can explain the anomalous perception of length. Proc. Natl. Acad. Sci. U. S. A. 99 (2002) 13184-13188
27. Ernst M.O., and Banks M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415 (2002) 429-433
28. Alais D., and Burr D. The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol. 14 (2004) 257-262
29. Jacobs R.A. Optimal integration of texture and motion cues to depth. Vision Res. 39 (1999) 3621-3629
30. Knill D.C., and Saunders J.A. Do humans optimally integrate stereo and texture information for judgments of surface slant?. Vision Res. 43 (2003) 2539-2558
31. Hillis J.M., et al. Slant from texture and disparity cues: optimal cue combination. J. Vis. 4 (2004) 967-992
32. van Beers R.J., et al. Integration of proprioceptive and visual position-information: An experimentally supported model. J. Neurophysiol. 81 (1999) 1355-1364
33. van Beers R.J., et al. How humans combine simultaneous proprioceptive and visual position information. Exp. Brain Res. 111 (1996) 253-261
34. Sober S.J., and Sabes P.N. Flexible strategies for sensory integration during motor planning. Nat. Neurosci. 8 (2005) 490-497
35. Hogan N. An organizing principle for a class of voluntary movements. J. Neurosci. 4 (1984) 2745-2754
36. Flash T., and Hogan N. The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 5 (1985) 1688-1703
37. Harris C.M., and Wolpert D.M. Signal-dependent noise determines motor planning. Nature 394 (1998) 780-784
38. Trommershäuser J., et al. Statistical decision theory and the selection of rapid, goal-directed movements. J. Opt. Soc. Am. A Opt Image Sci Vis 20 (2003) 1419-1433
39. Maloney, L.T. et al. Questions without words: A comparison between decision making under risk and movement planning under risk. In Integrated Models of Cognitive Systems (Gray, W., ed.), Oxford University Press (in press)
40. Wu S.W., et al. Limits to human movement planning in tasks with asymmetric gain landscapes. J. Vis. 6 (2006) 53-63
41. Körding K.P., et al. A neuroeconomics approach to measuring human loss functions. PLoS Biol. 2 (2004) e330
42. Körding K.P., and Wolpert D. The loss function of sensorimotor learning. Proc. Natl. Acad. Sci. U. S. A. 101 (2004) 9839-9842
43. Wolpert D.M., et al. An internal model for sensorimotor integration. Science 269 (1995) 1880-1882
44. Kalman R.E. A new approach to linear filtering and prediction problems. J. of Basic Engineering 82D (1960) 35-45
45. Todorov E. Optimality principles in sensorimotor control. Nat. Neurosci. 7 (2004) 907-915
46. Todorov E., and Jordan M.I. Optimal feedback control as a theory of motor coordination. Nat. Neurosci. 5 (2002) 1226-1235
47. Saunders J.A., and Knill D.C. Humans use continuous visual feedback from the hand to control both the direction and distance of pointing movements. Exp. Brain Res. 162 (2005) 458-473
48. Saunders J.A., and Knill D.C. Visual feedback control of hand movements. J. Neurosci. 24 (2004) 3223-3234
49. Baddeley R.J., et al. System identification applied to a visuomotor task: near-optimal human performance in a noisy changing task. J. Neurosci. 23 (2003) 3066-3075
50. Land M., et al. The roles of vision and eye movements in the control of activities of daily living. Perception 28 (1999) 1311-1328
51. Todorov E. Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system. Neural Comput. 17 (2005) 1084-1108
52. Brock, O. and Kavraki, L. (2001) Decomposition-based motion planning: a framework for real-time motion planning in high-dimensional configuration spaces. In IEEE International Conference on Robotics and Automation (Vol. 2), pp. 1469-1474, ICRA
53. Todorov E., et al. From task parameters to motor synergies: a hiearachical framework for approximately-optimal feedback control of redundant manipulators. Journal of Robotic Systems 22 (2005) 669-710
54. Wolpert D.M., et al. A unifying computational framework for motor control and social interaction. Philos. Trans. R. Soc. Lond. B Biol. Sci. 358 (2003) 593-602
55. Abbeel, P. and Ng, A.Y. (2004) Apprenticeship learning via inverse reinforcement learning. In Twenty-first International Conference on Machine Learning (Vol. 69), pp. 1-8, ACM International Conference Proceeding Series
56. Tenenbaum, J.B. et al. Intuitive theories as grammars for causal inference. In Causal Learning: Psychology, Philosophy, and Computation (Gopnik, A. and Schulz, L., eds), Oxford University Press (in press)
57. Scott S.H. Optimal feedback control and the neural basis of volitional motor control. Nat. Rev. Neurosci. 5 (2004) 532-546
58. He J. Feedback gains for correcting small perturbations to standing posture. IEEE Transactions on Automatic Control 36 (1991) 322-332
59. Guiso L., et al. Income risk, borrowing constraints, and portfolio choice. Am. Econ. Rev. 86 (1996) 158-172
60. Gibbons R., et al. Comparative advantage, learning, and sectoral wage determination. J. Labor Econ. 23 (2005) 681-724
61. Bernanke B.S., and Woodford M. Dynamic effects of monetary policy. Journal of Money, Credit and Banking 29 (1997) 653-684
62. Bentham J. An Introduction to the Principles of Morals and Legislation (1780), Clarendon Press
63. Bernoulli, D. (1738) Specimen theoriae novae de mensura sortis. Comentarii academiae scientarium imperialis Petropolitanae (for 1730 and 1731) 5, 175-192
64. Fehr E., and Rockenbach B. Human altruism: economic, neural, and evolutionary perspectives. Curr. Opin. Neurobiol. 14 (2004) 784-790
65. Kahneman D., and Tversky A. Prospect theory: an analysis of decision under risk. Econometrica XVLII (1979) 263-291
66. Sutton R.S., and Barto A.G. Reinforcement Learning: An Introduction (1998), MIT Press
67. Smart, W.D. and Kaelbling, L.P. (2002) Effective reinforcement learning for mobile robots. In International Conference on Robotics and Automation (Vol. 1), pp. 3404-3410, IEEE
68. Yu A.J., and Dayan P. Uncertainty, neuromodulation, and attention. Neuron 46 (2005) 681-692