Risk-sensitivity in sensorimotor control

Frontiers in Human Neuroscience

Volumn , Issue JANUARY, 2011, Pages 1-10

  Braun, Daniel A ^a,b   Nagengast, Arne J ^a,c   Wolpert, Daniel M ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b Computational Learning and Motor Control Laboratory Department of Computer Science University of Southern California ^*  (United States)

^c UK   (United Kingdom)

Author keywords

Risk; Risk sensitivity; Sensorimotor control; Uncertainty

Indexed keywords

ARTICLE; CONCEPTUAL FRAMEWORK; DECISION MAKING; LOCOMOTION; MATHEMATICAL MODEL; MOTOR CONTROL; PROBABILITY; REWARD; RISK; SENSORIMOTOR FUNCTION; SENSORY FEEDBACK; TASK PERFORMANCE;

EID: 81555216199     PISSN: 16625161     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2011.00001     Document Type: Article

References (98)

1. Abdellaoui, M. (2000). Parameter-free elicitation of utility and probability weighting functions. Manage. Sci. 46, 1497-1512.
2. Abdellaoui, M., Bleichrodt, H., and Paraschiv, C. (2007). Measuring loss aversion under prospect theory: a parameter-free approach. Manage. Sci. 53, 1659-1674.
3. Alexander, R. M. (1997). A minimum energy cost hypothesis for human arm trajectories. Biol. Cybern. 76, 97-105.
4. Allais, M. (1953). Le comportement de l'homme rationnel devant le risque: critique des postulats et axiomes de l'école américaine. Econometrica 2, 503-546.
5. Allais, M., and Hagen, O. (eds). (1979). Expected Utility Hypothesis and the Allais Paradox. Dordrecht: D. Reidel.
6. Arrow, K. J. (ed.). (1965). Aspects of the Theory of Risk Bearing. Helsinski: Yrjo Jahnsson Säätio.
7. Attneave, F. (1953). Psychological probability as a function of experienced frequency. J. Exp. Psychol. 46, 81-86.
8. Bar-Shira, Z., and Finkelshtain, I. (1999). Two-moments decision models and utility-representable preferences. J. Econ. Behav. Organ. 38, 237-244.
9. Bardsen, B. J., Tveraa, T., Fauchald, P., and Langeland, K. (2010). Observational evidence of risk-sensitive reproductive allocation in a long-lived mammal. Oecologia 162, 627-639.
10. Bateson, M. (2002). Recent advances in our understanding of risk-sensitive foraging preferences. Proc. Nutr. Soc. 61, 509-516.
11. Bell, D. E., Raiffa, H., and Tversky, A. (eds). (1988). Decision Making: Descriptive, Normative and Prescriptive Interactions. Cambridge: Cambridge University Press.
12. Bernoulli, D. (1954/1738). Exposition of a new theory on the measurement of risk. Econometrica 22, 23-36.
13. Bleichrodt, H., and Pinto, J. L. (2000). A parameter-free elicitation of the probability weighting function in medical decision analysis. Manage. Sci. 46, 1485-1496.
14. Boorman, E. D., and Sallet, J. (2009). Mean-variance or prospect theory: the nature of value representations in the human brain. J. Neurosci. 29, 7945-7947.
15. Braun, D. A., Ortega, P. A., and Wolpert, D. M. (2009a). Nash equilibria in multi-agent motor interactions. PLoS Comput. Biol. 5, e1000468. doi:10.1371/journal.pcbi.1000468
16. Braun, D. A., Aertsen, A., Wolpert, D. M., and Mehring, C. (2009b). Learning optimal adaptation strategies in unpredictable motor tasks. J. Neurosci. 29, 6472-6478.
17. Chen-Harris, H., Joiner, W. M., Ethier, V., Zee, D. S., and Shadmehr, R. (2008). Adaptive control of saccades via internal feedback. J. Neurosci. 28, 2804-2813.
18. Crevecoeur, F., McIntyre, J., Thonnard, J. L., and Lefevre, P. (2010). Movement stability under uncertain internal models of dynamics. J. Neurophysiol. 104, 1309-1313.
19. Dehaene, S., Izard, V., Spelke, E., and Pica, P. (2008). Log or linear? Distinct intuitions of the number scale in Western and Amazonian indigene cultures. Science 320, 1217-1220.
20. Diedrichsen, J. (2007). Optimal task- dependent changes of bimanual feedback control and adaptation. Curr. Biol. 17, 1675-1679.
21. Diedrichsen, J., and Dowling, N. (2009). Bimanual coordination as task- dependent linear control policies. Hum. Mov. Sci. 28, 334-347.
22. Diedrichsen, J., Shadmehr, R., and Ivry, R. B. (2010). The coordination of movement: optimal feedback control and beyond. Trends Cogn. Sci. 14, 31-39.
23. Ellsberg, D. (1961). Risk, ambiguity, and the savage axioms. Q. J. Econ. 75, 643-669.
24. Fagg, A. H., Shah, A., and Barto, A. G. (2002). A computational model of muscle recruitment for wrist movements. J. Neurophysiol. 88, 3348-3358.
25. Faisal, A. A., Selen, L. P., and Wolpert, D. M. (2008). Noise in the nervous system. Nat. Rev. Neurosci. 9, 292-303.
26. Fishburn, P., and Kochenberger, G. (1979). Two-piece von Neumann- Morgenstern utility functions. Decis. Sci. 10, 503-518.
27. Fishburn, P. C. (1970). Utility Theory for Decision Making. New York: Wiley.
28. Flash, T., and Hogan, N. (1985). The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 5, 1688-1703.
29. Franklin, D. W., and Wolpert, D. M. (2008). Specificity of reflex adaptation for task-relevant variability. J. Neurosci. 28, 14165-14175.
30. Gigerenzer, G. (2002). Reckoning with Risk: Learning to Live with Uncertainty. London: Allen Lane.
31. Glimcher, P. W. (2008). Neuroeconomics: Decision Making and the Brain. London: Academic Press.
32. Goldshmidt, J. N., and Fantino, E. (2004). Economic context and pigeons' risktaking: an integrative approach. Behav. Processes 65, 133-154.
33. Gonzalez, R., and Wu, G. (1999). On the shape of the probability weighting function. Cogn. Psychol. 38, 129-166.
34. Guigon, E., Baraduc, P., and Desmurget, M. (2008). Computational motor control: feedback and accuracy. Eur. J. Neurosci. 27, 1003-1016.
35. Hanoch, Y., Johnson, J., and Wilke, A. (2006). Domain specifcity in experimental measures and participant recruitment: an application to risktaking behavior. Psychol. Sci. 17, 300-304.
36. Harris, C. M., and Wolpert, D. M. (1998). Signal-dependent noise determines motor planning. Nature 394, 780-784.
37. Hatze, H., and Buys, J. D. (1977). Energyoptimal controls in the mammalian neuromuscular system. Biol. Cybern. 27, 9-20.
38. Hayden, B. Y., Heilbronner, S. R., Nair, A. C., and Platt, M. L. (2008). Cognitive influences on risk-seeking by rhesus macaques. Judgm. Decis. Mak. 3, 389-395.
39. Heilbronner, S. R., Rosati, A. G., Stevens, J. R., Hare, B., and Hauser, M. D. (2008). A fruit in the hand or two in the bush? Divergent risk preferences in chimpanzees and bonobos. Biol. Lett. 4, 246-249.
40. Hershey, J. C., and Schoemaker, P. J. H. (1980). Probability versus certainty equivalence methods in utility measurement: are they equivalent? Manag. Sci. 31, 1213-1231.
41. Houston, A. I. (1991). Risk-sensitive foraging theory and operant psychology. J. Exp. Anal. Behav. 56, 585-589.
42. Hsu, M., Krajbich, I., Zhao, C., and Camerer, C. (2009). Neural response to reward anticipation under risk is nonlinear in probabilities. J. Neurosci. 29, 2231-2237.
43. Hurly, T. A., and Oseen, M. D. (1999). Context-dependent, risk-sensitive foraging preferences in wild rufous hummingbirds. Anim. Behav. 58, 59-66.
44. Izawa, J., Rane, T., Donchin, O., and Shadmehr, R. (2008). Motor adaptation as a process of reoptimization. J. Neurosci. 28, 2883-2891.
45. Kahneman, D., Slovic, P., and Tversky, A. (1982). Judgment Under Uncertainty: Heuristics and Biases. Cambridge: Cambridge University Press.
46. Kahneman, D., and Tversky, A. (1979). Prospect theory: an analysis of decision under risk. Econometrica 47, 263-291.
47. Kahneman, D., and Tversky, A. (2000). Choices, Values, and Frames. Cambridge: Cambridge University Press.
48. Kawamori, A., and Matsushima, T. (2010). Subjective value of risky foods for individual domestic chicks: a hierarchical Bayesian model. Anim. Cogn. 13, 431-441.
49. Kirshenbaum, A. P., Szalda-Petree, A. D., and Haddad, N. F. (2000). Risksensitive foraging in rats: the effects of response-effort and reward-amount manipulations on choice behavior. Behav. Processes 50, 9-17.
50. Kreps, D. M. (1988). Notes on the Theory of Choice. Boulder, CO: Westview Press.
51. Levy, H., and Markowitz, H. (1979). Approximating expected utility by a function of mean and variance. Am. Econ. Rev. 9, 308-317.
52. Lichtenstein, S., Slovic, P., Fischhoff, B., Layman, M., and Coombs, B. (1978). Judged frequency of lethal events. J. Exp. Psychol. Hum. Learn. Mem. 4, 551-578.
53. Liu, D., and Todorov, E. (2007). Evidence for the flexible sensorimotor strategies predicted by optimal feedback control. J. Neurosci. 27, 9354-9368.
54. Long, A. B., Kuhn, C. M., and Platt, M. L. (2009). Serotonin shapes risky decision making in monkeys. Soc. Cogn. Affect. Neurosci. 4, 346-356.
55. MacCrimmon, K. R., and Wehrung, D. A. (1986). Taking Risks: The Management of Uncertainty. New York: Free Press.
56. Maloney, L. T., Trommershäuser, J., and Landy, M. S. (2007). "Questions without words: a comparison between decision making under risk and movement planning under risk," in Integrated Models of Cognitive Systems, ed. W. Gray (New York: Oxford University Press), 297-313.
57. Markowitz, H. (1952). Portfolio selection. J. Finance 7, 77-91.
58. Martino, B. D., Kumaran, D., Seymour, B., and Dolan, R. J. (2006). Frames, biases, and rational decision-making in the human brain. Science 313, 684-687.
59. Matsushima, T., Kawamori, A., and Bem-Sojka, T. (2008). Neuro-economics in chicks: foraging choices based on amount, delay and cost. Brain Res. Bull. 76, 245-252.
60. McCoy, A. N., and Platt, M. L. (2005). Risk-sensitive neurons in macaque posterior cingulate cortex. Nat. Neurosci. 8, 1220-1227.
61. Nagengast, A. J., Braun, D. A., and Wolpert, D. M. (2009). Optimal control predicts human performance on objects with internal degrees of freedom. PLoS Comput. Biol. 5, e1000419. doi:10.1371/journal.pcbi.1000419
62. Nagengast, A. J., Braun, D. A., and Wolpert, D. M. (2010a). Risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty. PLoS Comput. Biol. 6, e1000857. doi:10.1371/journal.pcbi.1000857
63. Nagengast, A. J., Braun, D. A., and Wolpert, D. M. (2010b). Risk-sensitivity and the mean-variance trade-off: decisionmaking in sensorimotor control. Proc. R. Soc. B. doi:10.1098/rspb.2010.2518. [Epub ahead of print].
64. Nakano, E., Imamizu, H., Osu, R., Uno, Y., Gomi, H., Yoshioka, T., and Kawato, M. (1999). Quantitative examinations of internal representations for arm trajectory planning: minimum commanded torque change model. J. Neurophysiol. 81, 2140-2155.
65. Payne, J. W., Laughhunn, D. J., and Crum, R. (1981). Further tests of aspiration level effects in risky choice. Manage. Sci. 27, 953-958.
66. Pratt, J. (1964). Risk aversion in the small and in the large. Econometrica 32, 122-136.
67. Pratt, J. W., Raiffa, H., and Schlaifer, R. (1995). Introduction to Statistical Decision Theory. Cambridge, MA, London: MIT Press.
68. Prelec, D. (1998). The probability weighting function. Econometrica 66, 497-527.
69. Preuschoff, K., Bossaerts, P., and Quartz, S. R. (2006). Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51, 381-390.
70. Rangel, A., Camerer, C., and Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9, 545-556.
71. Samuelson, P. A., and Nordhaus, W. D. (2009). Economics, 19th Edn. New York: McGraw-Hill Inc.
72. Sarin, R. K. (1984). Some extensions of Luce's measure of risk. Theory Decis. 22, 25-141.
73. Sarin, R. K., and Weber, M. (1993). Riskvalue models. Eur. J. Oper. Res. 70, 135-149.
74. Savage, L. J. (1954). The Foundations of Statistics. New York: Wiley.
75. Shafir, S., Wiegmann, D. D., Smith, B. H., and Real, L. A. (1999). Risk-sensitive foraging: choice behaviour of honeybees in response to variability in volume of reward. Anim. Behav. 57, 1055-1061.
76. Shapiro, M. S. (2000). Quantitative analysis of risk sensitivity in honeybees (Apis mellifera) with variability in concentration and amount of reward. J. Exp. Psychol. Anim. Behav. Process. 26, 196-205.
77. Smeets, J. B., and Brenner, E. (1999). A new view on grasping. Motor Control 3, 237-271.
78. Stevenson, I. H., Fernandes, H. L., Vilares, I., Wei, K., and Kording, K. P. (2009). Bayesian integration and non-linear feedback control in a full-body motor task. PLoS Comput. Biol. 5, e1000629. doi: 10.1371/journal.pcbi.1000629
79. Tobler, P. N., Christopoulos, G. I., O'Doherty, J. P., Dolan, R. J., and Schultz, W. (2009). Risk-dependent reward value signal in human prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 106, 7185-7190.
80. Tobler, P. N., Florillo, C. D., and Schultz, W. (2005). Adaptive coding of reward value by dopamine neurons. Science 307, 1642-1645.
81. Tobler, P. N., O'Doherty, J. P., Dolan, R. J., and Schultz, W. (2007). Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J. Neurophysiol. 97, 1621-1632.
82. Todorov, E. (2004). Optimality principles in sensorimotor control. Nat. Neurosci. 7, 907-915.
83. Todorov, E. (2005). Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system. Neural. Comput. 17, 1084-1108.
84. Todorov, E., and Jordan, M. I. (2002). Optimal feedback control as a theory of motor coordination. Nat. Neurosci. 5, 1226-1235.
85. Trimpop, R. (1994). The Psychology of Risk Taking Behavior. Amsterdam: North- Holland.
86. Trommershauser, J., Maloney, L. T., and Landy, M. S. (2003a). Statistical decision theory and trade-offs in the control of motor response. Spat. Vis. 16, 255-275.
87. Trommershauser, J., Maloney, L. T., and Landy, M. S. (2003b). Statistical decision theory and the selection of rapid, goal-directed movements. J. Opt. Soc. Am. A. Opt. Image Sci. Vis. 20, 1419-1433.
88. Trommershauser, J., Maloney, L. T., and Landy, M. S. (2008). Decision making, movement planning and statistical decision theory. Trends Cogn. Sci. 12, 291-297.
89. Tversky, A., and Kahneman, D. (1992). Advances in prospect theory - cumulative representation of uncertainty. J. Risk Uncertain. 5, 297-323.
90. Uno, Y., Kawato, M., and Suzuki, R. (1989). Formation and control of optimal trajectory in human multijoint arm movement. Minimum torque-change model. Biol. Cybern. 61, 89-101.
91. van Beers, R. J., Baraduc, P., and Wolpert, D. M. (2002). Role of uncertainty in sensorimotor control. Philos. Trans. R. Soc. Lond. B, Biol. Sci. 357, 1137-1145.
92. Von Neumann, J., and Morgenstern, O. (1944). Theory of Games and Economic Behavior. Princeton: Princeton University Press.
93. Wacker, P., and Deneffe, D. (1996). Eliciting von Neumann-Morgenstern utilities when probabilities are distorted or unknown. Manage. Sci. 42, 1131-1150.
94. Weber, E., Blais, A., and Betz, N. (2002). A domain-specific risk-attitude scale: measuring risk perceptions and risk behaviors. J. Behav. Decis. Mak. 15, 263-290.
95. Whittle, P. (1981). Risk-sensitive linear/quadratic/Gaussian control. Adv. Appl. Prob. 13, 764-777.
96. Wong, B. B., Jarvenpaa, M., and Lindstrom, K. (2009). Risk-sensitive mating decisions in a visually compromised environment. Biol. Lett. 5, 600-602.
97. Wu, S. W., Delgado, M. R., and Maloney, L. T. (2009). Economic decision-making compared with an equivalent motor task. Proc. Natl. Acad. Sci. U.S.A. 106, 6088-6093.
98. Yates, J. F. (1992). Risk-Taking Behavior. New York: Wiley.