Risk-sensitivity and the mean-variance trade-off: Decision making in sensorimotor control

Proceedings of the Royal Society B: Biological Sciences

Volumn 278, Issue 1716, 2011, Pages 2325-2332

  Nagengast, Arne J ^a,b   Braun, Daniel A ^a   Wolpert, Daniel M ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b University of Cambridge   (United Kingdom)

Author keywords

Decision making; Mean variance trade off; Motor control; Prospect theory; Risk

Indexed keywords

BIOMECHANICS; DECISION MAKING; HYPOTHESIS TESTING; MOVEMENT; NUMERICAL MODEL; PHYSIOLOGY; PSYCHOLOGY; RISK ASSESSMENT; SENSITIVITY ANALYSIS; SENSORY SYSTEM; TRADE-OFF;

ADULT; ARTICLE; BIOLOGICAL MODEL; COMPARATIVE STUDY; DECISION MAKING; FEMALE; HIGH RISK BEHAVIOR; HUMAN; MALE; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; SENSORY FEEDBACK;

ADULT; CHOICE BEHAVIOR; DECISION MAKING; FEEDBACK, SENSORY; FEMALE; HUMANS; MALE; MODELS, BIOLOGICAL; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; RISK-TAKING;

EID: 79959731729     PISSN: 09628452     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rspb.2010.2518     Document Type: Article

References (43)

1. Bernoulli, D. 1954 Exposition of a new theory on the measurement of risk. Econometrica 22, 23-36, orig. 1738.
2. Arrow, K. 1965 Aspects of the theory of risk-bearing. Yrjö Jahnssonin Sätiö.
3. Kahneman, D. & Tversky, A. 1979 Prospect theory: an analysis of decision under risk. Econometrica 47, 263-291. (doi:10.2307/1914185)
4. Markowitz, H. 1952 Portfolio selection. J. Financ. 7, 77-91. (doi:10.2307/2975974)
5. Neumann, J. V. & Morgenstern, O. 1944 Theories of games and economic behavior. Princeton, NJ: Princeton University Press.
6. Pratt, J. 1964 Risk aversion in the small and in the large. Econometrica 32, 122-136. (doi:10.2307/1913738)
7. Savage, L. J. 1972 The foundations of statistics. New York, NY: Dover Publications.
8. Real, L., Ott, J. & Silverfine, E. 1982 On the tradeoff between the mean and the variance in foraging: effect of spatial distribution and color preference. Ecology 63, 1617-1623. (doi:10.2307/1940101)
9. Christopoulos, G. I., Tobler, P. N., Bossaerts, P., Dolan, R. J. & Schultz, W. 2009 Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J. Neurosci. 29, 12574-12583. (doi:10.1523/JNEUROSCI.2614-09.2009)
10. Fecteau, S., Pascual-Leone, A., Zald, D. H., Liguori, P., Théoret, H., Boggio, P. S. & Fregni, F. 2007 Activation of prefrontal cortex by transcranial direct current stimulation reduces appetite for risk during ambiguous decision making. J. Neurosci. 27, 6212-6218. (doi:10. 1523/JNEUROSCI.0314-07.2007)
11. Floden, D., Alexander, M. P., Kubu, C. S., Katz, D. & Stuss, D. T. 2008 Impulsivity and risk-taking behavior in focal frontal lobe lesions. Neuropsychologia 46, 213- 223. (doi:10.1016/j.neuropsychologia.2007.07.020)
12. Huettel, S. A., Stowe, C. J., Gordon, E. M., Warner, B. T. & Platt, M. L. 2006 Neural signatures of economic preferences for risk and ambiguity. Neuron 49, 765-775. (doi:10.1016/j.neuron.2006.01.024)
13. Knoch, D., Gianotti, L. R. R., Pascual-Leone, A., Treyer, V., Regard, M., Hohmann, M. & Brugger, P. 2006 Disruption of right prefrontal cortex by low-frequency repetitive transcranial magnetic stimulation induces risk-taking behavior. J. Neurosci. 26, 6469-6472. (doi:10.1523/JNEUROSCI.0804-06.2006)
14. Preuschoff, K., Bossaerts, P. & Quartz, S. R. 2006 Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51, 381-390. (doi:10.1016/j.neuron.2006.06.024)
15. Tobler, P. N., O'Doherty, J. P., Dolan, R. J. & Schultz, W. 2007 Reward value coding distinct from risk attituderelated uncertainty coding in human reward systems. J. Neurophysiol. 97, 1621-1632. (doi:10.1152/jn.00745. 2006)
16. Tobler, P. N., Christopoulos, G. I., O'Doherty, J. P., Dolan, R. J. & Schultz, W. Risk-dependent reward value signal in human prefrontal cortex. Proc. Natl Acad. Sci. USA 106, 7185-7190. (doi:10.1073/pnas. 0809599106)
17. Cohen, R. & Sternad, D. 2009 Variability in motor learning: Relocating, channeling and reducting noise. Exp. Brain Res. 193, 69-83. (doi:10.1007/s00221-008-1596-1)
18. Trommershäuser, J., Maloney, L. T. & Landy, M. S. 2003 Statistical decision theory and the selection of rapid, goal-directed movements. J. Opt. Soc. Am. A 20, 1419-1433.
19. Trommershäuser, J., Maloney, L. T. & Landy, M. S. 2003 Statistical decision theory and trade-offs in the control of motor response. Spat. Vis. 16, 255-275.
20. Dean, M., Wu, S.-W. & Maloney, L. T. 2007 Trading off speed and accuracy in rapid, goal-directed movements. J. Vis. 7, 1-12. (doi:10.1167/7.5.10)
21. Hudson, T. E., Maloney, L. T. & Landy, M. S. 2008 Optimal compensation for temporal uncertainty in movement planning. PLoS Comput. Biol. 4, e1000130. (doi:10. 1371/journal.pcbi.1000130)
22. Braun, D. A., Aertsen, A., Wolpert, D. M. & Mehring, C. 2009 Learning optimal adaptation strategies in unpredictable motor tasks. J. Neurosci. 29, 6472-6478.(doi:10.1523/JNEUROSCI.3075-08.2009)
23. Diedrichsen, J. 2007 Optimal task-dependent changes of bimanual feedback control and adaptation. Curr. Biol. 17, 1675-1679. (doi:10.1016/j.cub.2007.08.051)
24. Izawa, J., Rane, T., Donchin, O. & Shadmehr, R. 2008 Motor adaptation as a process of reoptimization. J. Neurosci. 28, 2883-2891. (doi:10.1523/JNEUROSCI. 5359-07.2008)
25. Nagengast, A. J., Braun, D. A. & Wolpert, D. M. 2009 Optimal control predicts human performance on objects with internal degrees of freedom. PLoS Comput. Biol. 5, e1000419. (doi:10.1371/journal.pcbi.1000419)
26. Todorov, E. 2004 Optimality principles in sensorimotor control. Nat. Neurosci. 7, 907-915. (doi:10.1038/nn1309)
27. Todorov, E. & Jordan, M. I. 2002 Optimal feedback control as a theory of motor coordination. Nat. Neurosci. 5, 1226-1235. (doi:10.1038/nn963)
28. Wu, S.-W., Delgado, M. R. & Maloney, L. T. 2009 Economic decision-making compared with an equivalent motor task. Proc. Natl Acad. Sci. USA 106, 6088-6093. (doi:10.1073/pnas.0900102106)
29. Nagengast, A. J., Braun, D. A. & Wolpert, D. M. 2010 Risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty. PLoS Comput. Biol. 6, e1000857. (doi:10.1371/journal.pcbi.1000857)
30. Whittle, P. 1981 Risk-sensitive linear/quadratic/Gaussian control. Adv. Appl. Probab. 13, 764-777. (doi:10.2307/1426972)
31. Howard, I. S., Ingram, J. N. & Wolpert, D. M. 2009 A modular planar robotic manipulandum with end-point torque control. J. Neurosci. Meth. 181, 199-211. (doi:10.1016/j.jneumeth.2009.05.005)
32. Kö rding, K. P., Fukunaga, I., Howard, I. S., Ingram, J. N. & Wolpert, D. M. 2004 A neuroeconomics approach to inferring utility functions in sensorimotor control. PLoS Biol. 2, e330.
33. Watson, A. & Pelli, D. 1983 QUEST: a Bayesian adaptive psychometric method. Percept. Psychophys. 33, 113-120.
34. Prelec, D. 1998 The probability weighting function. Econometrica 66, 497-527. (doi:10.2307/2998573)
35. Tversky, A. & Kahneman, D. 1992 Advances in prospect theory: cumulative representation of uncertainty. J. Risk Uncertain. 5, 297-323. (doi:10.1007/BF00122574)
36. Trommershäuser, J., Gepshtein, S., Maloney, L. T., Landy, M. S. & Banks, M. S. 2005 Optimal compensation for changes in task-relevant movement variability. J. Neurosci. 25, 7169-7178.
37. Boorman, E. D. & Sallet, J. 2009 Mean-variance or prospect theory: the nature of value representations in the human brain. J. Neurosci. 29, 7945-7947. (doi:10. 1523/JNEUROSCI.1876-09.2009)
38. Tobler, P. N., Fiorillo, C. D. & Schultz, W. 2005 Adaptive coding of reward value by dopamine neurons. Science 307, 1642-1645. (doi:10.1126/science.1105370)
39. Martino, B. D., Kumaran, D., Seymour, B. & Dolan, R. J. 2006 Frames, biases, and rational decision-making in the human brain. Science 313, 684-687. (doi:10.1126/science.1128356)
40. Hsu, M., Krajbich, I., Zhao, C. &Camerer, C. F. 2009 Neural response to reward anticipation under risk is nonlinear in probabilities. J. Neurosci. 29, 2231-2237. (doi:10.1523/JNEUROSCI.5296-08.2009)
41. Rangel, A., Camerer, C. & Montague, P. R. 2008 A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9, 545-556. (doi:10.1038/nrn2357)
42. Langer, E. 1975 The illusion of control. J. Pers. Soc. Psychol. 32, 311-328. (doi:10.1037/0022-3514.32.2. 311)
43. Davis, D., Sundahl, I. & Lesbo, M. 2000 Illusory personal control as a determinant of bet size and type in casino craps games. J. Appl. Soc. Psychol. 30, 1224-1242. (doi:10.1111/j.1559-1816.2000.tb02518.x)