Dynamic estimation of task-relevant variance in movement under risk

Journal of Neuroscience

Volumn 32, Issue 37, 2012, Pages 12702-12711

  Landy, Michael S ^a   Trommershäuser, Julia ^a   Daw, Nathaniel D ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; BEHAVIOR; DECISION MAKING; FEMALE; HIGH RISK BEHAVIOR; HUMAN; HUMAN EXPERIMENT; MALE; MOVEMENT (PHYSIOLOGY); NORMAL HUMAN; PRIORITY JOURNAL; PUNISHMENT; REGRESSION ANALYSIS; REINFORCEMENT; REWARD; STIMULUS; TASK PERFORMANCE; VISUOMOTOR COORDINATION;

CUES; DECISION MAKING; FEMALE; HUMANS; LEARNING; MALE; MOVEMENT; PSYCHOMOTOR PERFORMANCE; RISK-TAKING; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84866252910     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.6160-11.2012     Document Type: Article

References (43)

1. Baddeley RJ, Ingram HA, Miall RC (2003) System identification applied to a visuomotor task: near-optimal human performance in a noisy changing task. J Neurosci 23:3066-3075.
2. Battaglia PW, Schrater PR (2007) Humans trade off viewing time and movement duration to improve visuomotor accuracy in a fast reaching task. J Neurosci 27:6984-6994.
3. Bayer HM, Glimcher PW (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47:129-141.
4. Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007) Learning the value of information in an uncertain world. Nat Neurosci 10:1214-1221.
5. Brainard DH (1997) The Psychophysics Toolbox. Spat Vis 10:433-436.
6. Burge J, Ernst MO, Banks MS (2008) The statistical determinants of adaptation rate in human reaching. J Vis 8(4): 1-19.
7. Corrado GS, Sugrue LP, Seung HS, Newsome WT (2005) Linearnonlinear-Poisson models of primate choice dynamics. J Exp Anal Behav 84:581-617.
8. Courville AC, Daw ND, Touretzky DS (2006) Bayesian theories of conditioning in a changing world. Trends Cogn Sci 10:294-300.
9. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441:876-879.
10. Dayan P, Abbott LF (2005) Theoretical neuroscience: computational and mathematical modeling of neural systems. Cambridge, MA: MIT.
11. Dayan P, Long T (1998) Statistical models of conditioning. In: Advances in neural information processing systems 10 (Kearns MJ, Jordan MI, Solla SA, eds), pp 117-123. Cambridge, MA: MIT.
12. Dayan P, Kakade S, Montague PR (2000) Learning and selective attention. Nat Neurosci 3 [Suppl]:1218-1223.
13. De Weese M, Zador A (1998) Asymmetric dynamics in optimal variance adaptation. Neural Comput 10:1179-1202.
14. Frank MJ, Doll BB, Oas-Terpstra J, Moreno F (2009) Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat Neurosci 12:1062-1068.
15. Gepshtein S, Seydell A, Trommershäuser J (2007) Optimality of human movement under natural variations of visual-motor uncertainty. J Vis 7(5): 1-18.
16. Holmes AP, Friston KJ (1998) Generalisability, random effects and population inference. Neuroimage 7:S754.
17. Hudson TE, Tassinari H, Landy MS (2010) Compensation for changing motor uncertainty. PLo S Comput Biol 6:e1000982.
18. Körding KP, Wolpert DM (2004) Bayesian integration in sensorimotor learning. Nature 427:244-247.
19. Landy MS, Goutcher R, Trommershäuser J, Mamassian P (2007) Visual estimation under risk. J Vis 7(7): 1-15.
20. Lau B, Glimcher PW (2005) Dynamic response-by-response models of matching behavior in rhesus monkeys. J Exp Anal Behav 84:555-579.
21. Li J, Schiller D, Schoenbaum G, Phelps EA, Daw ND (2011) Differential roles of human striatum and amygdala in associative learning. Nat Neurosci 14:1250-1252.
22. Maloney LT, Trommershäuser J, Landy MS (2007) Questions without words: a comparison between decision making under risk and movement planning under risk. In: Integrated models of cognitive systems (Gray W, ed), pp 297-315. New York: Oxford UP.
23. Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-1947.
24. Mood AM, Boes DC, Graybill FA (1973) Introduction to the theory of statistics, Ed 3. New York: McGraw-Hill.
25. Pearce JM, Hall G (1980) A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev 87:532-552.
26. Pelli DG (1997) The Video Toolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10:437-442.
27. Preuschoff K, Bossaerts P (2007) Adding prediction risk to the theory of reward learning. Ann N Y Acad Sci 1104:135-146.
28. Preuschoff K, Bossaerts P, Quartz SR (2006) Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51:381-390.
29. Preuschoff K, Quartz SR, Bossaerts P (2008) Human insula activation reflects risk prediction errors as well as risk. J Neurosci 28:2745-2752.
30. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: the effectiveness of reinforcement and non-reinforcement. In: Classical conditioning. 2: Current research and theory (Black AH, Prokasy WF, eds), pp 64-69. New York: Appleton-Century-Crofts.
31. Roesch MR, Calu DJ, Esber GR, Schoenbaum G (2010) Neural correlates of variations in event processing during learning in basolateral amygdala. J Neurosci 30:2464-2471.
32. Roesch MR, Esber GR, Li J, Daw ND, Schoenbaum G (2012) Surprise! Neural correlates of Pearce-Hall and Rescorla-Wagner coexist within the brain. Eur J Neurosci 35:1190-1200.
33. Sabes PN, Jordan MI (1997) Obstacle avoidance and a perturbation sensitivity model for motor planning. J Neurosci 17:7119-7128.
34. Sabes PN, Jordan MI, Wolpert DM (1998) The role of inertial sensitivity in motor planning. J Neurosci 18:5948-5957.
35. Schwarz GE (1978) Estimating the dimension of a model. Ann Stat 6:461-464.
36. Sugrue LP, Corrado GS, Newsome WT (2005) Choosing the greater of two goods: neural currencies for valuation and decision making. Nat Rev Neurosci 6:363-375.
37. Sutton RS (1992) Gain adaptation beats least squares? In: Proceedings of the Seventh Yale Workshop on Adaptive and Learning Systems, pp 161-166. New Haven, CT: Yale University.
38. Sutton RS, Barto AG (1998) Reinforcement learning an introduction. In: Adaptive computation and machine learning. Cambridge, MA: MIT.
39. Tassinari H, Hudson TE, Landy MS (2006) Combining priors and noisy visual cues in a rapid pointing task. J Neurosci 26:10154-10163.
40. Trommershäuser J, Maloney LT, Landy MS (2003a) Statistical decision theory and trade-offs in the control of motor response. Spat Vis 16:255-275.
41. Trommershäuser J, Maloney LT, Landy MS (2003b) Statistical decision theory and the selection of rapid, goal-directed movements. J Opt Soc Am A Opt Image Sci Vis 20:1419-1433.
42. Trommershäuser J, Gepshtein S, Maloney LT, Landy MS, Banks MS (2005) Optimal compensation for changes in task-relevant movement variability. J Neurosci 25:7169-7178.
43. Trommershäuser J, Landy MS, Maloney LT (2006) Humans rapidly estimate expected gain in movement planning. Psychol Sci 17:981-988.