Transient activation of midbrain dopamine neurons by reward risk

Neuroscience

Volumn 197, Issue , 2011, Pages 162-171

  Fiorillo, C D ^a,b  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Dopamine; Exploration; Reinforcement learning; Reward; Risk; Uncertainty

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BRAIN NERVE CELL; CELL ACTIVATION; CONTROLLED STUDY; DOPAMINERGIC NERVE CELL; FEMALE; HAPLORHINI; MALE; MESENCEPHALON; NONHUMAN; PRIORITY JOURNAL; REINFORCEMENT; REWARD; REWARD RISK; RISK SEEKING BEHAVIOR; TRAINING; VISUAL STIMULATION;

ANIMALS; CHOICE BEHAVIOR; CONDITIONING, CLASSICAL; DOPAMINERGIC NEURONS; FEMALE; MACACA MULATTA; MALE; MESENCEPHALON; MOTIVATION; REWARD; RISK-TAKING;

EID: 82855165025     PISSN: 03064522     EISSN: 18737544     Source Type: Journal    
DOI: 10.1016/j.neuroscience.2011.09.037     Document Type: Article

References (29)

1. Ambermoon P., Carter A., Hall W.D., Dissanayaka N.N., O'Sullivan J.D.) Impulse control disorders in patients with Parkinson's disease receiving dopamine replacement therapy: evidence and implications for the addictions field. Addiction 2011, 106:283-293.
2. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47:129-141.
3. Blatter K., Schultz W. Rewarding properties of visual stimuli. Exp Brain Res 2006, 168:541-546.
4. Bromberg-Martin E.S., Hikosaka O. Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 2009, 63:119-126.
5. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 2006, 441:876-879.
6. Fiorillo C.D., Newsome W.T., Schultz W. The temporal precision of reward prediction in dopamine neurons. Nat Neurosci 2008, 11:966-973.
7. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
8. Frank M.J., Doll B.B., Oas-Terpstra J., Moreno F. Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat Neurosci 2009, 12:1062-1068.
9. Hayden B.Y., Heilbronner S.R., Nair A.C., Platt M.L. Cognitive influences on risk-seeking by rhesus macaques. Judgm Decis Mak 2008, 3:389-395.
10. Hayden B.Y., Platt M.L. Temporal discounting predicts risk sensitivity in rhesus macaques. Curr Biol 2007, 17:49-53.
11. Kacelnik A., Brito e Abreu F. Risky choice and Weber's Law. J Theor Biol 1998, 194:289-298.
12. Kahneman D., Tversky A. Prospect theory: an analysis of decision under risk. Econometrica 1979, 47:263-292.
13. Kakade S., Dayan P. Dopamine: generalization and bonuses. Neur Networks 2002, 15:549-559.
14. Ljungberg T., Apicella P., Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 1992, 67:145-163.
15. McClure S.M., Gilzenrat M.S., Cohen J.D. An exploration-exploitation model based on norepinepherine and dopamine activity. Advances in Neural Information Processing Systems 2006, Vol. 18:867-874. MIT Press, Cambridge.
16. McCoy A.N., Platt M.L. Risk-sensitive neurons in macaque posterior cingulate cortex. Nat Neurosci 2005, 8:1220-1227.
17. Merrill E.G., Ainsworth A. Glass-coated platinum-plated tungsten microelectrodes. Med Biol Eng 1972, 10:662-672.
18. Morris G., Nevet A., Arkadir D., Vaadia E., Bergmann H. Midbrain dopamine neurons encode decisions for future action. Nat Neurosci 2006, 9:1057-1063.
19. Niemeier M., Crawford J.D., Tweed D. Optimal transsaccadic integration explains distorted spatial perception. Nature 2003, 422:76-80.
20. Paxinos G., Huang X.F., Toga A.W. The Rhesus Monkey Brain in Stereotaxic Coordinates 2000, Academic Press, San Diego.
21. Pearce J.M., Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev 1980, 87:532-552.
22. Roesch M.R., Calu D.J., Schoenbaum G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat Neurosci 2007, 10:1615-1624.
23. Schultz W., Dayan P., Montague R.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
24. Schultz W., Romo R. Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey. J Neurophysiol 1987, 57:201-217.
25. So N.Y., Stuphorn V. Supplementary eye field encodes option and action value for saccades with variable reward. J Neurophysiol 2010, 104:2634-2653.
26. Tobler P.N., Fiorillo C.D., Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005, 307:1642-1645.
27. Weiss Y., Simoncelli E.P., Adelson E.H. Motion illusions as optimal percepts. Nat Neurosci 2002, 5:598-604.
28. Wise R.A. Dopamine, learning and motivation. Nat Rev Neurosci 2004, 5:483-494.
29. Yang Z., Purves D. A statistical explanation of visual space. Nat Neurosci 2003, 6:632-640.