Neural coding of distinct statistical properties of reward information in humans

Cerebral Cortex

Volumn 16, Issue 4, 2006, Pages 561-573

  Dreher, Jean Claude ^a,b,c   Kohn, Philip ^a   Berman, Karen Faith ^a  

^a NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

^b INSTITUT DES SCIENCES COGNITIVES   (France)

^c CNRS   (France)

Author keywords

Dopamine; Error prediction; fMRI; Gambling; Information theory; Uncertainty

Indexed keywords

ADULT; ANALYTICAL ERROR; ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; EVENT RELATED POTENTIAL; FEMALE; HUMAN; MALE; MESENCEPHALON; MOTIVATION; NERVE CELL NETWORK; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; POSTSYNAPTIC MEMBRANE; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; PROBABILITY; REWARD;

ADULT; CONDITIONING, OPERANT; DISCRIMINATION LEARNING; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; MESENCEPHALON; PSYCHOMOTOR PERFORMANCE; REWARD;

EID: 33644918886     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhj004     Document Type: Article

References (54)

1. Apicella P, Scarnati E, Ljungberg T, Schultz W (1992) Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J Neurophysiol 68:945-960.
2. Aron AR, Shohamy D, Clark J, Myers C, Gluck MA, Poldrack RA (2004) Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. J Neurophysiol 92:1144-1152.
3. Berns GS, Mc Clure SM, Pagnoni G, Montague PR (2001) Predictability modulates human brain response to reward. J Neurosci 21:2793-2798.
4. Berridge KC, Robinson TE (1998) What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28:309-369.
5. Bradberry CW (2000) Acute and chronic dopamine dynamics in a non-human primate model of recreational cocaine use. J Neurosci 20:7109-7115.
6. Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P (2001) Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30:619-639.
7. Corlett PR, Aitken MR, Dickinson A, Shanks DR, Honey GD, Honey RA, et al. (2004) Prediction error during retrospective revaluation of causal associations in humans: fMRI evidence in favor of an associative model of learning. Neuron 44:877-888.
8. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and striatal systems for behavioural control. COSYNE 2005, Computational and Systems Neuroscience. Salt Lake City, UT.
9. Dayan P, Balleine BW (2002) Reward, motivation, and reinforcement learning. Neuron 36:285-298.
10. Dehaene S, Changeux JP (2000) Reward-dependent learning in neuronal networks for planning and decision making. Prog Brain Res 126:217-229.
11. Dreher JC, Burnod Y (2002) An integrative theory of the phasic and tonic modes of dopamine modulation in the prefrontal cortex. Neural Netw 15:583-602.
12. Dreher JC, Guigon E, Burnod Y (2002a) A model of prefrontal cortex dopaminergic modulation during the delayed alternation task. J Cogn Neurosci 14:853-865.
13. Dreher JC, Koechlin E, Ali SO, Grafman J (2002b) The roles of timing and task order during task switching. Neuroimage 17:95-109.
14. Elliott R, Newman JL, Longe OA, William Deakin JF (2004) Instrumental responding for rewards is associated with enhanced neuronal response in subcortical reward systems. Neuroimage 21:984-990.
15. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-1902.
16. Fletcher PC, Anderson JM, Shanks DR, Honey R, Carpenter TA, Donovan T, et al. (2001) Responses of human frontal cortex to surprising events are predicted by formal associative learning theory. Nat Neurosci 4:1043-1048.
17. Glimcher PW (2003) The neurobiology of visual-saccadic decision making. Annu Rev Neurosci 26:133-179.
18. Heberlein K, Hu X (1991) Improved shim by subject head positioning. ISMRM (International Society of Magnetic Resonance in Medicine), 9th Annual Meeting, Glasgow, p.1157.
19. Holroyd CB, Coles MG, Nieuwenhuis S (2002) Medial prefrontal cortex and error potentials. Science 296:1610-1611.
20. Holroyd CB, Nieuwenhuis S, Yeung N, Nystrom L, Mars RB, Coles MG, et al. (2004) Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nat Neurosci 7:497-498.
21. Ito R, Dalley JW, Robbins TW, Everitt BJ (2002) Dopamine release in the dorsal striatum during cocaine-seeking behavior under the control of a drug-associated cue. J Neurosci 22:6247-6253.
22. Kersten D, Mamassian P, Yuille A (2004) Object perception as Bayesian inference. Annu Rev Psychol 55:271-304.
23. Knutson B, Adams CM, Fong GW, Hommer D (2001) Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21:RC159.
24. Kobayashi S, Lauwereyns J, Koizumi M, Sakagami M, Hikosaka O (2002) Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J Neurophysiol 87:1488-1498.
25. Koechlin E, Ody C, Kouneiher F (2003) The architecture of cognitive control in the human prefrontal cortex. Science 302:1181-1185.
26. Kording KP, Wolpert DM (2004) Bayesian integration in sensorimotor learning. Nature 427:244-247.
27. Kringelbach ML, de Araujo IE, Rolls ET (2004) Taste-related activity in the human dorsolateral prefrontal cortex. Neuroimage 21:781-788.
28. Logothetis NK, Pauls J, Augath M, Trinath T, Oeltermann A (2001) Neurophysiological investigation of the basis of the fMRI signal. Nature 412:150-157.
29. Lucerna S, Salpietro FM, Alafaci C, Tomasello F (2002) In vivo atlas of deep brain structures. Berlin, Heidelberg, New York: Springer-Verlag.
30. McClure SM, Berns GS, Montague PR (2003) Temporal prediction errors in a passive learning task activate human striatum. Neuron 38:339-346.
31. Mellers BA (2000) Choice and the relative pleasure of consequences. Psychol Bull 126:910-924.
32. Nishijo H, Ono T, Nishino H (1988) Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance. J Neurosci 8:3570-3583.
33. Niv Y, Duff MO, Dayan P (2005) Dopamine, uncertainty and TD learning. Behav Brain Func 1:6.
34. O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ (2002) Neural responses during anticipation of a primary taste reward. Neuron 33:815-826.
35. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337.
36. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454.
37. Pagnoni G, Zink CF, Montague PR, Berns GS (2002) Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci 5:97-98.
38. Paulus MP, Feinstein JS, Tapert SF, Liu TT (2004) Trend detection via temporal difference model predicts inferior prefrontal cortex activation during acquisition of advantageous action selection. Neuroimage 21:733-743.
39. Pearce JM, Hall G (1980) A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev 87:532-552.
40. Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400:233-238.
41. Ramnani N, Elliott R, Athwal BS, Passingham RE (2004) Prediction error for free monetary reward in the human prefrontal cortex. Neuroimage 23:777-786.
42. Salamone JD, Correa M, Mingote SM, Weber SM (2005) Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr Opin Pharmacol 5:34-41.
43. Satoh T, Nakai S, Sato T, Kimura M (2003) Correlated coding of motivation and outcome of decision by dopamine neurons. J Neurosci 23:9913-9923.
44. Schall JD, Stuphorn V, Brown JW (2002) Monitoring and control of action by the frontal lobes. Neuron 36:309-322.
45. Schoenbaum G, Chiba AA, Gallagher M (1998) Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat Neurosci 1:155-159.
46. Schultz W (2000) Multiple reward signals in the brain. Nat Rev Neurosci 1:199-207.
47. Schultz W (2002) Getting formal with dopamine and reward. Neuron 36:241-263.
48. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
49. Sesack SR, Carr DB, Omelchenko N, Pinto A (2003) Anatomical substrates for glutamate-dopamine interactions: evidence for specificity of connections and extrasynaptic actions. Ann NY Acad Sci 1003:36-52.
50. Shannon CE (1948) A mathematical theory of communication. Bell Sys Tech J 27:379-423.
51. Shidara M, Aigner TG, Richmond BJ (1998) Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J Neurosci 18:2613-2625.
52. Tricomi EM, Delgado MR, Fiez JA (2004) Modulation of caudate activity by action contingency. Neuron 41:281-292.
53. Waelti P, Dickinson A, Schultz W (2001) Dopamine responses comply with basic assumptions of formal learning theory. Nature 412:43-48.
54. Watanabe M, Hikosaka K, Sakagami M, Shirakawa S (2002) Coding and monitoring of motivational context in the primate prefrontal cortex. J Neurosci 22:2391-2400.