Adaptive and aberrant reward prediction signals in the human brain

NeuroImage

Volumn 50, Issue 2, 2010, Pages 657-664

  Roiser, Jonathan P ^a   Stephan, Klaas E ^b,c   den Ouden, Hanneke E M ^b   Friston, Karl J ^b   Joyce, Eileen M ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Aberrant reward learning; Adaptive reward learning; Dopamine; Dorsolateral prefrontal cortex; Middle temporal gyrus; Salience attribution test (SAT); Striatum

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; CONTROLLED STUDY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEMODYNAMICS; HUMAN; HUMAN EXPERIMENT; LEARNING; MESENCEPHALON; MOTIVATION; NORMAL HUMAN; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; REWARD; STATE DEPENDENT LEARNING; STIMULUS RESPONSE; TEMPORAL LOBE; THALAMUS; VENTRAL TEGMENTUM; VOLUNTEER; BRAIN; BRAIN MAPPING; COMPUTER ASSISTED DIAGNOSIS; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY;

ADULT; BRAIN; BRAIN MAPPING; CUES; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; LEARNING; MAGNETIC RESONANCE IMAGING; REWARD;

EID: 77952299500     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2009.11.075     Document Type: Article

References (50)

1. Abi-Dargham, A., 2004. Do we still believe in the dopamine hypothesis? New data bring new evidence. Int. J. Neuropsychopharmacol. 7 (Suppl 1), S1-S5.
2. Alexander, G.E., DeLong, M.R., Strick, P.L., 1986. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 9, 357-381.
3. Berridge, K.C., Robinson, T.E., 1998. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Rev. 28, 309-369.
4. Bischoff-Grethe, A., Proper, S.M., Mao, H., Daniels, K.A., Berns, G.S., 2000. Conscious and unconscious processing of nonverbal predictability in Wernicke's area. J. Neurosci. 20, 1975-1981.
5. Blyler, C.R., Gold, J.M., Iannone, V.N., Buchanan, R.W., 2000. Short form of the WAIS-III for use with patients with schizophrenia. Schizophr. Res. 46, 209-215.
6. Brown, R.M., Crane, A.M., Goldman, P.S., 1979. Regional distribution of monoamines in the cerebral cortex and subcortical structures of the rhesus monkey: concentrations and in vivo synthesis rates. Brain Res. 168, 133-150.
7. Burgess, P.W., Dumontheil, I., Gilbert, S.J., 2007. The gateway hypothesis of rostral prefrontal cortex (area 10) function. Trends Cogn. Sci. 11, 290-298.
8. Camerer, C.F., Weber, M., 1992. Recent developments in modeling preferences: uncertainty and ambiguity. J. Risk Uncertain 5, 325-370.
9. Chew, S.H., Li, K.K., Chark, R., Zhong, S., 2008. Source preference and ambiguity aversion: models and evidence from behavioral and neuroimaging experiments. Adv. Health Econ. Health Serv. Res. 20, 179-201.
10. Christoff, K., Ream, J.M., Gabrieli, J.D., 2004. Neural basis of spontaneous thought processes. Cortex 40, 623-630.
11. Corlett, P.R., Aitken, M.R., Dickinson, A., Shanks, D.R., Honey, G.D., Honey, R.A., Robbins, T.W., Bullmore, E.T., Fletcher, P.C., 2004. Prediction error during retrospective revaluation of causal associations in humans: fMRI evidence in favor of an associative model of learning. Neuron 44, 877-888.
12. Corlett, P.R., Murray, G.K., Honey, G.D., Aitken, M.R., Shanks, D.R., Robbins, T.W., Bullmore, E.T., Dickinson, A., Fletcher, P.C., 2007. Disrupted prediction-error signal in psychosis: evidence for an associative account of delusions. Brain 130, 2387-2400.
13. Daw, N.D., O'Doherty, J.P., Dayan, P., Seymour, B., Dolan, R.J., 2006. Cortical substrates for exploratory decisions in humans. Nature 441 (7095), 876-879.
14. Fiorillo, C.D., Tobler, P.N., Schultz, W., 2003. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898-1902.
15. Garcia-Cabezas, M.A., Rico, B., Sanchez-Gonzalez, M.A., Cavada, C., 2007. Distribution of the dopamine innervation in the macaque and human thalamus. Neuroimage 34, 965-984.
16. Gilbert, S.J., Spengler, S., Simons, J.S., Frith, C.D., Burgess, P.W., 2006. Differential functions of lateral and medial rostral prefrontal cortex (area 10) revealed by brain-behavior associations. Cereb. Cortex 16, 1783-1789.
17. Grace, A.A., Floresco, S.B., Goto, Y., Lodge, D.J., 2007. Regulation of firing of dopaminergic neurons and control of goal-directed behaviors. Trends Neurosci. 30, 220-227.
18. Gray, J.A., Feldon, J., Rawlins, J., Hemsley, D.R., Smith, A.D., 1991. The neuropsychology of schizophrenia. Behav. Brain Sci. 14, 1-84.
19. Huettel, S.A., Stowe, C.J., Gordon, E.M., Warner, B.T., Platt, M.L., 2006. Neural signatures of economic preferences for risk and ambiguity. Neuron 49, 765-775.
20. Jensen, J., Willeit, M., Zipursky, R.B., Savina, I., Smith, A.J., Menon, M., Crawley, A.P., Kapur, S., 2008. The formation of abnormal associations in schizophrenia: neural and behavioral evidence. Neuropsychopharmacology 33, 473-479.
21. Kapur, S., 2003. Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am. J. Psychiatry 160, 13-23.
22. King, R., Barchas, J.D., Huberman, B.A., 1984. Chaotic behavior in dopamine neurodynamics. Proc. Natl. Acad. Sci. U. S. A. 81, 1244-1247.
23. Knutson, B., Adams, C.M., Fong, G.W., Hommer, D., 2001. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J. Neurosci. 21, RC159.
24. Knutson, B., Bjork, J.M., Fong, G.W., Hommer, D., Mattay, V.S., Weinberger, D.R., 2004. Amphetamine modulates human incentive processing. Neuron 43, 261-269.
25. Lawrence, A.D., Sahakian, B.J., Robbins, T.W., 1998. Cognitive functions and corticostriatal circuits: insights from Huntington's disease. Trends Cogn. Sci. 2, 379-388.
26. Mackintosh, N.J., 1975. A theory of attention: variations in the associability of stimuli with reinforcement. Psychol. Rev. 82, 276-298.
27. Mai, J.K., Assheuer, J., Paxinos, G., 2003. Atlas of the Human Brain, 2nd ed. Academic Press, San Diego.
28. Montague, P.R., Hyman, S.E., Cohen, J.D., 2004. Computational roles for dopamine in behavioural control. Nature 431, 760-767.
29. Morris, J.S., Friston, K.J., Dolan, R.J., 1997. Neural responses to salient visual stimuli. Proc. Biol. Sci. 264, 769-775.
30. Murray, G.K., Corlett, P.R., Clark, L., Pessiglione, M., Blackwell, A.D., Honey, G., Jones, P.B., Bullmore, E.T., Robbins, T.W., Fletcher, P.C., 2008. Substantia nigra/Ventral tegmental reward prediction error disruption in psychosis. Mol. Psychiatry 13 (239), 267-276.
31. Oades, R.D., Halliday, G.M., 1987. Ventral tegmental (A10) system: neurobiology. 1. Anatomy and connectivity. Brain Res. 434, 117-165.
32. Ongur, D., Price, J.L., 2000. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb. Cortex 10, 206-219.
33. Ongur, D., Ferry, A.T., Price, J.L., 2003. Architectonic subdivision of the human orbital and medial prefrontal cortex. J. Comp. Neurol. 460, 425-449.
34. Pearce, J.M., Hall, G., 1980. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87, 532-552.
35. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R.J., Frith, C.D., 2006. Dopaminedependent prediction errors underpin reward-seeking behaviour in humans. Nature 442, 1042-1045.
36. Preuschoff, K., Bossaerts, P., Quartz, S.R., 2006. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51, 381-390.
37. Robinson, D.L., Petersen, S.E., 1992. The pulvinar and visual salience. Trends Neurosci. 15, 127-132.
38. Roiser, J.P., Stephan, K.E., den Ouden, H.E., Barnes, T.R., Friston, K.J., Joyce, E.M., 2009. Do patients with schizophrenia exhibit aberrant salience? Psychol. Med. 39, 199-209.
39. Sanchez-Gonzalez, M.A., Garcia-Cabezas, M.A., Rico, B., Cavada, C., 2005. The primate thalamus is a key target for brain dopamine. J. Neurosci. 25, 6076-6083.
40. Schultz, W., Dayan, P., Montague, P.R., 1997. A neural substrate of prediction and reward. Science 275, 1593-1599.
41. Shaner, A., 1999. Delusions, superstitious conditioning and chaotic dopamine neurodynamics. Med. Hypotheses 52, 119-123.
42. Sheehan, D.V., Lecrubier, Y., Sheehan, K.H., Amorim, P., Janavs, J., Weiller, E., Hergueta, T., Baker, R., Dunbar, G.C., 1998. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J. Clin. Psychiatry 59 (Suppl 20), 22-33 quiz 34-57.
43. Small, D.M., Gitelman, D., Simmons, K., Bloise, S.M., Parrish, T., Mesulam, M.M., 2005. Monetary incentives enhance processing in brain regions mediating top-down control of attention. Cereb. Cortex 15, 1855-1865.
44. Strange, B.A., Duggins, A., Penny, W., Dolan, R.J., Friston, K.J., 2005. Information theory, novelty and hippocampal responses: unpredicted or unpredictable? Neural Netw. 18, 225-230.
45. Tsai, H.C., Zhang, F., Adamantidis, A., Stuber, G.D., Bonci, A., de Lecea, L., Deisseroth, K., 2009. Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324, 1080-1084.
46. Voorn, P., Jorritsma-Byham, B., Van Dijk, C., Buijs, R.M., 1986. The dopaminergic innervation of the ventral striatum in the rat: a light- and electron-microscopical study with antibodies against dopamine. J. Comp. Neurol. 251, 84-99.
47. Waltz, J.A., Gold, J.M., 2007. Probabilistic reversal learning impairments in schizophrenia: further evidence of orbitofrontal dysfunction. Schizophr. Res. 93, 296-303.
48. Waltz, J.A., Frank, M.J., Robinson, B.M., Gold, J.M., 2007. Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction. Biol. Psychiatry 62, 756-764.
49. Weiskopf, N., Hutton, C., Josephs, O., Deichmann, R., 2006. Optimal EPI parameters for reduction of susceptibility-induced BOLD sensitivity losses: a whole-brain analysis at 3 T and 1.5 T. Neuroimage 33, 493-504.
50. Weiskopf, N., Sitaram, R., Josephs, O., Veit, R., Scharnowski, F., Goebel, R., Birbaumer, N., Deichmann, R., Mathiak, K., 2007. Real-time functional magnetic resonance imaging: methods and applications. Magn. Reson. Imaging 25, 989-1003.