Expected value and prediction error abnormalities in depression and schizophrenia

Brain

Volumn 134, Issue 6, 2011, Pages 1751-1764

  Gradin, Victoria B ^a,b   Kumar, Poornima ^c   Waiter, Gordon ^b   Ahearn, Trevor ^b   Stickle, Catriona ^b   Milders, Marteen ^b   Reid, Ian ^b   Hall, Jeremy ^d   Steele, J Douglas ^a  

^a UNIVERSITY OF DUNDEE   (United Kingdom)

^b UNIVERSITY OF ABERDEEN   (United Kingdom)

^c UNIVERSITY OF OXFORD   (United Kingdom)

^d UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

dopamine; major depression; model based fMRI; prediction error; schizophrenia

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ANHEDONIA; ARTICLE; BECK DEPRESSION INVENTORY; CAUDATE NUCLEUS; CLINICAL ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; DISEASE SEVERITY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HAMILTON SCALE; HIPPOCAMPUS; HUMAN; INSULA; LEARNING; MAJOR DEPRESSION; MALE; MEASUREMENT ERROR; MESENCEPHALON; NATIONAL ADULT READING TEST; NEGATIVE SYNDROME; NUCLEUS ACCUMBENS; PARAHIPPOCAMPAL GYRUS; POSITIVE AND NEGATIVE SYNDROME SCALE; PREDICTION; PRIORITY JOURNAL; PSYCHOLOGICAL RATING SCALE; PSYCHOSIS; REWARD; SCHIZOPHRENIA; SIGNAL TRANSDUCTION; TASK PERFORMANCE; THALAMUS;

EID: 79957836466     PISSN: 00068950     EISSN: 14602156     Source Type: Journal    
DOI: 10.1093/brain/awr059     Document Type: Article

References (58)

1. Andrzejewski ME, Spencer RC, Kelley AE. Instrumental learning, but not performance, requires dopamine D1-receptor activation in the amygdala. Neuroscience 2005; 135: 335-45. (Pubitemid 41317373)
2. Beck AT, Ward HC, Mendelson M. An inventory for measuring depression. Arch Gen Psychiatry 1961; 4: 561-71.
3. Berke JD, Hyman SE. Addiction, dopamine, and the molecular mechanisms of memory. Neuron 2000; 25: 515-32.
4. Berridge KC. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 2007; 191: 391-431. (Pubitemid 46355895)
5. Berridge KC, Robinson TE. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Rev 1998; 28: 309-69. (Pubitemid 29012677)
6. Corlett PR, Murray GK, Honey GD, Aitken MR, Shanks DR, Robbins TW, et al. Disrupted prediction-error signal in psychosis: evidence for an associative account of delusions. Brain 2007; 130: 2387-400. (Pubitemid 47327635)
7. Craig AD. How do you feel-now? The anterior insula and human awareness. Nat Rev Neurosci 2009; 10: 59-70.
8. Dalley JW, Laane K, Theobald DE, Armstrong HC, Corlett PR, Chudasama Y, et al. Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens. Proc Natl Acad Sci USA 2005; 102: 6189-94. (Pubitemid 40594276)
9. Daw ND. Trial-by-trial data analysis using computational models. Attention & Performance, 2009.
10. Dayan P, Abbott LF. Theoretical neuroscience: computational and mathematical modelling of neural systems Cambridge, MA: The MIT Press; 2001.
11. Dunlop BW, Nemeroff CB. The role of dopamine in the pathophysiology of depression. Arch Gen Psychiatry 2007; 64: 327-37. (Pubitemid 46376789)
12. Elliott R, Sahakian BJ, Michael A, Paykel ES, Dolan RJ. Abnormal neural response to feedback on planning and guessing tasks in patients with unipolar depression. Psychol Med 1998; 28: 559-71. (Pubitemid 28241289)
13. Epstein J, Pan H, Kocsis JH, Yang Y, Butler T, Chusid J, et al. Lack of ventral striatal response to positive stimuli in depressed versus normal subjects. Am J Psychiatry 2006; 163: 1784-90. (Pubitemid 44522488)
14. Fletcher PC, Frith CD. Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia. Nat Rev Neurosci 2009; 10: 48-58.
15. Friston K. Introduction to statistical parametric mapping. In: Frackowiak RSJ, editor. Human brain function. London: Academic Press; 2004.
16. Frith C, Johnstone EC. Schizophrenia: a very short introduction. Oxford: Oxford University Press; 2003.
17. Glascher J, Hampton AN, O'Doherty JP. Determining a role for ventro-medial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex 2009; 19: 483-95.
18. Gottfried JA, O'Doherty J, Dolan RJ. Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 2003; 301: 1104-7. (Pubitemid 37022314)
19. Guillin O, Abi-Dargham A, Laruelle M. Neurobiology of dopamine in schizophrenia. Int Rev Neurobiol 2007; 78: 1-39.
20. Hall J, Romaniuk L, McIntosh AM, Steele JD, Johnstone EC, Lawrie SM. Associative learning and the genetics of schizophrenia. Trends Neurosci 2009; 32: 359-65.
21. Hamilton M. Rating scale for depression. J Neurol Neurosurg Psychiatry 1960; 23: 56-62.
22. Hampton AN, Bossaerts P, O'Doherty JP. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J Neurosci 2006; 26: 8360-7. (Pubitemid 44309850)
23. Harris D, Batki SL. Stimulant psychosis: symptom profile and acute clinical course. Am J Addict 2000; 9: 28-37. (Pubitemid 30155031)
24. Huys QJM, Vogelstein JT, Dayan P. Psychiatry: insights into depression through normative decision-making models. Adv Neural Inf Process Syst 2009.
25. Juckel G, Schlagenhauf F, Koslowski M, Filonov D, Wustenberg T, Villringer A, et al. Dysfunction of ventral striatal reward prediction in schizophrenic patients treated with typical, not atypical, neuroleptics. Psychopharmacology 2006a; 187: 222-8. (Pubitemid 44015616)
26. Juckel G, Schlagenhauf F, Koslowski M, Wustenberg T, Villringer A, Knutson B, et al. Dysfunction of ventral striatal reward prediction in schizophrenia. Neuroimage 2006b; 29: 409-16. (Pubitemid 43063297)
27. Kapur S. Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am J Psychiatry 2003; 160: 13-23. (Pubitemid 36042420)
28. Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (Positive and Negative Syndrome Scale) for schizophrenia. Schizophr Bull 1987; 13: 261-76. (Pubitemid 18039085)
29. Keedwell PA, Andrew C, Williams SC, Brammer MJ, Phillips ML. The neural correlates of anhedonia in major depressive disorder. Biol Psychiatry 2005; 58: 843-53. (Pubitemid 41790711)
30. Kim H, Shimojo S, O'Doherty JP. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol 2006; 4: e233.
31. Knutson B, Bjork JM, Fong GW, Hommer D, Mattay VS, Weinberger DR. Amphetamine modulates human incentive processing. Neuron 2004; 43: 261-9. (Pubitemid 38942965)
32. Koch K, Schachtzabel C, Wagner G, Schikora J, Schultz C, Reichenbach JR, et al. Altered activation in association with reward-related trial-and-error learning in patients with schizophrenia. Neuroimage 2010; 50: 223-32.
33. Kumar P, Waiter G, Ahearn T, Milders M, Reid I, Steele JD. Abnormal temporal difference reward-learning signals in major depression. Brain 2008; 131: 2084-93.
34. McClure SM, Berns GS, Montague PR. Temporal prediction error in a passive learning task activate human striatum. Neuron 2003a; 38: 339-46. (Pubitemid 36555658)
35. McClure SM, Daw ND, Montague PR. A computational substrate for incentive salience. Trends in Neurosciences 2003b; 26: 423-8. (Pubitemid 37288977)
36. Montague PR, Dayan P, Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 1996; 16: 1936-47. (Pubitemid 26145969)
37. Murray GK, Corlett PR, Clark L, Pessiglione M, Blackwell AD, Honey G, et al. Substantia nigra/ventral tegmental reward prediction error disruption in psychosis. Mol Psychiatry 2007; 12: 46-77.
38. Nelson HE, Wilson JR. The revised national adult reading test - test manual. Winsor: NFER-Wilson; 1991.
39. Niv Y, Daw ND, Dayan P. Choice values. Nat Neurosci 2006; 9: 987-8. (Pubitemid 44264904)
40. O'Doherty J, Critchley H, Deichmann R, Dolan RJ. Dissociating valence of outcome from behavioral control in human orbital and ventral pre-frontal cortices. J Neurosci 2003a; 23: 7931-9. (Pubitemid 37052362)
41. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004; 304: 452-4. (Pubitemid 38495943)
42. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ. Temporal difference models and reward-related learning in the human brain. Neuron 2003b; 38: 329-37. (Pubitemid 36555657)
43. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction error underpin reward-seeking behaviour in humans. Nature 2006; 442: 1042-5. (Pubitemid 44330261)
44. Pizzagalli D, Holmes AJ, Dillon DG, Goetz EL, Birk JL, Bogdan R, et al. Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. Am J Psychiatry 2009; 166: 702-10.
45. Pizzagalli D, Iosifescu D, Hallett LA, Ratner KG, Fava M. Reduced he-donic capacity in major depressive disorder: evidence from a probabilistic reward task. J Psychiatr Res 2008; 43: 76-87.
46. Preuschoff K, Quartz SR, Bossaerts P. Human insula activation reflects risk prediction error as well as risk. J Neurosci 2008; 28: 2745-52. (Pubitemid 351398874)
47. Roiser JP, Stephan KE, den Ouden HE, Barnes TR, Friston KJ, Joyce EM. Do patients with schizophrenia exhibit aberrant salience? Psychol Med 2009; 39: 199-209.
48. Romaniuk L, Honey GD, King JRL, Whalley HC, McIntosh AM, Levita L, et al. Midbrain activation during Pavlovian conditioning and delusional symptoms in schizophrenia. Arch Gen Psychiatry 2010; 67: 1246-54.
49. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 1998; 80: 1-27. (Pubitemid 28326237)
50. Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science 1997; 275: 1593-9. (Pubitemid 27120526)
51. Seymour B, O'Doherty JP, Koltzenburg M, Wiech K, Frackowiak R, Friston K, et al. Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat Neurosci 2005; 8: 1234-40. (Pubitemid 43348143)
52. Sims A. Symptoms in the mind. London: Saunders; 2005.
53. Slotnick SD, Moo LR, Segal JB, Hart J Jr. Distinct prefrontal cortex activity associated with item memory and source memory for visual shapes. Brain Res Cogn Brain Res 2003; 17: 75-82. (Pubitemid 36577543)
54. Spielberger CD. State-trait anxiety inventory for adults, STAI Form Y-1. Palo-Alto: Mind Garden; 1983.
55. Steele JD, Kumar P, Ebmeier KP. Blunted response to feedback information in depressive illness. Brain 2007; 130: 2367-74. (Pubitemid 47327628)
56. Sutton RS, Barto AG. Reinforcement learning. Cambridge, MA: MIT Press; 1998.
57. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W. Human neural learning depends on reward prediction error in the blocking paradigm. J Neurophysiol 2006; 95: 301-10. (Pubitemid 44698936)
58. Waltz JA, Schweitzer JB, Gold JM, Kurup PK, Ross TJ, Salmeron BJ, et al. Patients with schizophrenia have a reduced neural response to both un predictable and predictable primary reinforcers. Neuropsychopharmacology 2009; 34: 1567-77.