Aberrant salience is related to reduced reinforcement learning signals and elevated dopamine synthesis capacity in healthy adults

Journal of Neuroscience

Volumn 35, Issue 28, 2015, Pages 10103-10111

  Boehme, Rebecca ^a   Deserno, Lorenz ^a,b,c   Gleich, Tobias ^a   Katthagen, Teresa ^a   Pankow, Anne ^a   Behr, Joachim ^a,d   Buchert, Ralph ^a   Roiser, Jonathan P ^e   Heinz, Andreas ^a   Schlagenhauf, Florian ^a,b  

^a CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^b MAX PLANCK INSTITUTE FOR HUMAN COGNITIVE AND BRAIN SCIENCES   (Germany)

^c OTTO VON GUERICKE UNIVERSITY   (Germany)

^d BRANDENBURG MEDICAL SCHOOL THEODOR FONTANE   (Germany)

^e UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Aberrant salience; Dopamine; Orbitofrontal cortex; Prediction error; Reinforcement learning; Ventral striatum

Indexed keywords

LEVODOPA; DOPAMINE; DOPAMINE RECEPTOR STIMULATING AGENT; FLUORODEOXYGLUCOSE F 18; OXYGEN;

ADULT; ARTICLE; DOPAMINE METABOLISM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INSTRUMENTAL CONDITIONING; MALE; NORMAL HUMAN; ORBITAL CORTEX; POSITRON EMISSION TOMOGRAPHY; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT; REWARD; SALIENCE NETWORK; VENTRAL STRIATUM; ADOLESCENT; BLOOD; CORPUS STRIATUM; DIAGNOSTIC USE; IMAGE PROCESSING; METABOLISM; NUCLEAR MAGNETIC RESONANCE IMAGING; PATHOPHYSIOLOGY; PRODROMAL SYMPTOM; PSYCHOTIC DISORDERS; REACTION TIME; SCINTISCANNING; VASCULARIZATION; YOUNG ADULT;

ADOLESCENT; ADULT; CONDITIONING, OPERANT; CORPUS STRIATUM; DOPAMINE; DOPAMINE AGENTS; FEMALE; FLUORODEOXYGLUCOSE F18; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEVODOPA; MAGNETIC RESONANCE IMAGING; MALE; OXYGEN; POSITRON-EMISSION TOMOGRAPHY; PRODROMAL SYMPTOMS; PSYCHOTIC DISORDERS; REACTION TIME; REINFORCEMENT (PSYCHOLOGY); YOUNG ADULT;

EID: 84937611455     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.0805-15.2015     Document Type: Article

References (67)

1. Abi-Dargham A, Rodenhiser J, Printz D, Zea-Ponce Y, Gil R, Kegeles LS, Weiss R, Cooper TB, Mann JJ, Van Heertum RL, Gorman JM, LaruelleM (2000) Increased baseline occupancy of D2 receptors by dopamine in schizophrenia. Proc Natl Acad Sci U S A 97:8104-8109. CrossRef Medline
2. Ashburner J, Friston KJ (2005) Unified segmentation. Neuroimage 26:839- 851. CrossRef Medline
3. Bay-Richter C, O'Tuathaigh CM, O'Sullivan G, Heery DM, Waddington JL, Moran PM (2009) Enhanced latent inhibition in dopamine receptor-deficient mice is sex-specific for the D1 but not D2 receptor subtype: implications for antipsychotic drug action. Int J Neuropsychopharmacol 12:403- 414. Medline
4. Boureau YL, Dayan P (2011) Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology 36:74 -97. CrossRef Medline
5. Clarke HF, Cardinal RN, Rygula R, Hong YT, Fryer TD, Sawiak SJ, Ferrari V, Cockcroft G, Aigbirhio FI, Robbins TW, Roberts AC (2014) Orbitofrontal dopamine depletion upregulates caudate dopamine and alters behavior via changes in reinforcement sensitivity. J Neurosci 34:7663-7676. CrossRef Medline
6. Corlett PR, Fletcher PC (2012) The neurobiology of schizotypy: frontostriatal prediction error signal correlates with delusion-like beliefs in healthy people. Neuropsychologia 50:3612-3620. CrossRef Medline
7. Corlett PR, Murray GK, Honey GD, Aitken MR, Shanks DR, Robbins TW, Bullmore ET, Dickinson A, Fletcher PC (2007) Disrupted predictionerror signal in psychosis: evidence for an associative account of delusions. Brain 130:2387-2400. CrossRef Medline
8. D'Ardenne K, McClure SM, Nystrom LE, Cohen JD (2008) BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319:1264 -1267. CrossRef Medline
9. Deserno L, Boehme R, Heinz A, Schlagenhauf F (2013) Reinforcement learning and dopamine in schizophrenia: dimensions of symptoms or specific features of a disease group? Front Psychiatry 4:172. CrossRef Medline
10. Deserno L, Huys QJ, Boehme R, Buchert R, Heinze HJ, Grace AA, Dolan RJ, Heinz A, Schlagenhauf F (2015) Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making. Proc Natl Acad Sci U S A 112:1595-1600. CrossRef Medline
11. Egerton A, Chaddock CA, Winton-Brown TT, Bloomfield MA, Bhattacharyya S, Allen P, McGuire PK, Howes OD (2013) Presynaptic striatal dopamine dysfunction in people at ultra-high risk for psychosis: findings in a second cohort. Biol Psychiatry 74:106 -112. CrossRef Medline
12. Ewing SG, Grace AA (2013) Long-term high frequency deep brain stimulation of the nucleus accumbens drives time-dependent changes in functional connectivity in the rodent limbic system. Brain Stimul 6:274 -285. CrossRef Medline
13. First MB, Spitzer RL, Gibbon M, Williams J (2001) Structured clinical interview for DSM-IV-TR Axis I disorders, research version, patient edition with psychotic screen (SCID-I/P W/PSY SCREEN). New York: New York State Psychiatric Institute.
14. Fusar-Poli P, Howes OD, Allen P, Broome M, Valli I, Asselin MC, Grasby PM, McGuire PK (2010) Abnormal frontostriatal interactions in people with prodromal signs of psychosis: a multimodal imaging study. Arch Gen Psychiatry 67:683- 691. CrossRef Medline
15. Goto Y, Grace AA (2008) Limbic and cortical information processing in the nucleus accumbens. Trends Neurosci 31:552-558. CrossRef Medline
16. Grace AA (2012) Dopamine system dysregulation by the hippocampus: implications for the pathophysiology and treatment of schizophrenia. Neuropharmacology 62:1342-1348. CrossRef Medline
17. Gradin VB, Kumar P, Waiter G, Ahearn T, Stickle C, Milders M, Reid I, Hall J, Steele JD (2011) Expected value and prediction error abnormalities in depression and schizophrenia. Brain 134:1751-1764. CrossRef Medline
18. Greenberg BD, Murphy DL, Rasmussen SA (2000) Neuroanatomically based approaches to obsessive-compulsive disorder. Neurosurgery and transcranial magnetic stimulation. Psychiatr Clin North Am 23:671- 686, xii. CrossRef Medline
19. Haber SN, Kunishio K, Mizobuchi M, Lynd-Balta E (1995) The orbital and medial prefrontal circuit through the primate basal ganglia. J Neurosci 15:4851- 4867. Medline
20. Heinz A (2002) Dopaminergic dysfunction in alcoholism and schizophrenia- psychopathological and behavioral correlates. Eur Psychiatry 17:9 -16. CrossRef Medline
21. Heinz A, Schlagenhauf F (2010) Dopaminergic dysfunction in schizophrenia: salience attribution revisited. Schizophr Bull 36:472- 485. CrossRef Medline
22. Howes OD, Kapur S (2009) The dopamine hypothesis of schizophrenia: version III-the final common pathway. Schizophr Bull 35:549 -562. CrossRef Medline
23. Howes OD, Montgomery AJ, Asselin MC, Murray RM, Valli I, Tabraham P, Bramon-Bosch E, Valmaggia L, Johns L, Broome M, McGuire PK, Grasby PM (2009) Elevated striatal dopamine function linked to prodromal signs of schizophrenia. Arch Gen Psychiatry 66:13-20. CrossRef Medline
24. Howes OD, Kambeitz J, Kim E, Stahl D, Slifstein M, Abi-Dargham A, Kapur S (2012) The nature of dopamine dysfunction in schizophrenia and what this means for treatment. Arch Gen Psychiatry 69:776 -786. CrossRef Medline
25. Huys QJ, Cools R, Gölzer M, Friedel E, Heinz A, Dolan RJ, Dayan P (2011) Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. PLoS Comput Biol 7:e1002028. CrossRef Medline
26. Huys QJ, Eshel N, O'Nions E, Sheridan L, Dayan P, Roiser JP (2012) Bonsai trees in your head: how the pavlovian system sculpts goal-directed choices by pruning decision trees. PLoS Comput Biol 8:e1002410. CrossRef Medline
27. Jackowski AP, Araújo Filho GM, Almeida AG, Araújo CM, Reis M, Nery F, Batista IR, Silva I, Lacerda AL (2012) The involvement of the orbitofrontal cortex in psychiatric disorders: an update of neuroimaging findings. Rev Bras Psiquiatr 34:207-212. CrossRef Medline
28. Kapur S (2003) Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am J Psychiatry 160:13-23. CrossRef Medline
29. Kehagia AA, Murray GK, Robbins TW (2010) Learning and cognitive flexibility: frontostriatal function and monoaminergic modulation. Curr Opin Neurobiol 20:199 -204. CrossRef Medline
30. Kringelbach ML, Rolls ET (2004) The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog Neurobiol 72:341-372. CrossRef Medline
31. Lodge DJ, Grace AA (2007) Aberrant hippocampal activity underlies the dopamine dysregulation in an animal model of schizophrenia. J Neurosci 27:11424 -11430. CrossRef Medline
32. Malchow B, Hasan A, Meyer K, Schneider-Axmann T, Radenbach KE, Gruber O, Reith W, McIntosh AM, Schmitt A, Falkai P, Wobrock T (2015) Family load impacts orbitofrontal volume in first-episode schizophrenia. Psychiatry Res 232:130 -133. CrossRef Medline
33. Martinez D, Slifstein M, Broft A, Mawlawi O, Hwang DR, Huang Y, Cooper T, Kegeles L, Zarahn E, Abi-Dargham A, Haber SN, Laruelle M (2003) Imaging human mesolimbic dopamine transmission with positron emission tomography. Part II: amphetamine-induced dopamine release in the functional subdivisions of the striatum. J Cereb Blood Flow Metab 23: 285-300. CrossRef Medline
34. Matsumoto M, Hikosaka O (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459: 837-841. CrossRef Medline
35. Matsumoto M, Takada M (2013) Distinct representations of cognitive and motivational signals in midbrain dopamine neurons. Neuron 79:1011- 1024. CrossRef Medline
36. Meador-Woodruff JH, Haroutunian V, Powchik P, Davidson M, Davis KL, Watson SJ (1997) Dopamine receptor transcript expression in striatum and prefrontal and occipital cortex. Focal abnormalities in orbitofrontal cortex in schizophrenia. Arch Gen Psychiatry 54:1089 -1095. CrossRef Medline
37. Menzies L, Chamberlain SR, Laird AR, Thelen SM, Sahakian BJ, Bullmore ET (2008) Integrating evidence from neuroimaging and neuropsychological studies of obsessive-compulsive disorder: the orbitofronto-striatal model revisited. Neurosci Biobehav Rev 32:525-549. CrossRef Medline
38. Mizrahi R, Addington J, Rusjan PM, Suridjan I, Ng A, Boileau I, Pruessner JC, Remington G, Houle S, Wilson AA (2012) Increased stress-induced dopamine release in psychosis. Biol Psychiatry 71:561-567. CrossRef Medline
39. Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936 -1947. Medline
40. Murray GK, Corlett PR, Clark L, Pessiglione M, Blackwell AD, Honey G, Jones PB, Bullmore ET, Robbins TW, Fletcher PC (2008) Substantia nigra/ventral tegmental reward prediction error disruption in psychosis. Mol Psychiatry 13:239, 267-276. CrossRef Medline
41. Nagy H, Levy-Gigi E, Somlai Z, Takáts A, Bereczki D, Kéri S (2012) The effect of dopamine agonists on adaptive and aberrant salience in Parkinson's disease. Neuropsychopharmacology 37:950 -958. CrossRef Medline
42. O'Callaghan MJ, Bay-Richter C, O'Tuathaigh CM, Heery DM, Waddington JL, Moran PM (2014) Potentiation of latent inhibition by haloperidol and clozapine is attenuated in Dopamine D2 receptor (Drd-2)-deficient mice: do antipsychotics influence learning to ignore irrelevant stimuli via both Drd-2 and non-Drd-2 mechanisms? J Psychopharmacol 28:973- 977. CrossRef Medline
43. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329 -337. CrossRef Medline
44. Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223-226. CrossRef Medline
45. Patlak CS, Blasberg RG (1985) Graphical evaluation of blood-to-brain transfer constants from multiple-time uptake data. Generalizations. J Cereb Blood Flow Metab 5:584 -590. CrossRef Medline
46. Peters ER, Joseph SA, Garety PA (1999) Measurement of delusional ideation in the normal population: introducing the PDI (Peters et al. Delusions Inventory). Schizophr Bull 25:553-576. CrossRef Medline
47. Poletti M, Frosini D, Pagni C, Baldacci F, Lucetti C, Del Dotto P, Ceravolo R, Bonuccelli U (2014) A pilot psychometric study of aberrant salience state in patients with Parkinson's disease and its association with dopamine replacement therapy. Neurol Sci 35:1603-1605. CrossRef Medline
48. Raine A (1991) The SPQ: a scale for the assessment of schizotypal personality based on DSM-III-R criteria. Schizophr Bull 17:555-564. CrossRef Medline
49. Robinson TE, Berridge KC (1993) The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res Brain Res Rev 18: 247-291. CrossRef Medline
50. Roesch MR, Olson CR (2004) Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304:307-310. CrossRef Medline
51. Roiser JP, Stephan KE, den Ouden HE, Barnes TR, Friston KJ, Joyce EM (2009) Do patients with schizophrenia exhibit aberrant salience? Psychol Med 39:199 -209. CrossRef Medline
52. Roiser JP, Stephan KE, den Ouden HE, Friston KJ, Joyce EM (2010) Adaptive and aberrant reward prediction signals in the human brain. Neuroimage 50:657- 664. CrossRef Medline
53. Roiser JP, Howes OD, Chaddock CA, Joyce EM, McGuire P (2013) Neural and behavioral correlates of aberrant salience in individuals at risk for psychosis. Schizophr Bull 39:1328 -1336. CrossRef Medline
54. Romaniuk L, Honey GD, King JR, Whalley HC, McIntosh AM, Levita L, Hughes M, Johnstone EC, Day M, Lawrie SM, Hall J (2010) Midbrain activation during Pavlovian conditioning and delusional symptoms in schizophrenia. Arch Gen Psychiatry 67:1246 -1254. CrossRef Medline
55. Schlagenhauf F, Sterzer P, Schmack K, Ballmaier M, Rapp M, Wrase J, Juckel G, Gallinat J, Heinz A (2009) Reward feedback alterations in unmedicated schizophrenia patients: relevance for delusions. Biol Psychiatry 65: 1032-1039. CrossRef Medline
56. Schlagenhauf F, Huys QJ, Deserno L, Rapp MA, Beck A, Heinze HJ, Dolan R, Heinz A (2014) Striatal dysfunction during reversal learning in unmedicated schizophrenia patients. Neuroimage 89:171-180. CrossRef Medline
57. Schmidt K, Roiser JP (2009) Assessing the construct validity of aberrant salience. Front Behav Neurosci 3:58. CrossRef Medline
58. Schoenbaum G, Roesch MR, Stalnaker TA, Takahashi YK (2009) A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat Rev Neurosci 10:885- 892. CrossRef Medline
59. Schönberg T, Daw ND, Joel D, O'Doherty JP (2007) Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J Neurosci 27:12860 -12867. CrossRef Medline
60. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599. CrossRef Medline
61. Stalnaker TA, Franz TM, Singh T, Schoenbaum G (2007) Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron 54:51-58. CrossRef Medline
62. Sutton R, Barto AG (1998) Reinforcement learning: an introduction. Cambridge, MA: MIT.
63. Takahashi YK, Roesch MR, Stalnaker TA, Haney RZ, Calu DJ, Taylor AR, Burke KA, Schoenbaum G (2009) The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes. Neuron 62:269 -280. CrossRef Medline
64. Takahashi YK, Roesch MR, Wilson RC, Toreson K, O'Donnell P, Niv Y, Schoenbaum G (2011) Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat Neurosci 14:1590- 1597. CrossRef Medline
65. Ullsperger M, Danielmeier C, Jocham G (2014) Neurophysiology of performance monitoring and adaptive behavior. Physiol Rev 94:35-79. CrossRef Medline
66. Weiner I, Arad M (2009) Using the pharmacology of latent inhibition to model domains of pathology in schizophrenia and their treatment. Behav Brain Res 204:369 -386. CrossRef Medline
67. Winton-Brown TT, Fusar-Poli P, Ungless MA, Howes OD (2014) Dopaminergic basis of salience dysregulation in psychosis. Trends Neurosci 37: 85-94. CrossRef Medline