Temporal difference error prediction signal dysregulation in cocaine dependence

Neuropsychopharmacology

Volumn 39, Issue 7, 2014, Pages 1732-1742

  Rose, Emma Jane ^a,b   Salmeron, Betty Jo ^a   Ross, Thomas J ^a   Waltz, James ^b   Schweitzer, Julie B ^c   McClure, Samuel M ^d   Stein, Elliot A ^a  

^a NATIONAL INSTITUTE ON DRUG ABUSE   (United States)

^b UNIVERSITY OF MARYLAND SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d STANFORD UNIVERSITY   (United States)

Author keywords

Cocaine dependence; fMRI; motivation; reward; temporal difference error prediction

Indexed keywords

COCAINE; OXYGEN;

ABSTINENCE; ADULT; AFFECT; ARTICLE; ASSOCIATION; BRAIN FUNCTION; CLINICAL ARTICLE; COCAINE DEPENDENCE; COGNITION; CONDITIONING; CONTROLLED STUDY; DRIVE; ERROR; FEMALE; FOOD; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; INSULA; LEARNING; MALE; MIDDLE FRONTAL GYRUS; NEGATIVE TEMPORAL DIFFERENCE ERROR; NEUROBIOLOGY; PERSONALITY; POSITIVE TEMPORAL DIFFERENCE ERROR; POSTCENTRAL GYRUS; PREDICTION; PRIMARY MOTOR CORTEX; PRIORITY JOURNAL; PUTAMEN; RECIDIVISM; REINFORCEMENT; REWARD; SENSITIVITY ANALYSIS; SIGNAL TRANSDUCTION; STRESS; TASK PERFORMANCE; BLOOD; BRAIN; COMPLICATION; DRUG EFFECTS; IMAGE PROCESSING; MIDDLE AGED; NUCLEAR MAGNETIC RESONANCE IMAGING; PATHOLOGY; PERCEPTIVE DISCRIMINATION; PERCEPTUAL DISORDERS; PHYSIOLOGY; PREDICTIVE VALUE; TIME; VASCULARIZATION;

ADULT; AFFECT; BRAIN; COCAINE; COCAINE-RELATED DISORDERS; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; OXYGEN; PERCEPTUAL DISORDERS; PERSONALITY; PREDICTIVE VALUE OF TESTS; SIGNAL DETECTION, PSYCHOLOGICAL; TIME FACTORS;

EID: 84900539547     PISSN: 0893133X     EISSN: 1740634X     Source Type: Journal    
DOI: 10.1038/npp.2014.21     Document Type: Article

References (68)

1. Asaad WF, Eskandar EN (2011). Encoding of both positive and negative reward prediction errors by neurons of the primate lateral prefrontal cortex and caudate nucleus. J Neurosci 31: 17772-1778 7.
2. Bagby RM, Parker JD, Taylor GJ (1994). The twenty-item Toronto Alexithymia Scale-I: Item selection and cross-validation of the factor structure. J Psychosom Res 38: 23-32.
3. Balleine BW, O?Doherty JP (2010). Human and roDent homologies in action control: Corticostriatal Determinants of goal-directed and habitual action. Neuropsychopharmacology 35: 48-69.
4. Beck AT (1993). The Beck Anxiety Inve ntory. The Psychological Corporation: London, UK.
5. Beck AT (1996). The Beck Depression Inventory-II. The Psychological Corporation: London, UK.
6. Berns GS, McClure SM, Pagnoni G, Montague PR (2001). Predictability modulates human brain response to reward. J Neurosci 21: 2793-2798.
7. Bernstein DP, Fink L, HanDelsman L, Foote J, Lovejoy M, Wenzel K et al (1994). Initia l reliability and validity of a new retrospective measure of child abuse and neglect. Am J Psychiatry 151: 1132-1136.
8. Boileau I, Dagher A, Leyton M, Gunn RN, Baker GB, Diksic M et al (2006). M oDeling sensitization to stimulants in humans: An [11C]raclopriDe/positron emission tomography study in healthy men. Arch Gen Psychiatry 63: 1386-1395.
9. Boileau I, Dagher A, Leyton M, Welfeld K, Booij L, Diksi c M et al (2007). Conditioned dopamine release in humans: A positron emission tomography [11c]raclopriDe study with amphetamine. J Neurosci 27: 3998-4003.
10. Breiter HC, Gollub RL, Weisskoff RM, Kennedy DN, Makris N, Berke JD et al (1997). Acute effects of cocaine on human brain activity and emotion. Neuron 19: 591-611.
11. Brugha TS, Bebbington PE, Stretch DD, MacCarthy B, Wykes T (1997). Predicting the short-term outcome of first episoDes and recurrences of clinical Depression: A prospective study of life events, difficulties, and social su pport networks. J Clin Psychiatry 58: 298-306.
12. Chapman LJ, Chapman JP, Raulin ML (1976). Scales for physical and social anhedonia. J Abnorm Psychol 85: 374-382.
13. Cloninger CR , Przybeck TR, Svrakic DM, Wetzel RD (1994). The Temperament and Character Inventory (TCI): A GuiDe to its Development and Use. Washington University: Center for Psychobiology of Personality: St Louis, Missouri.
14. Co x RW (1996). AFNI software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 29: 162-173.
15. Diekhof EK, Falkai P, Gruber O (2008). Functional neuroimaging of reward processing and Decision-making: A review of aberrant motivational and affective processing in addiction and mood disorDers. Brain Res Rev 59: 164-184.
16. Everitt BJ, Robbins TW (2013). From the ventral to the dorsal striatum: Devolving views of their roles in drug addiction. Neurosci Biobehav Rev 37: 1946 -1954.
17. Garavan H, Pankiewicz J, Bloom A, Cho JK, Sperry L, Ross TJ et al (2000). Cue-induced cocai ne craving: Neuroanatomical specificity for drug users and drug stimuli. Am J Psychiatry 157: 1789-1798.
18. Goldstein RZ, Alia-Klein N, Tomasi D, Zhang L, Cottone LA, Maloney T et al (2007a ). I s Decreased prefrontal cortical sensitivity to monetary reward associated with impaired motivation and self-control in cocaine addiction Am J Psychiatry 164: 43-51.
19. Goldstein RZ, Tomasi D, Alia-Klein N, Cottone LA, Zhang L, Telang F et al (2007b ). Subjective sensitivity to monetary gradients is associated with frontolimbic activation to reward in cocaine abusers. Drug Alcohol Depend 87: 233-240.
20. Goldstein RZ, Volkow ND (2011). Dysfunction of the prefrontal cortex in addiction: Neuroimaging findings and clinical implications. Nat Rev Neurosci 12: 652-669.
21. Gu H,Salmeron BJ,Ross TJ,Geng X,Zhan W,Stein EA,et al (2010, Mesocorticolimbic circuits are impaired in chronic cocaine users as Demonstrated by resting-state functional connectivity, NeuroImage,53, 593-601.
22. Haber SN, Knutson B (2010). The reward circuit: Linking primate anatomy and human imaging. Neuropsychopharmacology 35: 4-26.
23. Hollerman JR, Schultz W ( 1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1: 304-309.
24. Jia Z, Worhunsky PD, Carroll KM, Rounsaville BJ, Stevens MC, Pearlson GD et al (2011). An initial study of neural responses to monetary incentives as related to treatment outcome in cocaine DepenDence. Biol Psychiatry 70: 553-560.
25. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL et al (2002). Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med 32: 959-976.
26. Knutson B, Fong GW, Adams CM, Varner JL, Hommer D (2001). Dissociation of reward anticipation and outcome with eventrelated fMRI. Neuroreport 12: 3683-3687.
27. Knutson B, Fong GW, Be nnett SM, Adams CM, Homme D (2003). A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: Characterization with rapid event-related fMRI. NeuroImage 18: 263-272.
28. Knutson B, Westdorp A, Kaiser E, Hommer D (2000). FMRI visualization of brain activity during a monetary incentive Delay task. NeuroImage 12: 20-27.
29. Knutson B, Wimmer GE (2007). Splitting the difference: How does the brain coDe reward episoDes Ann NY Acad Sci 1104: 54-69.
30. Koob GF, LeMoal M (1997). Drug abuse: Hedonic homeostatic dysregulation. Science 278: 52-58.
31. Koob GF, LeMoal M ( 2007). Drug addiction, dysregulation of reward, and allostasis. Neuropsychopharmacology 24: 97-129.
32. Koob GF, Sanna PP, Bloom FE (1998). Neuroscience of addiction. Neuron 21: 467-476.
33. Koob GF, Volkow ND (2010). Neurocircuitry of addiction. Neuropsychopharmacology 35: 217-238.
34. Kufahl PR, Li Z, Risinger RC, Rainey CJ, Wu G, Bloom AS et al (2005). Neu ral responses to acute cocaine administration in the human brain Detected by fMRI. NeuroImage 28: 904-914.
35. Martinez D, Broft A, Foltin RW, Slifstein M, Hwang DR, Huang Y et al (2004). Cocain e DepenDence and d2 receptor availability in the functional subdivisions of the striatum: Relationship with cocaine-seeking behavior. Neuropsychopharmacology 29: 1190-1202.
36. Martinez D, Narendran R, Foltin RW, Sl ifstein M, Hwang DR, Broft A et al (2007). Amphetamine-induced dopamine release: Markedly blunted in cocaine DepenDence and predictive of the choice to self-administer cocaine. Am J Psychiatry 164: 622-629.
37. McClure SM, Berns GS, Montague PR (2003). Temporal prediction errors in a passive learning task activate human striatum. Neuron 38: 339-346.
38. Montague PR, Dayan P, Sejnowski TJ (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16: 1936-1947.
39. Montague PR, Hyman SE, Cohen JD (2004). Computational roles for dopamine in behavioural control. Nature 431: 760-767.
40. Mroczek DK, Kolarz CM (1998). The effect of age on positive and negative affect: A Developmental perspective on happiness. J Pers Soc Psychol 75: 1333-1349.
41. Naqvi NH, Bechara A (2010). The insula and drug addiction: An interoceptive view of pleasure, urges, and Decision-making. Brain Struct Funct 214: 435-450.
42. O?Doherty J,Dayan P,Schultz J,Deichmann R,Friston K,Dolan RJ,2004, Dissociable roles of ventral and dorsal striatum in instrumental conditioning, Scie nce,304, 452-454.
43. ODoherty J, Kringelbach ML, Rolls ET, Hornak J, Andrews C (2001). Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci 4: 95-102.
44. ODoherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003). Temporal difference moDels and reward-related learning in the human brain. Neuron 38: 329-337.
45. Randolph C, Ti erney MC, Mohr E, Chase TN (1998). The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS): Preliminary clinical validity. J Clin Exp Neuropsychol 20: 310-319.
46. Redish AD (2004). Addiction as a computational process gone awry. Science 306: 1944-1947.
47. Risinger RC, Salmeron BJ, Ross TJ, Amen SL, Sanfilipo M, Hoffmann RG et al (2005). Neural correlates of high and c raving during cocaine self-administration using BOLD fMRI. Neuroimage 26: 1097-1108.
48. Roesch MR, Esber GR, Li J, Daw ND, Schoenbaum G (2012). Surprise! Neural correlates of Pearce-Hall and Rescorla-Wagner coexist within the brain. Eur J Neurosci 35: 1190-1200.
49. Rose EJ, Ross TJ, Salmeron BJ, Lee M, Shakleya DM, Huestis M et al (2012). Chronic exposure to nicotine is associated with reduced rewar d-related activity in the striatum but not the midbrain. Biol Psychiatry 71: 206-213.
50. Schultz W (1998). Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27.
51. Schult z W (2000). Multiple reward signals in the brain. Nat Rev Neurosci 1: 199-207.
52. Schultz W (2002). Getting formal with dopamine and reward. Neuron 36: 241-263.
53. Schultz W (2007). Behavioral dopamine signals. Trends Neurosci 30: 203-210.
54. Schultz W, Dayan P, Montague PR (1997). A neural substrate of prediction and reward. Science 275: 1593-1599.
55. Schultz W, Dickinson A (2000). Neuronal coding of prediction errors. Ann Rev Neurosci 23: 473-500.
56. Sutherland MT, McHugh MJ, Pariyadath V, Stein EA (2012). Resting state functional connectivity in addiction: Lessons learned and a road ahead. Neuroimage 62: 2281-2295.
57. Talairach J, Tournoux P (1988). Co-planar Stereotaxic Atlas of the Human Brain. Thieme: New York, NY.
58. Tomasi D, Volkow ND, Wang R, Carrillo JH, Maloney T, Alia-Klein N et al (2010). Disrupted functional connectivity with dopaminergic midbrain in cocaine abusers. PLoS One 5: E10815.
59. Van Den Oever MC, Spijker S, Smit AB, De Vries TJ (2010). Prefrontal cortex plasticity mechanisms in drug seeking and relapse. Neurosci Biobehav Rev 35: 276-284.
60. VerDejo-Garcia A, Clark L, Dunn BD (2012). The role of interoception in addiction: A critical review. Neurosci Biobehav Rev 36: 1857- 1869.
61. Volkow ND, Wang GJ, Fowler JS, Logan J, Gatley SJ, Hitzemann R et al (1997). Decrease d striatal dopaminergic responsiveness in Detoxified cocaine-DepenDent subjects. Nature 386: 830-833.
62. Volkow ND, Wang GJ, Fowler JS, Tomasi D, Telang F, Baler R (2010). Addiction: Decreased reward sensitivity and increased expectation sensitivity conspire to overwhelm the brains control circuit. BioEssays 32: 748-755.
63. Volkow ND, Wang GJ, Telang F, Fowler JS, Logan J, Childress AR et al (20 06). Cocaine cues and dopamine in dorsal striatum: Mechanism of craving in cocaine addiction. J Neurosci 26: 6583-6588.
64. Wechsler D, 2001, The Wechlser Test of Adult Reading (WTAR): Test Manual, Pearson San Antonio, TX.
65. Wechsler D (2007). Wechsler Abbreviated Scale of Intelligence (WASI). Pearson: San Antonio, TX.
66. Wise RA (2009). Roles for nigrostriatal-not just mesocorticolimbic- dopamine in reward and addiction. Trends Neurosci 32: 517-524.
67. Wise RA, Kiyatkin EA (2011). Differentiating the rapid actions of cocaine. Nat Rev Neurosci 12: 479-484.
68. Wise RA, Wang B, You ZB (2008). Cocaine serves as a peripheral interoceptive conditioned stimulus for central glutamate and dopamine release. PLoS One 3: E2846.