Imbalanced Decision Hierarchy in Addicts Emerging from Drug-Hijacked Dopamine Spiraling Circuit

PLoS ONE

Volumn 8, Issue 4, 2013, Pages

  Keramati, Mehdi ^a   Gutkin, Boris ^a  

^a ECOLE NORMALE SUPÉRIEURE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

ARTICLE; ASSOCIATION; COGNITION; CONFLICT; CORPUS STRIATUM; DECISION MAKING; DRUG DEPENDENCE; DRUG EXPOSURE; DRUG SEEKING BEHAVIOR; HUMAN; MOTIVATION; REINFORCEMENT;

ALGORITHMS; BASAL GANGLIA; BEHAVIOR, ADDICTIVE; COMPUTER SIMULATION; CUES; DECISION MAKING; DOPAMINE; HUMANS; MODELS, PSYCHOLOGICAL; MOTIVATION; REINFORCEMENT (PSYCHOLOGY); REWARD; SUBSTANCE-RELATED DISORDERS;

EID: 84876562294     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0061489     Document Type: Article

References (42)

1. Narcotics Anonymous (2008). 6th ed. World Service Office.
2. Goldstein A (2001) Addiction: From Biology to Drug Policy. Oxford University Press, USA.
3. Volkow ND, Fowler JS, Wang G-J, Swanson JM, (2004) Dopamine in drug abuse and addiction: results from imaging studies and treatment implications. Molecular Psychiatry 9: 557-569.
4. Stacy AW, Wiers RW, (2010) Implicit cognition and addiction: a tool for explaining paradoxical behavior. Annual review of clinical psychology 6: 551-575.
5. Diagnostic and statistical manual of mental disorders (DSM-IV) (2000). 4th ed. Washington, DC: American Psychiatric Association.
6. Lamb RJ, Preston KL, Schindler CW, Meisch RA, Davis F, et al. (1991) The reinforcing and subjective effects of morphine in post-addicts: a dose-response study. The Journal of pharmacology and experimental therapeutics 259: 1165-1173.
7. Goldstein RZ, Woicik PA, Moeller SJ, Telang F, Jayne M, et al. (2010) Liking and wanting of drug and non-drug rewards in active cocaine users: the STRAP-R questionnaire. Journal of psychopharmacology 24: 257-266.
8. Everitt BJ, Robbins TW, (2005) Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nature Neuroscience 8: 1481-1489.
9. Redish AD, (2004) Addiction as a computational process gone awry. Science 306: 1944-1947.
10. Dezfouli A, Piray P, Keramati MM, Ekhtiari H, Lucas C, et al. (2009) A neurocomputational model for cocaine addiction. Neural Computation 21: 2869-2893.
11. Piray P, Keramati MM, Dezfouli A, Lucas C, Mokri A, (2010) Individual differences in nucleus accumbens dopamine receptors predict development of addiction-like behavior: a computational approach. Neural Computation 22: 2334-2368.
12. Dayan P, (2009) Dopamine, reinforcement learning, and addiction. Pharmacopsychiatry 42: 56-65.
13. Takahashi Y, Schoenbaum G, Niv Y, (2008) Silencing the critics: understanding the effects of cocaine sensitization on dorsolateral and ventral striatum in the context of an actor/critic model. Frontiers in Neuroscience 2: 86-99.
14. Redish AD, Jensen S, Johnson A, (2008) A unified framework for addiction: vulnerabilities in the decision process. The Behavioral and Brain Sciences 31: 415-487.
15. Botvinick MM, (2008) Hierarchical models of behavior and prefrontal function. Trends in cognitive sciences 12: 201-208.
16. Haruno M, Kawato M, (2006) Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning. Neural Networks 19: 1242-1254.
17. Willuhn I, Burgeno LM, Everitt BJ, Phillips PEM, (2012) Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use. Proceedings of the National Academy of Sciences 109: 20703-20708.
18. Botvinick MM, Niv Y, Barto AC, (2009) Hierarchically organized behavior and its neural foundations: a reinforcement learning perspective. Cognition 113: 262-280.
19. Badre D, D'Esposito M, (2009) Is the rostro-caudal axis of the frontal lobe hierarchical? Nature Reviews Neuroscience 10: 659-669.
20. Koechlin E, Ody C, Kouneiher F, (2003) The architecture of cognitive control in the human prefrontal cortex. Science 302: 1181-1185.
21. Badre D, Hoffman J, Cooney JW, D'Esposito M, (2009) Hierarchical cognitive control deficits following damage to the human frontal lobe. Nature neuroscience 12: 515-522.
22. Alexander GE, DeLong MR, Strick PL, (1986) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience 9: 357-381.
23. Alexander GE, Crutcher MD, DeLong MR, (1990) Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, prefrontal and limbic functions. Progress in Brain Research 85: 119-146.
24. Schultz W, Dayan P, Montague PR, (1997) A neural substrate of prediction and reward. Science 275: 1593-1599.
25. Belin D, Everitt BJ, (2008) Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron 57: 432-441.
26. Haber SN, Fudge JL, McFarland NR, (2000) Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum. The Journal of Neuroscience 20: 2369-2382.
27. Haber SN, (2003) The primate basal ganglia: parallel and integrative networks. Journal of Chemical Neuroanatomy 26: 317-330.
28. Sutton RS, Barto AG (1998) Reinforcement Learning: An Introduction. Cambridge: MIT Press.
29. Di Chiara G, Imperato A, (1988) Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats. Proceedings of the National Academy of Sciences of the United States of America 85: 5274-5278.
30. Daw ND, Niv Y, Dayan P, (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 8: 1704-1711.
31. Vanderschuren LJMJ, Ciano PD, Everitt BJ, (2005) Involvement of the dorsal striatum in cue-controlled cocaine seeking. The Journal of Neuroscience 25: 8665-8670.
32. Volkow ND, Wang G-J, Telang F, Fowler JS, Logan J, et al. (2006) Cocaine cues and dopamine in dorsal striatum: mechanism of craving in cocaine addiction. The Journal of Neuroscience 26: 6583-6588.
33. Kalivas PW, Volkow ND, (2005) The neural basis of addiction: a pathology of motivation and choice. The American Journal of Psychiatry 162: 1403-1413.
34. Belin D, Jonkman S, Dickinson A, Robbins TW, Everitt BJ, (2009) Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction. Behavioural Brain Research 199: 89-102.
35. Matsumoto M, Hikosaka O, (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459: 837-841.
36. Frank MJ, Surmeier DJ, (2009) Do substantia nigra dopaminergic neurons differentiate between reward and punishment? Journal of Molecular Cell Biology 1: 15-16.
37. Vanderschuren LJMJ, Everitt BJ, (2004) Drug seeking becomes compulsive after prolonged cocaine self-administration. Science 305: 1017-1019.
38. Deroche-Gamonet V, Belin D, Piazza PV, (2004) Evidence for addiction-like behavior in the rat. Science 305: 1014-1017.
39. Panlilio LV, Thorndike EB, Schindler CW, (2007) Blocking of conditioning to a cocaine-paired stimulus: testing the hypothesis that cocaine perpetually produces a signal of larger-than-expected reward. Pharmacology, Biochemistry, and Behavior 86: 774-777.
40. Kamin L (1969) Predictability, surprise, attention, and conditioning. In: Campbell BA, Church RM, editors. Punishment and aversive behavior. New York: Appleton-Century-Crofts. pp. 279-296.
41. Dezfouli A, Balleine BW, (2012) Habits, action sequences and reinforcement learning. The European journal of neuroscience 35: 1036-1051.
42. Koob GF, Le Moal M (2005) Neurobiology of Addiction. San Diego: Academic Press.