Nicotinic alteration of decision-making

Neuropharmacology

Volumn 96, Issue PB, 2015, Pages 244-254

  Naudé, Jérémie ^a   Dongelmans, Malou ^a   Faure, Philippe ^a  

^a SORBONNE UNIVERSITÉ   (France)

Author keywords

Decision making; Impulsivity; Nicotine; Nicotinic acetylcholine receptors; Risk taking

Indexed keywords

ACETYLCHOLINE; NICOTINE; NICOTINIC RECEPTOR; NICOTINIC AGENT;

ARTICLE; DECISION MAKING; DECISION THEORY; DOPAMINERGIC ACTIVITY; DOPAMINERGIC SYSTEM; HIGH RISK BEHAVIOR; HUMAN; IMPULSIVENESS; LEARNING THEORY; NEUROBIOLOGY; NONHUMAN; PRIORITY JOURNAL; PROTEIN SUBUNIT; SPATIOTEMPORAL ANALYSIS; SUBSTANCE ABUSE; TOBACCO DEPENDENCE; ANIMAL; BRAIN; DOPAMINERGIC NERVE CELL; DRUG EFFECTS; NERVE CELL; PATHOPHYSIOLOGY; PHYSIOLOGY; PSYCHOLOGY;

ACETYLCHOLINE; ANIMALS; BRAIN; DECISION MAKING; DOPAMINERGIC NEURONS; HUMANS; IMPULSIVE BEHAVIOR; NEURONS; NICOTINE; NICOTINIC AGONISTS; RECEPTORS, NICOTINIC; RISK-TAKING; TOBACCO USE DISORDER;

EID: 84933178620     PISSN: 00283908     EISSN: 18737064     Source Type: Journal    
DOI: 10.1016/j.neuropharm.2014.11.021     Document Type: Review

References (167)

1. American Psychiatric Association Diagnostic and Statistical Manual of Mental Disorders fifth ed. 2013 Washington, DC: Author
2. M.A. Addicott, J.M. Pearson, J. Wilson, M.L. Platt, and F.J. McClernon Smoking and the bandit: a preliminary study of smoker and nonsmoker differences in exploratory behavior measured with a multiarmed bandit task Exp. Clin. Psychopharmacol. 21 2013 66 73
3. K.G. Anderson, and J.W. Diller Effects of acute and repeated nicotine administration on delay discounting in Lewis and Fisher 344 rats Behav. Pharmacol. 21 2010 754 764
4. A.P. Anokhin, S. Golosheykin, J.D. Grant, and A.C. Heath Heritability of delay discounting in adolescence: a longitudinal twin study Behav. Genet. 41 2011 175 183
5. J. Audrain-McGovern, D. Rodriguez, L.H. Epstein, J. Cuevas, K. Rodgers, and E.P. Wileyto Does delay discounting play an etiological role in smoking or is it a consequence of smoking? Drug Alcohol Depend. 103 2009 99 106
6. M.E. Avale, P. Faure, S. Pons, P. Robledo, T. Deltheil, D.J. David, A.M. Gardier, R. Maldonado, S. Granon, J.-P. Changeux, and U. Maskos Interplay of β2∗nicotinic receptors and dopamine pathways in the control of spontaneous locomotion Proc. Natl. Acad. Sci. U. S. A. 105 2008 15991 15996
7. C.D.C. Bailey, M. De Biasi, P.J. Fletcher, and E.K. Lambe The nicotinic acetylcholine receptor α5 subunit plays a key role in attention circuitry and accuracy J. Neurosci. 30 2010 9241 9252
8. F. Baker, M.W. Johnson, and W.K. Bickel Delay discounting in current and never-before cigarette smokers: similarities and differences across commodity, sign, and magnitude J. Abnorm. Psychol. 112 2003 382 392
9. B.W. Balleine, and A. Dickinson Goal-directed instrumental action: contingency and incentive learning and their cortical substrates Neuropharmacology 37 1998 407 419
10. N. Barazangi, and L.W. Role Nicotine-induced enhancement of glutamatergic and GABAergic synaptic transmission in the mouse amygdala J. Neurophysiol. 86 2001 463 474
11. J.a. Beeler, N. Daw, C.R.M. Frazier, and X. Zhuang Tonic dopamine modulates exploitation of reward learning Front. Behav. Neurosci. 4 2010 170
12. D. Belin, A.C. Mar, J.W. Dalley, T.W. Robbins, and B.J. Everitt Europe PMC Funders group high impulsivity predicts the switch to compulsive cocaine taking 320 2008 1352 1355
13. K.C. Berridge The debate over dopamine's role in reward: the case for incentive salience Psychopharmacology (Berl) 191 2007 391 431
14. K.C. Berridge, and T.E. Robinson What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Brain Res. Rev. 28 1998 309 369
15. M. Besson, S. Granon, M. Mameli-Engvall, I. Cloëz-Tayarani, N. Maubourguet, A. Cormier, P. Cazala, V. David, J.-P. Changeux, and P. Faure Long-term effects of chronic nicotine exposure on brain nicotinic receptors Proc. Natl. Acad. Sci. U. S. A. 104 2007 8155 8160
16. W.K. Bickel, a.L. Odum, and G.J. Madden Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers Psychopharmacology (Berl) 146 1999 447 454
17. Y.-L. Boureau, and P. Dayan Opponency revisited: competition and cooperation between dopamine and serotonin Neuropsychopharmacology 36 2010 74 97
18. E.S. Bromberg-Martin, M. Matsumoto, and O. Hikosaka Dopamine in motivational control: rewarding, aversive, and alerting Neuron 68 2010 815 834
19. B. Buisson, and D. Bertrand Nicotine addiction: the possible role of function upregulation Trends Pharmacol. Sci. 23 2002 130 136
20. M. Businelle, M.A. McVay, D. Kendzor, and A. Copeland A comparison of delay discounting among smokers, substance users, and non-dependent controls Drug Alcohol Depend. 112 2010 247 250
21. X. Cai, S. Kim, and D. Lee Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice Neuron 69 2011 170 182
22. S. Caillé, K. Guillem, M. Cador, O. Manzoni, and F. Georges Voluntary nicotine consumption triggers in vivo potentiation of cortical excitatory drives to midbrain dopaminergic neurons J. Neurosci. 29 2009 10410 10415
23. J.-P. Changeux, and S.J. Edelstein Allosteric mechanisms of signal transduction Science 308 2005 1424 1428
24. P.H. Chiu, T.M. Lohrenz, and P.R. Montague Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task Nat. Neurosci. 11 2008 514 520
25. L. Clark, R. Cools, and T.W. Robbins The neuropsychology of ventral prefrontal cortex: decision-making and reversal learning Brain Cognit. 55 2004 41 53
26. J.R. Clement, and S. Grant Glutamate-like immunoreactivity in neurons of the laterodorsal and pedunculopontine nucleus in the rat Neurosci. Lett. 120 1990 70 73
27. J. Cornwall, J.D. Cooper, and O.T. Phillipson Exp. Brain Res. 9 1990 157 171
28. J.W. Dalley, B.J. Everitt, and T.W. Robbins Impulsivity, compulsivity, and top-down cognitive control Neuron 69 2011 680 694
29. J.A. Dani, D. Ji, and F. Zhou Synaptic plasticity and nicotine addiction Neuron 31 2001 349 352
30. J.A. Dani, and R.A. Harris Nicotine addiction and comorbidity with alcohol abuse and mental illness Nat. Neurosci. 8 2005 1465 1470
31. J.A. Dani, and D. Bertrand Nicotinic acetylcholine receptors and nicotinic cholinergic mechanisms of the central nervous system Annu. Rev. Pharmacol. Toxicol. 47 2007 699 729
32. J.A. Dani, D. Jenson, J.I. Broussard, and M. De Biasi Neurophysiology of nicotine addiction J. Addict. Res. Ther. 1 2011 1 12
33. D. Dautan, I. Huerta-Ocampo, I.B. Witten, K. Deisseroth, J.P. Bolam, T. Gerdjikov, and J. Mena-Segovia A major external source of cholinergic innervation of the striatum and nucleus accumbens originates in the brainstem J. Neurosci. 34 2014 4509 4518
34. N.D. Daw, Y. Niv, and P. Dayan Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control Nat. Neurosci. 8 2005 1704 1711
35. N.D. Daw, J.P. O'Doherty, P. Dayan, B. Seymour, and R.J. Dolan Cortical substrates for exploratory decisions in humans Nature 441 2006 876 879
36. N.D. Daw, S.J. Gershman, B. Seymour, P. Dayan, and R.J. Dolan Model-based influences on humans' choices and striatal prediction errors Neuron 69 6 2011 1204 1215
37. H. de Wit, and J.B. Richards Dual determinants of drug use in humans: reward and impulsivity Nebr. Symp. Motiv. 50 2004 19 55
38. H. de Wit Impulsivity as a determinant and consequence of drug use: a review of underlying processes Addict. Biol. 14 2009 22 31
39. L. Diergaarde, T. Pattij, I. Poortvliet, F. Hogenboom, W. De Vries, A.N.M. Schoffelmeer, and T.J. De Vries Impulsive choice and impulsive action predict vulnerability to distinct stages of nicotine seeking in rats Biol. Psychiatry 63 2008 301 308
40. J. Dallery, and M.L. Locey Effects of acute and chronic nicotine on impulsive choice in rats Behav. Pharmacol. 16 1 2005 15 23
41. M. Devaine, G. Hollard, and J. Daunizeau Theory of mind: did evolution fool us? PLoS ONE 9 2014 e87619
42. R.J. Dolan, and P. Dayan Goals and habits in the brain Neuron 80 2013 312 325
43. B.B. Doll, D.A. Simon, and N.D. Daw The ubiquity of model-based reinforcement learning Curr. Opin. Neurobiol. 22 2012 1075 1081
44. R. Dos Santos Coura, and S. Granon Prefrontal neuromodulation by nicotinic receptors for cognitive processes Psychopharmacology (Berl) 221 2012 1 18
45. K. Doya Modulators of decision making Nat. Neurosci. 11 2008 410 416
46. W.M. Doyon, Y. Dong, A. Ostroumov, A.M. Thomas, T.A. Zhang, and J.A. Dani Nicotine decreases ethanol-induced dopamine signaling and increases self-administration via stress hormones Neuron 2013 1 11
47. M.P. Epping-Jordan, S.S. Watkins, G.F. Koob, and A. Markou Dramatic decreases in brain reward function during nicotine withdrawal Nature 393 1998 76 79
48. K.D. Ersche, A.J. Turton, S. Pradhan, E.T. Bullmore, and T.W. Robbins Drug addiction endophenotypes: impulsive versus sensation-seeking personality traits Biol. Psychiatry 68 2010 770 773
49. J.L. Evenden Varieties of impulsivity Psychopharmacology (Berl) 146 1999 348 361
50. R. Exley, and S.J. Cragg Presynaptic nicotinic receptors: a dynamic and diverse cholinergic filter of striatal dopamine neurotransmission Br. J. Pharmacol. 153 Suppl. 1 2008 S283 S297
51. P. Faure, S. Tolu, S. Valverde, and J. Naudé Role of nicotinic acetylcholine receptors in regulating dopamine neuron activity Neuroscience 282 2014 86 100
52. W.C. Fobbs, and S.J.Y. Mizumori Cost-benefit decision circuitry: proposed modulatory role for acetylcholine Prog. Mol. Biol. Transl. Sci. 122 2014 233 261
53. C.D. Fowler, M.A. Arends, and P.J. Kenny Subtypes of nicotinic acetylcholine receptors in nicotine reward, dependence, and withdrawal: evidence from genetically modified mice Behav. Pharmacol. 19 2008 461 484
54. C.D. Fowler, and P.J. Kenny Nicotine aversion: neurobiological mechanisms and relevance to tobacco dependence vulnerability Neuropharmacology 76 Pt B 2014 533 544
55. X. Gallego, S. Molas, A. Amador-Arjona, M.J. Marks, N. Robles, P. Murtra, L. Armengol, R.D. Fernández-Montes, M. Gratacòs, M. Pumarola, R. Cabrera, R. Maldonado, J. Sabrià, X. Estivill, and M. Dierssen Overexpression of the CHRNA5/A3/B4 genomic cluster in mice increases the sensitivity to nicotine and modifies its reinforcing effects Amino Acids 43 2012 897 909
56. A.P. Govind, P. Vezina, and W.N. Green Nicotine-induced upregulation of nicotinic receptors: underlying mechanisms and relevance to nicotine addiction Biochem. Pharmacol. 78 2009 756 765
57. A.a. Grace, S.B. Floresco, Y. Goto, and D.J. Lodge Regulation of firing of dopaminergic neurons and control of goal-directed behaviors Trends Neurosci. 30 2007 220 227
58. K. Guillem, B. Bloem, R.B. Poorthuis, M. Loos, A.B. Smit, U. Maskos, S. Spijker, and H.D. Mansvelder Nicotinic acetylcholine receptor β2 subunits in the medial prefrontal cortex control attention Science 333 2011 888 891
59. M.E. Hasselmo, and M. Sarter Modes and models of forebrain cholinergic neuromodulation of cognition Neuropsychopharmacology 36 2011 52 73
60. T.A. Hauser, A. Kucinski, K.G. Jordan, G.J. Gatto, S.R. Wersinger, R.A. Hesse, E.K. Stachowiak, M. Stachowiak, R.L. Papke, P.M. Lippiello, and M. Bencherif TC-5619: an α7 neuronal nicotinic receptor-selective agonist that demonstrates efficacy in animal models of the positve and negative symptoms and cognitive dysfunction of schizophrenia Biochem. Pharmacol. 78 2010 803 812
61. Y.A. Hay, S. Andjelic, S. Badr, and B. Lambolez Orexin-dependent activation of layer VIb enhances cortical network activity and integration of non-specific thalamocortical inputs Brain Struct. Funct. 2014 10.1007/s00429-014-0869-7
62. S.R. Heilbronner, and B.Y. Hayden Contextual factors explain risk-seeking preferences in rhesus monkeys Front. Neurosci. 7 2013 7
63. R.J. Herrnstein Relative and absolute strength of responses as a function of frequency of reinforcement J. Exp. Anal. Behav. 4 1961 267 272
64. O. Hikosaka, K. Nakamura, and H. Nakahara Basal ganglia orient eyes to reward J. Neurophysiol. 95 2 2006 567 584
65. S. Hong, T.C. Jhou, M. Smith, K.S. Saleem, and O. Hikosaka Negative reward signals from the lateral habenula to dopamine neurons are mediated by rostromedial tegmental nucleus in primates J. Neurosci. 31 2011 11457 11471
66. M.D. Humphries, M. Khamassi, and K. Gurney Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia Front. Neurosci. 6 2012 9
67. M.D. Humphries, and T.J. Prescott The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward Prog. Neurobiol. 90 2010 385 417
68. S. Ikemoto, and J. Panksepp The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking Brain Res. Brain Res. Rev. 31 1999 6 41
69. D. Joel, and I. Weiner The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum NSC 96 2000 451 474
70. M.W. Johnson, W.K. Bickel, and F. Baker Moderate drug use and delay discounting: a comparison of heavy, light, and never smokers Exp. Clin. Psychopharmacol. 15 2 2007 187 194
71. S. Jones, and A. Bonci Synaptic plasticity and drug addiction Curr. Opin. Pharmacol. 5 2005 20 25
72. D. Kahneman, and A. Tversky Prospect theory: an analysis of decision under risk Econometrica 47 2 1979 263 291
73. J.W. Kable, and P.W. Glimcher The neural correlates of subjective value during intertemporal choice Nat. Neurosci. 10 2007 1625 1633
74. J.W. Kable, and P.W. Glimcher The neurobiology of decision: consensus and controversy Neuron 63 2009 733 745
75. J.E. Kelsey, and A. Niraula Effects of acute and sub-chronic nicotine on impulsive choice in rats in a probabilistic delay-discounting task Psychopharmacology (Berl) 227 2013 385 392
76. M. Keramati, A. Dezfouli, and P. Piray Speed/accuracy trade-off between the habitual and the goal-directed processes PLoS Comput. Biol. 7 2011 e1002055
77. M. Keramati, and B. Gutkin Imbalanced decision hierarchy in addicts emerging from drug-hijacked dopamine spiraling circuit PLoS ONE 8 2013 e61489
78. S. Kim, and D. Lee Prefrontal cortex and impulsive decision making Biol. Psychiatry 69 12 Jun 15, 2011 1140 1146
79. H. Kim, D. Lee, and M.W. Jung Signals for previous goal choice persist in the dorsomedial, but not dorsolateral striatum of rats J. Neurosci. 33 1 2013 52 63
80. K.T. Kishida, B. King-Casas, and P.R. Montague Neuroeconomic approaches to mental disorders Neuron 67 2010 543 554
81. R. Klink, A. de Kerchove d'Exaerde, M. Zoli, and J.-P. Changeux Molecular and physiological diversity of nicotinic acetylcholine receptors in the midbrain dopaminergic nuclei J. Neurosci. 21 2001 1452 1463
82. K.Z. Kolokotroni, R.J. Rodgers, and A.A. Harrison Acute nicotine increases both impulsive choice and behavioural disinhibition in rats Psychopharmacology 217 4 2011 455 473
83. J.L. Koranda, J.J. Cone, D.S. McGehee, M.F. Roitman, J.a. Beeler, and X. Zhuang Nicotinic receptors regulate the dynamic range of dopamine release in vivo J. Neurophysiol. 111 2014 103 111
84. S. Lammel, D.I. Ion, J. Roeper, and R.C. Malenka Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli Neuron 70 2011 855 862
85. B. Lamotte, and P. Ascher High affinity and low affinity heteromeric nicotinic acetylcholine receptors at central synapses J. Physiol. 8119 2014 1 10
86. B. Lau, and P.W. Glimcher Value representations in the primate striatum during matching behavior Neuron 58 2008 451 463
87. C.W. Lejuez, W.M. Aklin, M.J. Zvolensky, and C.M. Pedulla Evaluation of the Balloon Analogue Risk Task (BART) as a predictor of adolescent real-world risk-taking behaviours J. Adolesc. 26 2003 475 479
88. C.C. Lo, and X.J. Wang Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks 9 2006 956 963
89. M.L. Locey, and J. Dallery Isolating behavioral mechanisms of intertemporal choice: nicotine effects on delay discounting and amount sensitivity J. Exp. Anal. Behav. 91 2009 213 223
90. M.L. Locey, and J. Dallery Nicotine and the behavioral mechanisms of intertemporal choice Behav. Process. 87 2012 18 24
91. T. Lohrenz, K. McCabe, C.F. Camerer, and P.R. Montague Neural signature of fictive learning signals in a sequential investment task Proc. Natl. Acad. Sci. U. S. A. 104 2007 9493 9498
92. D.S. McGrath, and S.P. Barrett The comorbidity of tobacco smoking and gambling: a review of the literature Drug Alcohol Rev. 28 2009 676 681
93. M. Mameli-Engvall, A. Evrard, S. Pons, U. Maskos, T.H. Svensson, J.-P. Changeux, and P. Faure Hierarchical control of dopamine neuron-firing patterns by nicotinic receptors Neuron 50 2006 911 921
94. H.D. Mansvelder, and D.S. McGehee Long-term potentiation of excitatory inputs to brain reward areas by nicotine Neuron 27 2000 349 357
95. D. Mao, D.C. Perry, R.P. Yasuda, B.B. Wolfe, and K.J. Kellar The α4β2α5 nicotinic cholinergic receptor in rat brain is resistant to up-regulation by nicotine in vivo J. Neurochem. 104 2008 446 456
96. M.J. Marks, J.F.L. Pauly, F. Heinemann, A.C. Collinss, E.S. Deneris, I. Hermans-borgmeyer, and D. Gross Nicotine binding and nicotinic nicotine treatment receptor subunit RNA after chronic J. Neurosci. 12 1992 2765 2784
97. D. Martí Barros, M.R. Ramirez, E.a. Dos Reis, and I. Izquierdo Participation of hippocampal nicotinic receptors in acquisition, consolidation and retrieval of memory for one trial inhibitory avoidance in rats Neuroscience 126 2004 651 656
98. F. Marti, O. Arib, C. Morel, V. Dufresne, U. Maskos, P.-J. Corringer, R. de Beaurepaire, and P. Faure Smoke extracts and nicotine, but not tobacco extracts, potentiate firing and burst activity of ventral tegmental area dopaminergic neurons in mice Neuropsychopharmacology 36 2011 2244 2257
99. U. Maskos Role of endogenous acetylcholine in the control of the dopaminergic system via nicotinic receptors J. Neurochem. 114 2010 641 646
100. M. Matsumoto, and O. Hikosaka Two types of dopamine neuron distinctly convey positive and negative motivational signals Nature 459 2009 837 841
101. S.G. Matta, D.J. Balfour, N.L. Benowitz, R.T. Boyd, J.J. Buccafusco, and A.R. Caggiula J.M. Zirger Guidelines on nicotine dose selection for in vivo research Psychopharmacology 190 2007 269 319
102. I.A. Mendez, R.J. Gilbert, J.L. Bizon, and B. Setlow Effects of acute administration of nicotinic and muscarinic cholinergic agonists and antagonists on performance in different cost-benefit decision making tasks in rats Psychopharmacology (Berl) 224 2012 489 499
103. M.R. Mitchell, C.M. Vokes, A.L. Blankenship, N.W. Simon, and B. Setlow Effects of acute administration of nicotine, amphetamine, diazepam, morphine, and ethanol on risky decision-making in rats Psychopharmacology (Berl) 218 2011 703 712
104. S.H. Mitchell Measures of impulsivity in cigarette smokers and non-smokers Psychopharmacology (Berl) 146 1999 455 464
105. F.G.M.D. Moeller, and D.M. Dougherty Impulsivity and substance abuse: what is the connection? Addict. Disord. Their Treat. 1 1 2002 3 10
106. P.R. Montague, R.J. Dolan, K.J. Friston, and P. Dayan Computational psychiatry Trends Cognit. Sci. 16 2012 72 80
107. C. Morel, L. Fattore, S. Pons, Y.A. Hay, F. Marti, B. Lambolez, M. De Biasi, M. Lathrop, W. Fratta, U. Maskos, and Ph Faure Nicotine consumption is regulated by a human polymorphism in dopamine neurons Mol. Psychiatry 19 2014 930 936
108. R. Nashmi, C. Xiao, P. Deshpande, S. McKinney, S.R. Grady, P. Whiteaker, Q. Huang, T. McClure-Begley, J.M. Lindstrom, C. Labarca, A.C. Collins, M.J. Marks, and H.A. Lester Chronic nicotine cell specifically upregulates functional α4∗nicotinic receptors: basis for both tolerance in midbrain and enhanced long-term potentiation in perforant path J. Neurosci. 27 2007 8202 8218
109. J. Nesic, J. Rusted, T. Duka, and a Jackson Degree of dependence influences the effect of smoking on cognitive flexibility Pharmacol. Biochem. Behav. 98 2011 376 384
110. Y. Niv, N.D. Daw, D. Joel, and P. Dayan Tonic dopamine: opportunity costs and the control of response vigor Psychopharmacology (Berl) 191 2007 507 520
111. Y. Niv, J.a. Edlund, P. Dayan, and J.P. O'Doherty Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain J. Neurosci. 32 2012 551 562
112. A.B.W. Norton, Y.S. Jo, E.W. Clark, C.A. Taylor, and S.J.Y. Mizumori Independent neural coding of reward and movement by pedunculopontine tegmental nucleus neurons in freely navigating rats Eur. J. Neurosci. 33 2011 1885 1896
113. S.A. Oakman, P.L. Faris, P.E. Kerr, C. Cozzari, and B.K. Hartman Distribution of pontomesencephalic cholinergic neurons projecting to substantia nigra differs significantly from those projecting to ventral tegmental area J. Neurosci. 15 1995 5859 5869
114. C. Padoa-Schioppa Neurobiology of economic choice: a good-based model Annu. Rev. Neurosci. 34 2011 333 359
115. W.-X. Pan, and B.I. Hyland Pedunculopontine tegmental nucleus controls conditioned responses of midbrain dopamine neurons in behaving rats J. Neurosci. 25 2005 4725 4732
116. V. Parikh, R. Kozak, V. Martinez, and M. Sarter Prefrontal acetylcholine release controls cue detection on multiple timescales Neuron 56 2007 141 154
117. J.M. Pearce, and G. Hall A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli Psychol. Rev. 87 6 1980 532
118. J.L. Perry, and M.E. Carroll The role of impulsive behavior in drug abuse Psychopharmacology (Berl) 200 2008 1 26
119. J.L. Perry, E.B. Larson, J.P. German, G.J. Madden, and M.E. Carroll Impulsivity (delay discounting) as a predictor of acquisition of IV cocaine self-administration in female rats Psychopharmacology (Berl) 178 2005 193 201
120. J. Peters, and C. Büchel The neural mechanisms of inter-temporal decision-making: understanding variability Trends Cognit. Sci. 15 2011 227 239
121. P.E. Phillips, G.D. Stuber, M.L. Heien, R.M. Wightman, and R.M. Carelli Subsecond dopamine release promotes cocaine seeking Nature 422 6932 2003 614 618
122. M.R. Picciotto Nicotine as a modulator of behavior: beyond the inverted U Trends Pharmacol. Sci. 24 2003 493 499
123. P. Pichat, O.E. Bergis, J.-P. Terranova, A. Urani, C. Duarte, V. Santucci, C. Gueudet, C. Voltz, R. Steinberg, J. Stemmelin, F. Oury-Donat, P. Avenet, G. Griebel, and B. Scatton SSR180711, a novel selective α7 nicotinic receptor partial agonist: (II) efficacy in experimental models predictive of activity against cognitive symptoms of schizophrenia Neuropsychopharmacology 32 2007 17 34
124. V.I. Pidoplichko, M. DeBiasi, J.T. Williams, and J.A. Dani Nicotine activates and desensitizes midbrain dopamine neurons Nature 390 1997 401 404
125. J. Prickaerts, N.P. van Goethem, R. Chesworth, G. Shapiro, F.G. Boess, C. Methfessel, O.a.H. Reneerkens, D.G. Flood, D. Hilt, M. Gawryl, S. Bertrand, D. Bertrand, and G. König EVP-6124, a novel and selective α7 nicotinic acetylcholine receptor partial agonist, improves memory performance by potentiating the acetylcholine response of α7 nicotinic acetylcholine receptors Neuropharmacology 62 2012 1099 1110
126. S. Rahman, J. Zhang, E.A. Engleman, and W.A. Corrigall Neuroadaptive changes in the mesoaccumbens dopamine system after chronic nicotine self-administration: a microdialysis study Neuroscience 129 2004 415 424
127. J. Ramirez-Latorre, C.R. Yu, X. Qu, F. Perin, A. Karlin, and L. Role Functional contributions of α5 subunit to neuronal acetylcholine receptor channels Nature 380 1996 347 351
128. P. Redgrave, M. Rodriguez, Y. Smith, and M.C. Rodriguez-oroz Europe PMC Funders Group Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease 11 2011 760 772
129. A.D. Redish Addiction as a computational process gone awry Science 306 2004 1944 1947
130. A.D. Redish, S. Jensen, A. Johnson, and Z. Kurth-Nelson Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling Psychol. Rev. 114 3 2007 784 805
131. A.D. Redish, S. Jensen, and A. Johnson A unified framework for addiction: vulnerabilities in the decision process Behav. Brain Sci. 31 2008 415 437 Discussion 437-87
132. R.A. Rescorla, and A.R. Wagner A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement Class. Cond. II Curr. Res. Theory 2 1972 64 99
133. J.N. Reynolds, B.I. Hyland, and J.R. Wickens A cellular mechanism of reward-related learning Nature 413 6851 2001 67 70
134. B. Reynolds, J.B. Richards, K. Horn, and K. Karraker Delay discounting and probability discounting as related to cigarette smoking status in adults Behav. Process. 65 2004 35 42
135. M.F. Rushworth, M.P. Noonan, E.D. Boorman, M.E. Walton, and T.E. Behrens Frontal cortex and reward-guided learning and decision-making Neuron 70 6 2011 1054 1069
136. D. Saal, Y. Dong, A. Bonci, and R.C. Malenka Drugs of abuse and stress trigger a common synaptic adaptation in dopamine neurons Neurons 37 4 2003 577 582
137. J.D. Salamone, M. Correa, A.M. Farrar, E.J. Nunes, and M. Pardo Dopamine, behavioral economics, and effort Front. Behav. Neurosci. 3 2009 13
138. K. Samejima, Y. Ueda, K. Doya, and M. Kimura Representation of action-specific reward values in the striatum Science 310 2005 1337 1340
139. M. Sarter, V. Parikh, and W.M. Howe Phasic acetylcholine release and the volume transmission hypothesis: time to move on Nat. Rev. Neurosci. 10 2009 383 390
140. P.J.H. Schoemaker The expected utility model: its variants, purposes, evidence and limitations J. Econ. Lit. XX 1982 529 563
141. W. Schultz Getting formal with dopamine and reward Neuron 36 2002 241 263
142. W. Schultz, P. Dayan, and P.R. Montague A neural substrate of prediction and reward Science 275 1997 1593 1599
143. P. Serreau, J. Chabout, S.V. Suarez, J. Naudé, and S. Granon β2-containing neuronal nicotinic receptors as major actors in the flexible choice between conflicting motivations Behav. Brain Res. 225 2011 151 159
144. D.A. Simon, and N.D. Daw Neural correlates of forward planning in a spatial decision task in humans J. Neurosci. 31 2011 5526 5539
145. K.L. Skjei, and A. Markou Effects of repeated withdrawal episodes, nicotine dose, and duration of nicotine exposure on the severity and duration of nicotine withdrawal in rats Psychopharmacology 168 2003 280 292
146. A. Stocco Acetylcholine-based entropy in response selection: a model of how striatal interneurons modulate exploration, exploitation, and response variability in decision-making Front. Neurosci. 6 2012 18
147. I.P. Stolerman, and M.J. Jarvis The scientific case that nicotine is addictive Psychopharmacology (Berl) 117 1995 2 10 Discussion 14-20
148. R.S. Sutton, and A.G. Barto Introduction to Reinforcement Learning 1998 MIT Press
149. J. Tang, and J.A. Dani Dopamine enables in vivo synaptic plasticity associated with the addictive drug nicotine Neuron 63 2009 673 682
150. S. Tolu, R. Eddine, F. Marti, V. David, M. Graupner, S. Pons, M. Baudonnat, M. Husson, M. Besson, C. Reperant, J. Zemdegs, C. Pagès, Y.A.H. Hay, B. Lambolez, J. Caboche, B. Gutkin, A.M. Gardier, J.-P. Changeux, P. Faure, and U. Maskos Co-activation of VTA DA and GABA neurons mediates nicotine reinforcement Mol. Psychiatry 18 2013 382 393
151. J.A. Thompson, and G. Felsen Activity in mouse pedunculopontine tegmental nucleus reflects action and outcome in a decision-making task J. Neurophysiol. 110 2013 2817 2829
152. E. Valjent, C. Pagès, D. Hervé, J.-A. Girault, and J. Caboche Addictive and non-addictive drugs induce distinct and specific patterns of ERK activation in mouse brain Eur. J. Neurosci. 19 2004 1826 1836
153. A. Verdejo-García, A.J. Lawrence, and L. Clark Impulsivity as a vulnerability marker for substance-use disorders: review of findings from high-risk research, problem gamblers and genetic association studies Neurosci. Biobehav. Rev. 32 2008 777 810
154. X. Viñals, S. Molas, X. Gallego, R.D. Fernández-Montes, P. Robledo, M. Dierssen, and R. Maldonado Overexpression of α3/α5/β4 nicotinic receptor subunits modifies impulsive-like behavior Drug Alcohol Depend. 122 3 2012 247 252
155. I. Vlaev, N. Chater, N. Stewart, and G.D.A. Brown Does the brain calculate value? Trends Cognit. Sci. 15 2011 546 554
156. T.L. Wallace, and R.H.P. Porter Targeting the nicotinic α7 acetylcholine receptor to enhance cognition in disease Biochem. Pharmacol. 82 2011 891 903
157. R. West, and J. Brown Theory of Addiction 2013 John Wiley & Sons
158. D.I.G. Wilson, D.A.A. MacLaren, and P. Winn Bar pressing for food: differential consequences of lesions to the anterior versus posterior pedunculopontine Eur. J. Neurosci. 30 2009 504 513
159. P. Winn How best to consider the structure and function of the pedunculopontine tegmental nucleus: evidence from animal studies J. Neurol. Sci. 248 1 2006 234 250
160. S. Wonnacott The paradox of nicotinic acetylcholine receptor upregulation by nicotine Trends Pharmacol. Sci. 11 1990
161. C. Xiao, K. Yang, C. Zhou, G. Jin, J. Wu, and J. Ye Nicotine modulates GABAergic transmission to dopaminergic neurons in substantia nigra pars compacta Acta Pharmacol. Sin. 30 2009 851 858
162. L. Xiao, A. Bechara, S. Cen, J.L. Grenard, A.W. Stacy, P. Gallaher, Y. Wei, Y. Jia, and C.A. Johnson Affective decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in 10th-grade Chinese adolescent smokers Nicot. Tob. Res. 10 2008 1085 1097
163. H.H. Yin, S.B. Ostlund, and B.W. Balleine Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks Eur. J. Neurosci. 28 2008 1437 1448
164. A.J. Yu, and P. Dayan Acetylcholine in cortical inference Neural Netw. 15 2002 719 730
165. A.J. Yu, and P. Dayan Uncertainty, neuromodulation, and attention Neuron 46 2005 681 692
166. H. Zhang, and D. Sulzer Frequency-dependent modulation of dopamine release by nicotine Nat. Neurosci. 7 2004 581 582
167. L. Zhang, Y. Dong, W.M. Doyon, and J.A. Dani Withdrawal from chronic nicotine exposure alters dopamine signaling dynamics in the nucleus accumbens Biol. Psychiatry 71 2013 184 191