A hierarchical instrumental decision theory of nicotine dependence

Current Topics in Behavioral Neurosciences

Volumn 23, Issue , 2015, Pages 165-191

  Hogarth, Lee ^a   Troisi, Joseph R ^a  

^a UNIVERSITY OF EXETER   (United Kingdom)

Author keywords

Exposure therapy; External drug cue reactivity; Hierarchical instrumental learning; Individual vulnerability; Internal discriminative stimuli; Nicotine dependence; Pharmacotherapy; Smoking decisions

Indexed keywords

AMFEBUTAMONE; NICOTINE; VARENICLINE;

ARTICLE; CONDITIONED REFLEX; CUE REACTIVITY; DECISION MAKING; DECISION THEORY; DISCRIMINATIVE STIMULUS; DRUG DISCRIMINATION TEST; DRUG SELF ADMINISTRATION; DRUG THERAPY; GESTALT THERAPY; HIERARCHICAL INSTRUMENTAL DECISION THEORY; HUMAN; LEARNING; NONHUMAN; PERSEVERATION; PRIORITY JOURNAL; REWARD; SMOKING; SMOKING CESSATION; SOCIAL LEARNING THEORY; STIMULUS RESPONSE; TITRIMETRY; TOBACCO DEPENDENCE; TREATMENT OUTCOME; ANIMAL; PATHOPHYSIOLOGY;

ANIMALS; DECISION THEORY; HUMANS; TOBACCO USE DISORDER;

EID: 84922465229     PISSN: 18663370     EISSN: 18663389     Source Type: Book Series    
DOI: 10.1007/978-3-319-13665-3_7     Document Type: Article

References (185)

1. Ahmed SH (2010) Validation crisis in animal models of drug addiction: beyond non-disordered drug use toward drug addiction. Neurosci Biobehav Rev 35:172–184
2. Ahmed SH, Koob GF (2005) Transition to drug addiction: a negative reinforcement model based on an allostatic decrease in reward function. Psychopharmacology 180:473–490
3. Ahmed SH, Lenoir M, Guillem K (2013) Neurobiology of addiction versus drug use driven by lack of choice. Curr Opin Neurobiol 23:581–587
4. Anthony JC, Warner LA, Kessler RC (1994) Comparative epidemiology of dependence on tobacco, alcohol, controlled substances, and inhalants: basic findings from the national comorbidity survey. Exp Clin Psychopharmacol 2:244–268
5. Baker TB, Piper ME, McCarthy DE, Majeskie MR, Fiore MC (2004) Addiction motivation reformulated: an affective processing model of negative reinforcement. Psychol Rev 111:33–51
6. Balleine BW, Ostlund SB (2007) Still at the choice-point: action selection and initiation in instrumental conditioning. In: Balleine BW, Doya K, Doherty JO, Sakagami M (eds) Reward and decision making in corticobasal ganglia networks (Annals of the New York Academy of Sciences.). Blackwell Publishing, Malden, pp 147–171
7. Banks ML, Negus SS (2012) Preclinical determinants of drug choice under concurrent schedules of drug self-administration. Adv Pharmacol Sci 2012:281768
8. Behm F, Rose J (1994) Reducing craving for cigarettes while decreasing smoke intake using capsaicin-enhanced low tar cigarette. Exp Clin Psychopharmacol 2:143–153
9. Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ (2008) High impulsivity predicts the switch to compulsive cocaine-taking. Science 320:1352–1355
10. Benowitz NL, Jacob P (1990) Intravenous nicotine replacement suppresses nicotine intake from cigarette smoking. J Pharmacol Exp Ther 254:1000–1005
11. Benowitz N, Porchet H, Jacob P (1990) Pharmacokinetics, metablolism, and pharmacodynamics of nicotine. In: Wonnacott S, Russell M, Stolerman I (eds) Nicotine psychopharmacology molecular, cellular and behavioral aspects. Oxford University Press, New York, pp 112–157
12. Bickel WK, Madden GJ (1999) A comparison of measures of relative reinforcing efficacy and behavioral economics: cigarettes and money in smokers. Behav Pharmacol 10:627–637
13. Bouton ME, Doyle-Burr C, Vurbic D (2012) Asymmetrical generalization of conditioning and extinction from compound to element and element to compound. J Exp Psychol Anim Behav Process 38:381–393
14. Bradfield LA, Balleine BW (2013) Hierarchical and binary associations compete for behavioral control during instrumental biconditional discrimination. J Exp Psychol Anim Behav Process 39:2–13
15. Brandon T, Drobes D, Unrod M, Heckman B, Oliver J, Roetzheim R, Karver S, Small B (2011) Varenicline effects on craving, cue reactivity, and smoking reward. Psychopharmacology 218:1–13
16. Brody AL, Mandelkern MA, Jarvik ME, Lee GS, Smith EC, Huang JC, Bota RG, Bartzokis G, London ED (2004) Differences between smokers and nonsmokers in regional gray matter volumes and densities. Biol Psychiatry 55:77–84
17. Carter BL, Tiffany ST (2001) The cue-availability paradigm: the effects of cigarette availability on cue reactivity in smokers. Exp Clin Psychopharmacol 9:183–190
18. Chait L, Griffiths R (1982) Differential control of puff duration and interpuff interval in cigarette smokers. Pharmacol Biochem Behav 17:155–158
19. Chase HW, MacKillop J, Hogarth L (2013) Isolating behavioral economic indices of demand in relation to nicotine dependence. Psychopharmacology 226:371–380
20. Chassin L, Presson CC, Pitts SC, Sherman SJ (2000) The natural history of cigarette smoking from adolescence to adulthood in a midwestern community sample: multiple trajectories and their psychosocial correlates. Health Psychol 19:223–231
21. Collins BN, Brandon TH (2002) Effects of extinction context and retrieval cues on alcohol cue reactivity among nonalcoholic drinkers. J Consult Clin Psychol 70:390–397
22. Colwill RM, Rescorla RA (1990) Evidence for the hierarchical structure of instrumental learning. Anim Learn Behav 18:71–82
23. Conklin CA, Tiffany ST (2002) Applying extinction research and theory to cue-exposure addiction treatments. Addiction 97:155–167
24. Corbit LH, Nie H, Janak PH (2012) Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum. Biol Psychiatry 72:389–395
25. Corrigall W, Coen K (1989a) Nicotine maintains robust self-administration in rats on a limitedaccess schedule. Psychopharmacology 99:473–478
26. Corrigall WA, Coen KM (1989b) Nicotine maintains robust self-administration in rats on a limited-access schedule. Psychopharmacology 99:473–478
27. Davidson TL (1993) The nature and function of interoceptive signal to feed: towards integration of physiological and learning perspectives. Psychol Rev 100:640–657
28. Davidson TL, Aparicio J, Rescorla R (1988) Transfer between Pavlovian facilitators and instrumental discriminative stimuli. Anim Learn Behav 16:285–291
29. de Wit S, Dickinson A (2009) Associative theories of goal-directed behavior: a case for animal– human translational models. Psychol Res 73:463–476
30. de Wit S, Ridderinkhof KR, Fletcher P, Dickinson A (2012) Resolution of outcome-induced response conflict by humans after extended training. Psychol Res 47:1–14
31. Delamater AR (1996) Effects of several extinction treatments upon the integrity of Pavlovian stimulus-outcome associations. Learn Behav 24:437–449
32. Delfino RJ, Jamner LD, Whalen CK (2001) Temporal analysis of the relationship of smoking behavior and urges to mood states in men versus women. Nicotine Tob Res 3:235–248
33. Devito EE, Herman AI, Waters AJ, Valentine GW, Sofuoglu M (2014) Subjective, physiological, and cognitive responses to intravenous nicotine: effects of sex and menstrual cycle phase. Neuropsychopharmacology 39:1431–1440
34. Di Ciano P, Everitt BJ (2003) Differential control over drug-seeking behavior by drug-associated conditioned reinforcers and discriminative stimuli predictive of drug availability. Behav Neurosci 117:952–960
35. Dickinson A, Balleine BW (2002) The role of learning in the operation of motivational systems. In: Gallistel CR (ed) Stevens’ handbook of experimental psychology, learning, motivation and emotion, vol 3, 3rd edn. Wiley, New York, pp 497–533
36. Dickinson A, Balleine B (2010) The cognitive/motivational interface. In: Kringelbach ML, Berridge KC (eds) Pleasures of the brain. The neural basis of taste, smell and other rewards. Oxford University Press, Oxford, pp 74–84
37. Dickinson A, Wood N, Smith JW (2002) Alcohol seeking by rats: action or habit? Q J Exp Psychol B Comp Physiol Psychol 55:331–348
38. Dols M, Willems B, van den Hout M, Bittoun R (2000) Smokers can learn to influence their urge to smoke. Addict Behav 25:103–108
39. Dols M, Hout Mvd, Kindt M, Willems B (2002) The urge to smoke depends on the expectation of smoking. Addiction 97:87–93
40. Donatelle RJ, Prows SL, Champeau D, Hudson D (2000) Randomised controlled trial using social support and financial incentives for high risk pregnant smokers: significant other supporter (SOS) program. Tob Control. 9: 367–369
41. Donny E, Caggiula A, Knopf S, Brown C (1995) Nicotine self-administration in rats. Psychopharmacology 122:390–392
42. Doran N, Spring B, McChargue D, Pergadia M, Richmond M (2004) Impulsivity and smoking relapse. Nicotine Tob Res 6:641–647
43. Drobes DJ, Tiffany ST (1997) Induction of smoking urge through imaginal and in vivo procedures: physiological and self-report manifestations. J Abnorm Psychol 106:15–25
44. Droungas A, Ehrman R, Childress A, O’Brien C (1995) Effects of smoking cues and cigarette availability on craving and smoking behavior. Addict Behav 20:657–673
45. Dwyer DM, Dunn MJ, Rhodes SEV, Killcross AS (2010) Lesions of the prelimbic prefrontal cortex prevent response conflict produced by action–outcome associations. Q J Exp Psychol 63:417–424
46. Eder A, Müsseler J, Hommel B (2012) The structure of affective action representations: temporal binding of affective response codes. Psychol Res 76:111–118
47. Eissenberg T (2004) Measuring the emergence of tobacco dependence: the contribution of negative reinforcement models. Addiction 99:5–29
48. Elash CA, Burton SM, Tiffany ST (1994) The effect of imagery-induced urges on smoking behavior. Paper presented at the annual meeting of the Midwestern Psychological Association, Chicago
49. Epstein LH, Bulik CM, Perkins KA, Caggiulla AR, Rodefer J (1991) Behavioral economics analysis of smoking: money and food as alternatives. Pharmacol Biochem Behav 38:715–721
50. Everitt BJ, Robbins TW (2013) From the ventral to the dorsal striatum: devolving views of their roles in drug addiction. Neurosci Biobehav Rev 37:1946–1954
51. Ferguson SG, Shiffman S (2009) The relevance and treatment of cue-induced cravings in tobacco dependence. J Subst Abuse Treat 36:235–243
52. Ferguson SG, Shiffman S, Gwaltney CJ (2006) Does reducing withdrawal severity mediate nicotine patch efficacy? A randomized clinical trial. J Consult Clin Psychol 74:1153–1161
53. Feyerabend C, Ings R, Russell M (1985) Nicotine pharmacokinetics and its application to intake from smoking. Br J Pharmacol 19:239–247
54. Franklin T, Wang Z, Suh JJ, Hazan R, Cruz J, Li Y, Goldman M, Detre JA, O’Brien CP, Childress AR (2011) Effects of varenicline on smoking cue-triggered neural and craving responses. Arch Gen Psychiatry 68:516–526
55. Gámez AM, Rosas JM (2005) Transfer of stimulus control across instrumental responses is attenuated by extinction in human instrumental conditioning. Int J Psychol Psychol Ther 5:207–222
56. Gerhardstein L, Wang A, Burki N (1993) Nicotine is responsible for airway irritation evoked by cigarette smoking inhalation in men. J Appl Physiol 75:1955–1961
57. Glad W, Adesso VJ (1976) The relative importance of socially induced tension and behavioral contagion for smoking behavior. J Abnorm Psychol 85:119–121
58. Grindley GC (1932) The formation of a simple habit in guinea-pigs. Br J Psychol 23:127–147
59. Hammond LJ (1980) The effect of contingency upon the appetitive conditioning of free-operant behavior. J Exp Anal Behav 34:297–304
60. Hanson H, Ivester C, Morton B (1979) Nicotine self-administration in rats. In: Krasnegor N (ed) Cigarette smoking as a dependence process. NIDA Research Monograph 23, USD-HEW, Rockville
61. Harris CM, Emmett-Oglesby MW, Robinson NG, Lal H (1986) Withdrawal from chronic nicotine substitutes partially for the interoceptive stimulus produced by pentylenetetrazol (PTZ). Psychopharmacology 90:85–89
62. Harris JA, Andrew BJ, Kwok DWS (2013) Magazine approach during a signal for food depends on Pavlovian, not instrumental, conditioning. J Exp Psychol Anim Behav Process 39:107–116
63. Harvey DM, Yasar S, Heishman SJ, Panlilio LV, Henningfield JE, Goldberg SR (2004) Nicotine serves as an effective reinforcer of intravenous drug-taking behavior in human cigarette smokers. Psychopharmacology 175:134–142
64. Hasenfratz M, Baldinger B, Battig K (1993) Nicotine or tar titration in cigarette smoking behavior. Psychopharmacology 112:253–258
65. Herman CP (1974) External and internal cues as determinants of the smoking behavior of light and heavy smokers. J Pers Soc Psychol 30:664–672
66. Heyes C, Dickinson A (1990) The intentionality of animal action. Mind Lang 5:87–104
67. Heyman GM (2013) Addiction and choice: theory and new data. Front Psychiatry 4:31
68. Hitsman B, Hogarth L, Tseng L-J, Teige JC, Shadel WG, DiBenedetti DB, Danto S, Lee TC, Price LH, Niaura R (2013) Dissociable effect of acute varenicline on tonic versus cue-provoked craving in non-treatment-motivated heavy smokers. Drug Alcohol Depend 130:135–141
69. Hogarth L (2011) The role of impulsivity in the aetiology of drug dependence: reward sensitivity versus automaticity. Psychopharmacology 215:567–580
70. Hogarth L (2012) Goal-directed and transfer-cue-elicited drug-seeking are dissociated by pharmacotherapy: evidence for independent additive controllers. J Exp Psychol Anim Behav Process 38:266–278
71. Hogarth L, Chase HW (2011) Parallel goal-directed and habitual control of human drug-seeking: implications for dependence vulnerability. J Exp Psychol Anim Behav Process 37:261–276
72. Hogarth L, Chase HW (2012) Evaluating psychological markers for human nicotine dependence: tobacco choice, extinction, and Pavlovian-to-instrumental transfer. Exp Clin Psychopharmacol 20:213–224
73. Hogarth L, Dickinson A, Wright A, Kouvaraki M, Duka T (2007) The role of drug expectancy in the control of human drug seeking. J Exp Psychol Anim Behav Process 33:484–496
74. Hogarth L, Dickinson A, Janowski M, Nikitina A, Duka T (2008) The role of attentional bias in mediating human drug seeking behavior. Psychopharmacology 201:29–41
75. Hogarth L, Dickinson A, Duka T (2010) The associative basis of cue elicited drug taking in humans. Psychopharmacology 208:337–351
76. Hogarth L, Attwood AS, Bate HA, Munafò MR (2012a) Acute alcohol impairs human goaldirected action. Biol Psychol 90:154–160
77. Hogarth L, Chase HW, Baess K (2012b) Impaired goal-directed behavioral control in human impulsivity. Q J Exp Psychol 65:305–316
78. Hogarth L, Balleine BW, Corbit LH, Killcross S (2013a) Associative learning mechanisms underpinning the transition from recreational drug use to addiction. Ann N Y Acad Sci 1282:12–24
79. Hogarth L, Field M, Rose AK (2013b) Phasic transition from goal-directed to habitual control over drug-seeking produced by conflicting reinforcer expectancy. Addict Biol 18:88–97
80. Hogarth L, Retzler C, Munafò MR, Tran DMD, Troisi JRI, Rose A, Jones A, Field M (2014) Extinction of cue-evoked drug-seeking relies on targeting hierarchical instrumental knowledge. Behav Res Ther 59:61–70
81. Hogarth L, Maynard OM, Munafò MR (2014) Plain cigarette packs do not exert pavlovian to instrumental transfer of control over tobacco-seeking. Addiction Hommel B (1993) Inverting the Simon effect by intention. Psychol Res 55:270–279
82. Hutcheson DM, Everitt BJ, Robbins TW, Dickinson A (2001) The role of withdrawal in heroin addiction: enhances reward or promotes avoidance? Nat Neurosci 4:943–947
83. Jarvik ME, Caskey NH, Rose JE, Herskovic JE, Sadeghpour M (1989) Anxiolytic effects of smoking associated with four stressors. Addict Behav 14:379–386
84. Jimenez-Gomez C, Shahan TA (2008) Matching law analysis of rats’ alcohol self-administration in a free-operant choice procedure. Behav Pharmacol 19:353–356
85. Johnson MW, Bickel WK (2003) The behavioral economics of cigarette smoking: the concurrent presence of a substitute and an independent reinforcer. Behav Pharmacol 14:137–144
86. Kennerley SW, Walton ME (2011) Decision making and reward in frontal cortex: complementary evidence from neurophysiological and neuropsychological studies. Behav Neurosci 125:297– 317
87. Killen JD, Fortmann SP (1997) Craving is associated with smoking relapse: findings from three prospective studies. Exp Clin Psychopharmacol 5:137–142
88. Koch I, Kunde W (2002) Verbal response-effect compatibility. Mem Cogn 30:1297–1303
89. Kunde W (2001) Response-effect compatibility in manual choice reaction tasks. J Exp Psychol Hum Percept Perform 27:387–394
90. Litvin EB, Brandon TH (2010) Testing the influence of external and internal cues on smoking motivation using a community sample. Exp Clin Psyhopharmacol 18:61–70
91. Liu X, Jernigan C (2012) Effects of caffeine on persistence and reinstatement of nicotine-seeking behavior in rats: interaction with nicotine-associated cues. Psychopharmacology 220:541–550
92. Lu CH, Proctor RW (1995) The influence of irrelevant location information on performance: a review of the Simon and spatial Stroop effects. Psychon Bull Rev 2:174–207
93. MacKillop J, O’Hagen S, Lisman SA, Murphy JG, Ray LA, Tidey JW, McGeary JE, Monti PM (2010) Behavioral economic analysis of cue-elicited craving for alcohol. Addiction 105:1599– 1607
94. MacKillop J, Few LR, Murphy JG, Wier LM, Acker J, Murphy C, Stojek M, Carrigan M, Chaloupka F (2012) High-resolution behavioral economic analysis of cigarette demand to inform tax policy. Addiction 107:2191–2200
95. Manzardo AM, Stein L, Belluzzi JD (2002) Rats prefer cocaine over nicotine in a two-lever selfadministration choice test. Brain Res 924:10–19
96. Marissen MAE, Franken IHA, Waters AJ, Blanken P, van den Brink W, Hendriks VM (2006) Attentional bias predicts heroin relapse following treatment. Addiction 101:1306–1312
97. Maude-Griffin PM, Tiffany ST (1996) Production of smoking urges through imagery: the impact of affect and smoking abstinence. Exp Clin Psychopharmacol 4:198–208
98. McCarthy DE, Piasecki TM, Lawrence DL, Jorenby DE, Shiffman S, Baker TB (2008) Psychological mediators of bupropion sustained-release treatment for smoking cessation. Addiction 103:1521–1533
99. Meeter M, Shohamy D, Myers CE (2009) Acquired equivalence changes stimulus representations. J Exp Anal Behav 91:127–141
100. Mitchell CJ, De Houwer J, Lovibond PF (2009) The propositional nature of human associative learning. Behav Brain Sci 32:183–198
101. Moeller SJ, Beebe-Wang N, Woicik PA, Konova AB, Maloney T, Goldstein RZ (2013) Choice to view cocaine images predicts concurrent and prospective drug use in cocaine addiction. Drug Alcohol Depend 130:178–185
102. Mucha RF, Pauli P, Angrilli A (1998) Conditioned responses elicited by experimentally produced cues for smoking. Can J Physiol Pharmacol 76:259–268
103. Nelson AJD, Killcross S (2013) Accelerated habit formation following amphetamine exposure is reversed by D1, but enhanced by D2, receptor antagonists. Front Neurosci 7:76
104. Nemeth-Coslett R, Griffiths R (1984a) Determinants of puff duration in cigarette smokers: I. Pharmacol Biochem Behav 20:965–971
105. Nemeth-Coslett R, Griffiths R (1984b) Determinants of puff duration in cigarette smokers: II. Pharmacol Biochem Behav 21:903–912
106. Niaura RS, Abrams DB, Pedraza M, Monti P, Rosenhow DJ (1992) Smokers reactions to interpersonal interactions and presentation of smoking cues. Addict Behav 17:557–566
107. Nil R, Battig K (1989) Separate effects of cigarette smoke yield and smoke taste on smoking behavior. Psychopharmacology 99:54–59
108. O’Connell K, Martin E (1987) Highly tempting situations associated with abstinance, temporary lapse, and relapse among participants in smoking cessation program. J Consult Clin Psychol 55:367–371
109. Ostlund SB, Balleine BW (2008) The disunity of Pavlovian and instrumental values. Behav Brain Sci 31:456
110. Overmier JB, Bull JA, Trapold MA (1971) Discriminative cue properties of different fears and their role in response selection in dogs. J Comp Physiol Psychol 76:478–482
111. Palmatier MI, Bevins RA (2008) Occasion setting by drug states: functional equivalence following similar training history. Behav Brain Res 195:260–270
112. Panlilio LV, Schindler CW, Weiss SJ (1996) Cocaine self-administration increased by compounding discriminative stimuli. Psychopharmacology 125:202–208.
113. Patterson F, Jepson C, Loughead J, Perkins K, Strasser AA, Siegel S, Frey J, Gur R, Lerman C (2010) Working memory deficits predict short-term smoking resumption following brief abstinence. Drug Alcohol Depend 106:61–64
114. Payne T, Etscheidt M, Corrigan S (1990) Conditioning arbitrary stimuli to cigarette smoke intake: a preliminary study. J Subst Abuse 2:113–119
115. Payne TJ, Schare ML, Levis DJ, Colletti G (1991) Exposure to smoking-relevant cues: effects on desire to smoke and topographical components of smoking behavior. Addict Behav 16:467–479
116. Perkins KA, Grobe JE, Stiller RL, Fonte C, Goettler JE (1992) Nasal spray nicotine replacement suppresses cigarette smoking desire and behavior. Clin Pharmacol Ther 52:627–634
117. Perkins KA, Epstein LH, Grobe J, Fonte C (1994) Tobacco abstinence, smoking cues, and the reinforcing value of smoking. Pharmacol Biochem Behav 47:107–112
118. Perkins KA, Grobe J, Fonte C (1997a) Influence of acute smoking exposure on the subsequent reinforcing value of smoking. Exp Clin Psychopharmacol 5:277–285
119. Perkins KA, Sanders M, D’Amico D, Wilson A (1997b) Nicotine discrimination and selfadministration in humans as a function of smoking status. Psychopharmacology 131:361–370
120. Perkins KA, Sanders M, Fonte C, Wilson AS, White W, Stiller R, McNamara D (1999) Effects of central and peripheral nicotinic blockade on human nicotine discrimination. Psychopharmacology 142:158–164
121. Perkins KA, Broge M, Gerlach D, Sanders M, Grobe JE, Cherry C, Wilson AS (2002) Acute nicotine reinforcement, but not chronic tolerance, predicts withdrawal and relapse after quitting smoking. Health Psychol 21:332–339
122. Perkins KA, Giedgowd GE, Karelitz JL, Conklin CA, Lerman C (2012) Smoking in response to negative mood in men versus women as a function of distress tolerance. Nicotine Tob Res 14:1418–1425
123. Piper ME, Federmen EB, McCarthy DE, Bolt DM, Smith SS, Fiore MC, Baker TB (2008) Using mediational models to explore the nature of tobacco motivation and tobacco treatment effects. J Abnorm Psychol 117:94–105
124. Pittenger ST, Bevins RA (2013) Interoceptive conditioning with a nicotine stimulus is susceptible to reinforcer devaluation. Behav Neurosci 127:465–473
125. Price KL, Saladin ME, Baker NL, Tolliver BK, DeSantis SM, McRae-Clark AL, Brady KT (2010) Extinction of drug cue reactivity in methamphetamine-dependent individuals. Behav Res Ther. 48:860–865
126. Quick SL, Pyszczynski AD, Colston KA, Shahan TA (2011) Loss of alternative non-drug reinforcement induces relapse of cocaine-seeking in rats: role of dopamine D1 receptors. Neuropsychopharmacology 36:1015–1020
127. Rachlin H (1997) Four teleological theories of addiction. Psychon Bull Rev 4:462–473
128. Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of valuebased decision making. Nat Rev Neurosci 9:545–556
129. Remedios J, Woods C, Tardif C, Janak PH, Chaudhri N (2014) Pavlovian-conditioned alcoholseeking behavior in rats is invigorated by the interaction between discrete and contextual alcohol cues: implications for relapse. Brain Behav 4:278–289
130. Rescorla RA (1987) A Pavlovian analysis of goal-directed behavior. Am Psychol 42:119–129
131. Rescorla RA (1991) Associative relations in instrumental learning—the 18 Bartlett memorial lecture. Q J Exp Psychol B Comp Physiol Psychol 43:1–23
132. Rescorla RA (1992a) Associations between an instrumental discriminative stimulus and multiple outcomes. J Exp Psychol Anim Behav Process 18:95–104
133. Rescorla RA (1992b) Response-outcome versus outcome-response associations in instrumental learning. Anim Learn Behav 20:223–232
134. Rescorla RA (1994) Control of instrumental performance by Pavlovian and instrumental stimuli. J Exp Psychol Anim Behav Process 20:44–50
135. Rescorla RA, Cunningham CL (1979) Spatial contiguity facilitates Pavlovian second-order conditioning. J Exp Psychol Anim Behav Process 5:152–161
136. Roll JM, Higgins ST (2000) A within-subject comparison of three different schedules of reinforcement of drug abstinence using cigarette smoking as an exemplar. Drug Alcohol Depend 58:103–109
137. Rosas JM, Paredes-Olay MC, García-Gutiérrez A, Espinosa JJ, Abad MJF (2010) Outcomespecific transfer between predictive and instrumental learning is unaffected by extinction but reversed by counterconditioning in human participants. Learn Motiv 41:48–66
138. Rose JE, Corrigall WA (1997) Nicotine self-administration in animals and humans: similarities and differences. Psychopharmacology 130:28–40
139. Rose J, Heskovic J, Trilling Y, Jarvik M (1985) Transdermal nicotine reduces cigarette craving and nicotine preference. Clin Pharmacol Ther 38:450–456
140. Rose J, Sampson A, Levin E, Henningfield J (1989) Mecamylamine increase nicotine preference and attenuates nicotine discrimination. Pharmacol Biochem Behav 32:399–938
141. Rose JE, Behm FM, Levin ED (1993) Role of nicotine dose and sensory cues in the regulation of smoke intake. Pharmacol Biochem Behav 44:891–900
142. Rose JE, Westman EC, Behm FM (1996) Nicotine/mecamylamine combination treatment for smoking cessation. Drug Dev Res 38:243–256
143. Rose JE, Westman EC, Behm FM, Johnson MP, Goldberg JS (1999) Blockade of smoking satisfaction using the peripheral nicotinic antagonist trimethaphan. Pharmacol Biochem Behav 62:165–172
144. Russell M, Wilson C, Patel U, Fayerband C, Cole P (1975) Plasma nicotine levels after smoking cigarettes with high median and low nicotine yields. Br Med J 2:414–416
145. Rusted JM, Mackee A, Williams R, Willner P (1998) Deprivation state but not nicotine content of the cigarette affects responding by smokers on a progressive ratio task. Psychopharmacology 140:411–417
146. Şahin E, Çakmak M, Doğar MR, Uğur E, Üçoluk G (2007) To afford or not to afford: a new formalization of affordances toward affordance-based robot control. Adapt Behav 15:447–472
147. Scherer G (1999) Smoking behavior and compensation: a review of the literature. Psychopharmacology 145:1–20
148. Shahan TA, Bickel WK, Badger GJ, Giordano LA (2001) Sensitivity of nicotine-containing and de-nicotinized cigarette consumption to alternative non-drug reinforcement: a behavioral economic analysis. Behav Pharmacol 12:277–284
149. Shiffman S (1986) A cluster-analytic classification of smoking relapse episodes. Addict Behav 11:295–307
150. Shiffman S (2009) Responses to smoking cues are relevant to smoking and relapse. Addiction 104:1617–1618
151. Shiffman S, Ferguson SG, Gwaltney CJ (2006) Immediate hedonic response to smoking lapses: relationship to smoking relapse, and effects of nicotine replacement therapy. Psychopharmacology 184:608–618
152. Shiffman S, Dunbar M, Kirchner T, Li X, Tindle H, Anderson S, Scholl S (2013) Smoker reactivity to cues: effects on craving and on smoking behavior. J Abnorm Psychol 122:264–280
153. Shoaib M, Stolerman I (1999) Plasma nicotine and cotinine levels following intravenous nicotine self-administration in rats. Psychopharmacology 143:318–321
154. Shoptaw S, Rotheram-Fuller E, Yang X, Frosch D, Nahom D, Jarvik ME, Rawson RA, Ling W (2002) Smoking cessation in methadone maintenance. Addiction 97:1317–1328
155. Skinner BF (1938) The behavior of organisms: an experimental analysis. Appleton-Century, Oxford
156. Stairs DJ, Neugebauer NM, Bardo MT (2010) Nicotine and cocaine self-administration using a multiple schedule of intravenous drug and sucrose reinforcement in rats. Behav Pharmacol 21:182–193
157. Stolerman I, Garcha H, Pratt J, Kumar R (1984) Role of training dose in discrimination of nicotine and related compounds in rats. Psychopharmacology 84:413–419
158. Stolerman IP, Rauch RJ, Norris EA (1987) Discriminative stimulus effects of a nicotinemidazolam mixture in rats. Psychopharmacology 93:250–256
159. Surawy B, Stepney R, Cox T (1985) Does watching others smoke increase smoking? Br J Addict 80:207–210
160. Thewissen R, Snijders SJBD, Havermans RC, van den Hout M, Jansen A (2006) Renewal of cueelicited urge to smoke: implications for cue exposure treatment. Behav Res Ther 44:1441–1449
161. Tiffany ST (1990) A cognitive model of drug urges and drug-use behavior: role of automatic and nonautomatic processes. Psychol Rev 97:147–168
162. Tiffany ST, Drobes DJ (1991) The development and initial validation of a questionnaire on smoking urges. Br J Addict 86:1467–1476
163. Tiffany ST, Cox LS, Elash CA (2000) Effects of transdermal nicotine patches on abstinenceinduced and cue-elicited craving in cigarette smokers. J Consult Clin Psychol 68:233–240
164. Tiffany ST, Warthen MW, Goedeker KC (2009) The functional significance of craving in nicotine dependence. In: Caggiula AR, Bevins RA (eds) The motivational impact of nicotine and its role in tobacco use (Nebraska symposium on motivation). Springer, New York, pp 1–27
165. Trapold MA (1970) Are expectancies based upon different positive reinforcing events discriminably different? Learn Motiv 1:129–140
166. Troisi JRII (2003) Nicotine vs. ethanol discrimination: extinction and spontaneous recovery of responding. Integr Physiol Behav Sci 38:104–123
167. Troisi JRII (2006) Pavlovian-instrumental transfer of the discriminative stimulus effects of nicotine and ethanol in rats. Psychol Rec 56:499–512
168. Troisi JRII (2013a) Acquisition, extinction, recovery, and reversal of different response sequences under conditional control by nicotine in rats. J Gen Psychol 140:187–203
169. Troisi JRII (2013b) The Pavlovian vs. operant interoceptive stimulus effects of EtOH: commentary on Besheer, Fisher, & Durant (2012). Alcohol 47:433–436
170. Troisi JRII (2013c) Perhaps more consideration of Pavlovian operant interactions may improve the clinical efficacy of behaviorally based drug treatment programs. Psychol Rec 63:863–894
171. Troisi JRII, LeMay BJ, Järbe TUC (2010) Transfer of the discriminative stimulus effects of Δ9 THC and nicotine from one operant response to another in rats. Psychopharmacology. 212:171-179
172. Troisi JRII, Bryant E, Kane J (2012) Extinction of the discriminative stimulus effects of nicotine with a devalued reinforcer: recovery following revaluation. Psychol Rec 62:707–718
173. Troisi JRII, Dooley TF, Craig EM (2013) The discriminative stimulus effects of a nicotine-ethanol compound in rats: extinction with the parts differs from the whole. Behav Neurosci 127:899–912
174. Urcuioli PJ (2005) Behavioral and associative effects of differential outcomes in discrimination learning. Anim Learn Behav 33:1–21
175. Ussher MH, Taylor A, Faulkner G (2012) Exercise interventions for smoking cessation. The Cochrane Database of Systematic Reviews 1
176. VanderVeen JW, Cohen LM, Cukrowicz KC, Trotter DRM (2008) The role of impulsivity on smoking maintenance. Nicotine Tob Res 10:1397–1404
177. Vlaev I, Chater N, Stewart N, Brown GDA (2011) Does the brain calculate value? Trends Cogn Sci 15:546–554
178. Volpp KG, Gurmankin Levy A, Asch DA, Berlin JA, Murphy JJ, Gomez A, Sox H, Zhu J, Lerman C (2006) A randomized controlled trial of financial incentives for smoking cessation. Cancer Epidemiol Biomark Prev 15:12–18
179. Westman EC, Behm FM, Rose JE (1995) Airway sensory replacement combined with nicotine replacement for smoking cessation—a randomized, placebo controlled trial using a citric acid inhaler. Chest 107:1358–1364
180. Wiley R, Wickham J (1974) The fabrication and application of a puff-by-puff smoking machine. Tob Sci 18:67–69
181. Willner P, Jones C (1996) Effects of mood manipulation on subjective and behavioral measures of cigarette craving. Behav Pharmacol 7:355–363
182. Willner P, Hardman S, Eaton G (1995) Subjective and behavioral evaluation of cigarette cravings. Psychopharmacology 118:171–177
183. Winterbauer NE, Bouton ME (2010) Mechanisms of resurgence of an extinguished instrumental behavior. J Exp Psychol Anim Behav Process 36:343–353
184. Woolverton WL, Anderson KG (2006) Effects of delay to reinforcement on the choice between cocaine and food in rhesus monkeys. Psychopharmacology 186:99–106
185. Xue YX, Luo YX, Wu P, Shi HS, Xue LF, Chen C, Zhu WL, Ding ZB, Bao YP, Shi J, Epstein DH, Shaham Y, Lu L (2012) A memory retrieval-extinction procedure to prevent drug craving and relapse. Science 336:241–245