Extinction of cue-evoked drug-seeking relies on degrading hierarchical instrumental expectancies

Behaviour Research and Therapy

Volumn 59, Issue , 2014, Pages 61-70

  Hogarth, Lee ^a,b   Retzler, Chris ^c   Munafò, Marcus R ^d,g   Tran, Dominic M D ^b   Troisi, Joseph R ^e   Rose, Abigail K ^f   Jones, Andrew ^f   Field, Matt ^f,g  

^a UNIVERSITY OF EXETER   (United Kingdom)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

^c UNIVERSITY OF HUDDERSFIELD   (United Kingdom)

^d UNIVERSITY OF BRISTOL   (United Kingdom)

^e SAINT ANSELM COLLEGE   (United States)

^f UNIVERSITY OF LIVERPOOL   (United Kingdom)

^g UK CENTRE FOR TOBACCO AND ALCOHOL STUDIES   (United Kingdom)

Author keywords

Dependence; Extinction; Learning; Relapse; Transfer

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; CONDITIONED REFLEX; CUE EVOKED DRUG SEEKING; DISCRIMINATION LEARNING; DISCRIMINATIVE STIMULUS; DRINKING BEHAVIOR; DRUG SEEKING BEHAVIOR; EVOKED RESPONSE; EXPECTANCY; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; REINFORCEMENT; REWARD; SIGNAL PROCESSING; SMOKING; STIMULUS RESPONSE; VERBAL COMMUNICATION; INSTRUMENTAL CONDITIONING; LEARNING; PHOTOSTIMULATION; PSYCHOLOGY; YOUNG ADULT;

ALCOHOL DRINKING; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; CUES; DISCRIMINATION LEARNING; DRUG-SEEKING BEHAVIOR; EXTINCTION, PSYCHOLOGICAL; FEMALE; HUMANS; MALE; PHOTIC STIMULATION; REWARD; SMOKING; TRANSFER (PSYCHOLOGY); YOUNG ADULT;

EID: 84903904405     PISSN: 00057967     EISSN: 1873622X     Source Type: Journal    
DOI: 10.1016/j.brat.2014.06.001     Document Type: Article

References (84)

1. Attwood A.S., O'Sullivan H., Leonards U., Mackintosh B., Munafo M.R. Attentional bias training and cue reactivity in cigarette smokers. Addiction 2008, 103:1875-1882.
2. Babor T.F., Higgins-Biddle J.C., Saunders J.B., Monteiro M.G. AUDIT: The alcohol use disorders identification test guidelines for use in primary care 2001, Department of Mental Health and Substance Dependence. World Health Organization. 2nd ed.
3. Balleine B.W., Ostlund S.B. Still at the choice-point: action selection and initiation in instrumental conditioning. Reward and decision making in corticobasal ganglia networks 2007, 147-171. Blackwell Publishing, Malden. B.W. Balleine, K. Doya, J.O. Doherty, M. Sakagami (Eds.).
4. Bouton M.E., Todd T.P., Vurbic D., Winterbauer N.E. Renewal after the extinction of free operant behavior. Learning & Behavior 2011, 39:57-67.
5. Bradfield L.A., Balleine B.W. Hierarchical and binary associations compete for behavioral control during instrumental biconditional discrimination. Journal of Experimental Psychology: Animal Behavior Processes 2013, 39:2-13.
6. Cisek P. Cortical mechanisms of action selection: the affordance competition hypothesis. Philosophical Transactions of the Royal Society B: Biological Sciences 2007, 362:1585-1599.
7. Collins B.N., Brandon T.H. Effects of extinction context and retrieval cues on alcohol cue reactivity among nonalcoholic drinkers. Journal of Consulting and Clinical Psychology 2002, 70:390-397.
8. Colwill R.M. Associative representations of instrumental contingencies. Psychology of learning and motivation 1994, Vol. 31:1-72. Academic Press.
9. Colwill R.M., Delamater B.A. An associative analysis of instrumental biconditional discrimination learning. Animal Learning & Behavior 1995, 23:218-233.
10. Colwill R.M., Rescorla R.A. Effects of reinforcer devaluation on discriminative control of instrumental behavior. Journal of Experimental Psychology: Animal Behavior Processes 1990, 16:40-47.
11. Colwill R.M., Rescorla R.A. Evidence for the hierarchical structure of instrumental learning. Animal Learning & Behavior 1990, 18:71-82.
12. Conklin C.A., Tiffany S.T. Applying extinction research and theory to cue-exposure addiction treatments. Addiction 2002, 97:155-167.
13. Corbit L.H., Janak P.H., Balleine B.W. General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area. European Journal of Neuroscience 2007, 26:3141-3149.
14. Delamater A.R. Outcome-selective effects of intertrial reinforcement in Pavlovian appetitive conditioning with rats. Animal Learning & Behavior 1995, 23:31-39.
15. Delamater A.R. Effects of several extinction treatments upon the integrity of Pavlovian stimulus-outcome associations. Learning & Behavior 1996, 24:437-449.
16. Dwyer D.M., Dunn M.J., Rhodes S.E.V., Killcross A.S. Lesions of the prelimbic prefrontal cortex prevent response conflict produced by action-outcome associations. The Quarterly Journal of Experimental Psychology 2010, 63:417-424.
17. Eberl C., Wiers R.W., Pawelczack S., Rinck M., Becker E.S., Lindenmeyer J. Approach bias modification in alcohol dependence: do clinical effects replicate and for whom does it work best?. Developmental Cognitive Neuroscience 2013, 4:38-51.
18. Eder A., Müsseler J., Hommel B. The structure of affective action representations: temporal binding of affective response codes. Psychological Research 2012, 76:111-118.
19. Ferguson S.G., Shiffman S. The relevance and treatment of cue-induced cravings in tobacco dependence. Journal of Substance Abuse Treatment 2009, 36:235-243.
20. Field M., Duka T., Eastwood B., Child R., Santarcangelo M., Gayton M. Experimental manipulation of attentional biases in heavy drinkers: do the effects generalise?. Psychopharmacology 2007, 192:593-608.
21. Gámez A.M., Rosas J.M. Transfer of stimulus control across instrumental responses is attenuated by extinction in human instrumental conditioning. International Journal of Psychology & Psychological Therapy 2005, 5:207-222.
22. Garbusow, M., Schad, D. J., Sommer, C., Jünger, E., Sebold, M., Friedel, E., et al. Pavlovian-to-instrumental-transfer in alcohol dependence - a pilot study. Neuropsychobiology (in press).
23. Gass J.T., Chandler L.J. The plasticity of extinction: contribution of the prefrontal cortex in treating addiction though inhibitory learning. Frontiers in Psychiatry 2013, 4.
24. Glautier S., Elgueta T. Multiple cue extinction effects on recovery of responding in causal judgments. International Journal of Comparative Psychology 2009, 22:254-270.
25. Goldstein R.Z., Volkow N.D. Dysfunction of the prefrontal cortex in addiction: neuroimaging findings and clinical implications. Nature Reviews Neuroscience 2011, 12:652-669.
26. Gunther L.M., Denniston J.C., Miller R.R. Conducting exposure treatment in multiple contexts can prevent relapse. Behaviour Research and Therapy 1998, 36:75-91.
27. Haddon J.E., George D.N., Killcross S. Contextual control of biconditional task performance: evidence for cue and response competition in rats. Quarterly Journal of Experimental Psychology 2008, 61:1307-1320.
28. Heyes C., Dickinson A. The intentionality of animal action. Mind and Language 1990, 5:87-104.
29. Hitsman B., Hogarth L., Tseng L.-J., Teige J.C., Shadel W.G., DiBenedetti D.B., et al. Dissociable effect of acute varenicline on tonic versus cue-provoked craving in non-treatment-motivated heavy smokers. Drug and Alcohol Dependence 2013, 130:135-141.
30. Hogarth L. Goal-directed and transfer-cue-elicited drug-seeking are dissociated by pharmacotherapy: evidence for independent additive controllers. Journal of Experimental Psychology: Animal Behavior Processes 2012, 38:266-278.
31. Hogarth L., Balleine B.W., Corbit L.H., Killcross S. Associative learning mechanisms underpinning the transition from recreational drug use to addiction. Annals of the New York Academy of Sciences 2013, 1282:12-24.
32. Hogarth L., Chase H.W. Parallel goal-directed and habitual control of human drug-seeking: implications for dependence vulnerability. Journal of Experimental Psychology: Animal Behavior Processes 2011, 37:261-276.
33. Hogarth L., Chase H.W. Evaluating psychological markers for human nicotine dependence: tobacco choice, extinction, and Pavlovian-to-instrumental transfer. Experimental and Clinical Psychopharmacology 2012, 20:213-224.
34. Hogarth L., Dickinson A., Duka T. Detection versus sustained attention to drug cues have dissociable roles in mediating drug seeking behaviour. Experimental and Clinical Psychopharmacology 2009, 17:21-30.
35. Hogarth L., Dickinson A., Duka T. The associative basis of cue elicited drug taking in humans. Psychopharmacology 2010, 208:337-351.
36. Hogarth L., Dickinson A., Janowski M., Nikitina A., Duka T. The role of attentional bias in mediating human drug seeking behaviour. Psychopharmacology 2008, 201:29-41.
37. Hogarth L., Dickinson A., Wright A., Kouvaraki M., Duka T. The role of drug expectancy in the control of human drug seeking. Journal of Experimental Psychology: Animal Behavior Processes 2007, 33:484-496.
38. Holland P.C. Relations between Pavlovian-instrumental transfer and reinforcer devaluation. Journal of Experimental Psychology: Animal Behavior Processes 2004, 30. 258-258.
39. Holman J.G., Mackintosh N.J. The control of appetitive instrumental responding does not depend on classical conditioning to the discriminative stimulus. Quarterly Journal of Experimental Psychology Section B 1981, 33:21-31.
40. Holmes N.M., Marchand A.R., Coutureau E. Pavlovian to instrumental transfer: a neurobehavioural perspective. Neuroscience & Biobehavioral Reviews 2010, 34:1277-1295.
41. Hommel B. Inverting the Simon effect by intention. Psychological Research 1993, 55:270-279.
42. Houben K., Nederkoorn C., Wiers R.W., Jansen A. Resisting temptation: decreasing alcohol-related affect and drinking behavior by training response inhibition. Drug and Alcohol Dependence 2011, 116:132-136.
43. Jones A., Field M. The effects of cue-specific inhibition training on alcohol consumption in heavy social drinkers. Experimental and Clinical Psychopharmacology 2013, 21:8-16.
44. Kennerley S.W., Walton M.E. Decision making and reward in frontal cortex: complementary evidence from neurophysiological and neuropsychological studies. Behavioral Neuroscience 2011, 125:297-317.
45. Koch I., Kunde W. Verbal response-effect compatibility. Memory & Cognition 2002, 30:1297-1303.
46. Kunde W. Response-effect compatibility in manual choice reaction tasks. Journal of Experimental Psychology: Human Perception and Performance 2001, 27:387-394.
47. Loewenstein G. Out of control: visceral influences on behavior. Organizational Behavior and Human Decision Processes 1996, 65:272-292.
48. Lu C.H., Proctor R.W. The influence of irrelevant location information on performance: a review of the Simon and spatial Stroop effects. Psychonomic Bulletin & Review 1995, 2:174-207.
49. Martinovic J., Jones A., Christiansen P., Rose A.K., Hogarth L., Field M. Electrophysiological responses to alcohol cues are not associated with Pavlovian-to-instrumental transfer in social drinkers. Plos One 2014, 9:e94605.
50. Millan E.Z., Milligan-Saville J., McNally G.P. Memory retrieval, extinction, and reinstatement of alcohol seeking. Neurobiology of Learning and Memory 2013, 101:26-32.
51. Mitchell C.J., De Houwer J., Lovibond P.F. The propositional nature of human associative learning. Behavioral and Brain Sciences 2009, 32:183-198.
52. Nadler N., Delgado M.R., Delamater A.R. Pavlovian to instrumental transfer of control in a human learning task. Emotion 2011, 11:1112-1123.
53. Overmier J.B., Bull J.A., Trapold M.A. Discriminative cue properties of different fears and their role in response selection in dogs. Journal of Comparative and Physiological Psychology 1971, 76:478-482.
54. Perkins K.A., Lerman C., Fonte C.A., Mercincavage M., Stitzer M.L., Chengappa K.N.R., et al. Cross-validation of a new procedure for early screening of smoking cessation medications in humans. Clinical Pharmacology and Therapeutics 2010, 88:109-114.
55. Price K.L., Saladin M.E., Baker N.L., Tolliver B.K., DeSantis S.M., McRae-Clark A.L., et al. Extinction of drug cue reactivity in methamphetamine-dependent individuals. Behaviour Research and Therapy 2010, 48:860-865.
56. Rescorla R.A. Associative relations in instrumental learning - the 18 Bartlett memorial lecture. Quarterly Journal of Experimental Psychology Section B - Comparative and Physiological Psychology 1991, 43:1-23.
57. Rescorla R.A. Associations between an instrumental discriminative stimulus and multiple outcomes. Journal of Experimental Psychology: Animal Behavior Processes 1992, 18:95-104.
58. Rescorla R.A. Response-outcome versus outcome-response associations in instrumental learning. Animal Learning & Behavior 1992, 20:223-232.
59. Rescorla R.A. Control of instrumental performance by Pavlovian and instrumental stimuli. Journal of Experimental Psychology: Animal Behavior Processes 1994, 20:44-50.
60. Rescorla R.A. Transfer of instrumental control mediated by a devalued outcome. Animal Learning & Behavior 1994, 22:27-33.
61. Rescorla R.A., Cunningham C.L. Spatial contiguity facilitates Pavlovian second-order conditioning. Journal of Experimental Psychology: Animal Behavior Processes 1979, 5:152-161.
62. Rosas J.M., Paredes-Olay M.C., García-Gutiérrez A., Espinosa J.J., Abad M.J.F. Outcome-specific transfer between predictive and instrumental learning is unaffected by extinction but reversed by counterconditioning in human participants. Learning and Motivation 2010, 41:48-66.
63. Rosas J.M., Todd T.P., Bouton M.E. Context change and associative learning. Wiley Interdisciplinary Reviews: Cognitive Science 2013, 4:237-244.
64. Şahin E., Çakmak M., Doǧar M.R., Uǧur E., Üçoluk G. To afford or not to afford: a new formalization of affordances toward affordance-based robot control. Adaptive Behavior 2007, 15:447-472.
65. Sayette M.A., Tiffany S.T. Peak provoked craving: an alternative to smoking cue-reactivity. Addiction 2013, 108:1019-1025.
66. Schoenmakers T.M., de Bruin M., Lux I.F.M., Goertz A.G., Van Kerkhof D.H.A.T., Wiers R.W. Clinical effectiveness of attentional bias modification training in abstinent alcoholic patients. Drug and Alcohol Dependence 2010, 109:30-36.
67. Shiffman S. Responses to smoking cues are relevant to smoking and relapse. Addiction 2009, 104:1617-1618.
68. Shiflett M. The effects of amphetamine exposure on outcome-selective Pavlovian-instrumental transfer in rats. Psychopharmacology 2012, 223:361-370.
69. Thewissen R., Snijders S.J.B.D., Havermans R.C., van den Hout M., Jansen A. Renewal of cue-elicited urge to smoke: Implications for cue exposure treatment. Behaviour Research and Therapy 2006, 44:1441-1449.
70. Todd T.P. Mechanisms of renewal after the extinction of instrumental behavior. Journal of Experimental Psychology: Animal Behavior Processes 2013, 39:193-207.
71. Todd T.P., Vurbic D., Bouton M.E. Behavioral and neurobiological mechanisms of extinction in Pavlovian and instrumental learning. Neurobiology of Learning and Memory 2014, 108:52-64.
72. Trapold M.A. Are expectancies based upon different positive reinforcing events discriminably different?. Learning and Motivation 1970, 1:129-140.
73. Troisi J.R.I. Pavlovian-instrumental transfer of the discriminative stimulus effects of nicotine and ethanol in rats. Psychological Record 2006, 56:499-512.
74. Troisi J.R.I. Acquisition, extinction, recovery, and reversal of different response sequences under conditional control by nicotine in rats. The Journal of General Psychology 2013, 140:187-203.
75. Troisi J.R.I. Perhaps more consideration of Pavlovian operant interactions may improve the clinical efficacy of behaviorally based drug treatment programs. Psychological Record 2013, 63:863-894.
76. Troisi J.R.I., LeMay B.J., Järbe T.U.C. Transfer of the discriminative stimulus effects of δ9-THC and nicotine from one operant response to another in rats. Psychopharmacology 2010, 212:171-179.
77. Urcuioli P.J. Behavioral and associative effects of differential outcomes in discrimination learning. Animal Learning & Behavior 2005, 33:1-21.
78. Veling H., Aarts H., Stroebe W. Using stop signals to reduce impulsive choices for palatable unhealthy foods. British Journal of Health Psychology 2013, 18:354-368.
79. Verbruggen F., Logan G.D. Automatic and controlled response inhibition: associative learning in the go/no-go and stop-signal paradigms. Journal of Experimental Psychology: General 2008, 137:649-672.
80. Wakefield M.A., Hayes L., Durkin S., Borland R. Introduction effects of the Australian plain packaging policy on adult smokers: a cross-sectional study. BMJ Open 2013, 3.
81. Wilson S.J., Sayette M.A., Fiez J.A. Quitting-unmotivated and quitting-motivated cigarette smokers exhibit different patterns of cue-elicited brain activation when anticipating an opportunity to smoke. Journal of Abnormal Psychology 2012, 121:198-211.
82. de Wit S., Dickinson A. Associative theories of goal-directed behaviour: a case for animal-human translational models. Psychological Research 2009, 73:463-476.
83. de Wit S., Ridderinkhof K.R., Fletcher P., Dickinson A. Resolution of outcome-induced response conflict by humans after extended training. Psychological Research 2012, 1-14.
84. Xue Y.X., Luo Y.X., Wu P., Shi H.S., Xue L.F., Chen C., et al. Amemory retrieval-extinction procedure to prevent drug craving and relapse. Science 2012, 336:241-245.