Relapse processes after the extinction of instrumental learning: Renewal, resurgence, and reacquisition

Behavioural Processes

Volumn 90, Issue 1, 2012, Pages 130-141

  Bouton, Mark E ^a   Winterbauer, Neil E ^a   Todd, Travis P ^a  

^a UNIVERSITY OF VERMONT   (United States)

Author keywords

Context; Extinction; Instrumental (operant) learning; Reacquisition; Renewal; Resurgence

Indexed keywords

COCAINE; CYCLOSERINE;

CONDITIONING; EXPERIMENTAL STUDY; THEORETICAL STUDY;

ARTICLE; BEHAVIOR; BEHAVIOR CHANGE; COCAINE DEPENDENCE; CONDITIONED REFLEX; CONDITIONING; DRUG EFFICACY; EVOKED RESPONSE; FACILITATION; FEAR; FOOD DEPRIVATION; HELP SEEKING BEHAVIOR; INSTRUMENTAL CONDITIONING; INSTRUMENTAL LEARNING; LABORATORY; LEARNING; LONG TERM POTENTIATION; NONHUMAN; PLACE PREFERENCE; REACQUISITION; REINFORCEMENT; RENEWAL; RESURGENCE; REWARD; STIMULUS RESPONSE;

ANIMALS; CONDITIONING, OPERANT; EXTINCTION, PSYCHOLOGICAL; RATS;

EID: 84860171809     PISSN: 03766357     EISSN: 18728308     Source Type: Journal    
DOI: 10.1016/j.beproc.2012.03.004     Document Type: Article

References (95)

1. Atkinson R.C., Estes W.K. Stimulus sampling theory. Handbook of Mathematical Psychology 1963, 3:121-268. Wiley, New York.
2. Bossert J.M., Liu S.Y., Lu L., Shaham Y. A role of ventral tegmental area glutamate in contextual cue-induced relapse to heroin seeking. J. Neurosci. 2004, 24:10726-10730.
3. Botreau F., Paolone G., Stewart J. d-Cycloserine facilitates extinction of a cocaine-induced conditioned place preference. Behav. Brain Res. 2006, 172:173-178.
4. Bouton M.E. Differential control by context in the inflation and reinstatement paradigms. J. Exp. Psychol.: Anim. Behav. Process. 1984, 10:56-74.
5. Bouton M.E. Slow reacquisition following the extinction of conditioned suppression. Learn. Motiv. 1986, 17:1-15.
6. Bouton M.E. Context and ambiguity in the extinction of emotional learning: Implications for exposure therapy. Behav. Res. Ther. 1988, 26:137-149.
7. Bouton M.E. Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. Psychol. Bull. 1993, 114:80-99.
8. Bouton M.E. A learning theory perspective on lapse relapse and the maintenance of behavior change. Health Psychol. 2000, 19:57-63.
9. Bouton M.E. Context, ambiguity, and unlearning: Sources of relapse after behavioral extinction. Biol. Psychiatry 2002, 52:976-986.
10. Bouton M.E. Context and behavioral processes in extinction. Learn. Mem. 2004, 11:485-494.
11. Bouton M.E. The multiple forms of context in associative learning theory. The Mind in Context 2010, 233-258. Guilford Press, New York, NY, US. B. Mesquita, L.F. Barrett, E.R. Smith (Eds.).
12. Bouton M.E. Learning and the persistence of appetite: extinction and the motivation to eat and overeat. Physiol. Behav. 2011, 103:51-58.
13. Bouton M.E., Bolles R.C. Contextual control of the extinction of conditioned fear. Learn. Motiv. 1979, 10:445-466.
14. Bouton M.E., Bolles R.C. Role of conditioned contextual stimuli in reinstatement of extinguished fear. J. Exp. Psychol.: Anim. Behav. Process. 1979, 5:368-378.
15. Bouton M.E., King D.A. Contextual control of the extinction of conditioned fear: tests for the associative value of the context. J. Exp. Psychol.: Anim. Behav. Process. 1983, 9:248-265.
16. Bouton M.E., Swartzentruber D. Analysis of the associative and occasion-setting properties of contexts participating in a Pavlovian discrimination. J. Exp. Psychol.: Anim. Behav. Process. 1986, 12:333-350.
17. Bouton M.E., Swartzentruber D. Slow reacquisition following extinction: context, encoding, and retrieval mechanisms. J. Exp. Psychol.: Anim. Behav. Process. 1989, 15:43-53.
18. Bouton M.E., Swartzentruber D. Sources of relapse after extinction in Pavlovian and instrumental learning. Clin. Psychol. Rev. 1991, 11:123-140.
19. Bouton M.E., Ricker S.T. Renewal of extinguished responding in a second context. Anim. Learn. Behav. 1994, 22:317-324.
20. Bouton M.E., García-Gutiérrez A. Intertrial interval as a contextual stimulus. Behav. Process. 2006, 71:307-317.
21. Bouton M.E., Woods A.M. Extinction: behavioral mechanisms and their implications. Learning and Memory: A Comprehensive Reference 2008, vol. 1:151-171. Elsevier, Oxford, UK.
22. Bouton M.E., Hendrix M.C. Intertrial interval as a contextual stimulus: further analysis of a novel asymmetry in temporal discrimination learning. J. Exp. Psychol.: Anim. Behav. Process. 2011, 37:79-93.
23. Bouton M.E., Kenny F.A., Rosengard C. State-dependent fear extinction with two benzodiazepine tranquilizers. Behav. Neurosci. 1990, 104:44-55.
24. Bouton M.E., Woods A.M., Pineño O. Occasional reinforced trials during extinction can slow the rate of rapid reacquisition. Learn. Motiv. 2004, 35:371-390.
25. Bouton M.E., García-Gutiérrez A., Zilski J., Moody E.W. Extinction in multiple contexts does not necessarily make extinction less vulnerable to relapse. Behav. Res. Ther. 2006, 44:983-994.
26. Bouton M.E., Woods A.M., Moody E.W., Sunsay C., García-Gutiérrez A. Counteracting the context-dependence of extinction: Relapse and some tests of possible methods of relapse prevention. Fear and Learning: Basic Science to Clinical Application 2006, American Psychological Association, Washington, DC. M.G. Craske, D. Hermans, D. Vansteenwegen (Eds.).
27. Bouton M.E., Vurbic D., Woods A.M. d-Cycloserine facilitates context-specific fear extinction learning. Neurobiol. Learn. Mem. 2008, 90:504-510.
28. Bouton M.E., Todd T.P., Vurbic D., Winterbauer N.E. Renewal after the extinction of free-operant behavior. Learn. Behav. 2011, 39:57-67.
29. Bouton M.E., Winterbauer N.E., Vurbic D. Context and extinction: mechanisms of relapse in drug self-administration. Clinical Application of Learning Theory 2011, Psychology Press, East Sussex, UK. M. Haselgrove, L. Hogarth (Eds.).
30. Brooks D.C., Bouton M.E. A retrieval cue for extinction attenuates response recovery (renewal) caused by a return to the conditioning context. J. Exp. Psychol.: Anim. Behav. Process. 1994, 20:366-379.
31. Bullock D.H., Smith W.C. An effect of repeated conditioning-extinction upon operant strength. J. Exp. Psychol. 1953, 46:349-352.
32. Cancado C.R.X., Lattal K.A. Resurgence of temporal patterns of responding. J. Exp. Anal. Behav. 2011, 95:271-287.
33. Capaldi E.J. A sequential hypothesis of instrumental learning. The Psychology of Learning and Motivation 1967, 67-156. Academic Press, New York. K.W. Spence, J.T. Spence (Eds.).
34. Capaldi E.J. The sequential view: from rapidly fading stimulus traces to the organization of memory and the abstract concept of number. Psychon. Bull. Rev. 1994, 1:156-181.
35. Chaudhri N., Sahuque L.L., Janak P.H. Context-induced relapse of conditioned behavioral responding to ethanol cues in rats. Biol. Psychiatry 2008, 64:203-210.
36. Collins B.N., Brandon T.H. Effects of extinction context and retrieval cues on alcohol cue reactivity among nonalcoholic drinkers. J. Consult. Clin. Psychol. 2002, 70:390-397.
37. Conklin C.A., Tiffany S.T. Applying extinction research and theory to cue-exposure addiction treatments. Addiction 2002, 97:155-167.
38. Craske M.G., Kircanski K., Zelikowsky M., Mystkowski J., Chowdhury N., Baker A. Optimizing inhibitory learning during exposure therapy. Behav. Res. Ther. 2008, 46:5-27.
39. Cunningham C.L. Alcohol as a cue for extinction: state dependency produced by conditioned inhibition. Learn. Behav. 1979, 7:45-52.
40. Crombag H.S., Shaham Y. Renewal of drug seeking by contextual cues after prolonged extinction in rats. Behav. Neurosci. 2002, 116:169-173.
41. Dawson G.R., Dickinson A. Performance on ratio and interval schedules with matched reinforcement rates. Quart. J. Exp. Psychol. 1990, 42:225-239.
42. Epstein R. Resurgence of previously reinforced behavior during extinction. Behav. Anal. Lett. 1983, 3:391-397.
43. Gallistel C.R., Mark T.A., King A.P., Latham P.E. The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. J. Exp. Psychol.: Anim. Behav. Process. 2001, 27:354-372.
44. Groblewski P.A., Lattal K.M., Cunningham C.L. Effects of d-cycloserine on extinction and reconditioning of ethanol-seeking behavior in mice. Alcohol.: Clin. Exp. Res. 2009, 33:772-782.
45. Gunther L.M., Denniston J.C., Miller R.R. Conducting exposure treatment in multiple contexts can prevent relapse. Behav. Res. Ther. 1998, 36:75-91.
46. Hamlin A.S., Clemens K.J., McNally G.P. Renewal of extinguished cocaine-seeking. Neuroscience 2008, 151:659-670.
47. Hamlin A.S., Newby J., McNally G.P. The neural correlates and role of D1 dopamine receptors in renewal of extinguished alcohol-seeking. Neuroscience 2007, 146:525-536.
48. Higgins S.T., Heil S.H., Lussier J.P. Clinical implications of reinforcement as a determinant of substance abuse disorders. Ann. Rev. Psychol. 2004, 55:431-461.
49. Kearns D.N., Weiss S.J. Contextual renewal of cocaine seeking in rats and its attenuation by the conditioned effects of an alternative reinforcer. Drug Alcohol Depend. 2007, 90:193-202.
50. Kessler D.A. The End of Overeating: Taking Control of the Insatiable American Appetite 2009, Rodale, New York.
51. Kimble G.A. Conditioning and Learning 1961, Appleton-Century-Crofts, New York.
52. Laborda M.A., McConnell B.L., Miller R.R. Behavioral techniques to reduce relapse after exposure therapy: Applications of studies of experimental extinction. Associative Learning and Conditioning Theory: Human and Non-human Applications 2011, 79-103. Oxford University Press, Oxford, UK. T.R. Schachtman, S. Reilly (Eds.).
53. Lattal M.A. Effects of ethanol on encoding, consolidation, and expression of extinction following contextual fear conditioning. Behav. Neurosci. 2007, 121:1280-1292.
54. Ledgerwood L., Richardson R., Cranney J. Effects of d-cycloserine on extinction of conditioned freezing. Behav. Neurosci. 2003, 117:341-349.
55. Leitenberg H., Rawson R.A., Bath K. Reinforcement of competing behavior during extinction. Science 1970, 169:301-303.
56. Leitenberg H., Rawson R.A., Mulick J.A. Extinction and reinforcement of alternative behavior. J. Compar. Physiol. Psychol. 1975, 88:640-652.
57. Lieving G.A., Lattal K.A. Recency, repeatability, and reinforcement retrenchment: an experimental analysis of resurgence. J. Exp. Anal. Behav. 2003, 80:217-233.
58. Mackintosh N.J. The Psychology of Animal Learning 1974, Academic Press, San Diego, CA.
59. Myers K.M., Davis M. Mechanisms of fear extinction. Mol. Psychiatry 2007, 12:120-150.
60. Nakajima S., Tanaka S., Urushihara K., Imada H. Renewal of extinguished lever-press responses upon return to the training context. Learn. Motiv. 2000, 31:416-431.
61. Napier R.M., Macrae M., Kehoe E.J. Rapid reacquisition in conditioning of the rabbit's nictitating membrane response. J. Exp. Psychol.: Anim. Behav. Process. 1991, 18:182-192.
62. Neumann D.L., Lipp O.V., Cory S.E. Conducting extinction in multiple contexts does not necessarily attenuate the renewal of shock expectancy in a fear-conditioning procedure with humans. Behav. Res. Ther. 2007, 45:385-394.
63. Nevin J.A., Grace R.C. Behavioral momentum and the law of effect. Behav. Brain Sci. 2000, 23:73-90.
64. Nic Dhonnchadha B.A., Szalay J.J., Achat-Mendes C., Platt D.M., Otto M.W., Spealman R.D., Kantak K.M. d-Cycloserine deters reacquisition of cocaine self-administration by augmenting extinction learning. Neuropsychopharmacology 2010, 35:357-367.
65. Podlesnik C.A., Jimenez-Gomez C., Shahan T.A. Resurgence of alcohol seeking produced by discounting non-drug reinforcement as an animal model of drug relapse. Behav. Pharmacol. 2006, 17:369-374.
66. Podlesnik C.A., Shahan T.A. Behavioral momentum and relapse of extinguished operant responding. Learn. Behav. 2009, 37:357-364.
67. 1 receptors. Neuropsychopharmacology 2011, 36:1015-1020.
68. Rawson R.A., Leitenberg H., Mulick J.A., Lefebvre M.F. Recovery of extinction responding in rats following discontinuation of reinforcement of alternative behavior: a test of two explanations. Anim. Learn. Behav. 1977, 5:415-420.
69. Reid R.L. The role of the reinforcer as stimulus. Br. J. Psychol. 1958, 49:202-209.
70. Rescorla R.A. Extinction of facilitation. J. Exp. Psychol.: Anim. Behav. Process. 1986, 12:16-24.
71. Rescorla R.A., Heth C.D. Reinstatement of fear to an extinguished conditioned stimulus. J. Exp. Psychol.: Anim. Behav. Process. 1975, 1:88-96.
72. Rescorla R.A., Skucy J.C. Effect of response-independent reinforcers during extinction. J. Compar. Physiol. Psychol. 1969, 67:381-389.
73. Ricker S.T., Bouton M.E. Reacquisition following extinction in appetitive conditioning. Learn. Behav. 1996, 24:423-436.
74. Shahan T.A., Sweeney M.M. A model of resurgence based on behavioral momentum theory. J. Exp. Anal. Behav. 2011, 95:91-108.
75. Shaw D., Norwood K., Sharp K., Quigley L., McGovern S.F., Leslie J.C. Facilitation of extinction of operant behaviour in mice by d-cycloserine. Psychopharmacology 2009, 202:397-402.
76. Staddon J.E.R. Schedule-induced behavior. Handbook of Operant Behavior 1977, 125-152. Prentice-Hall, Englewood Cliffs, NJ. W.K. Honig, J.E.R. Staddon (Eds.).
77. Staddon J.E.R., Simmelhag V.L. The superstition experiment: a reexamination of its implications for the principles of adaptive behavior. Psychol. Rev. 1971, 78:3-43.
78. Tamai N., Nakajima S. Renewal of formerly conditioned fear in rats after extensive extinction training. Int. J. Compar. Psychol. 2000, 13:137-147.
79. Thanos P.K., Bermeo C., Wang G.J., Volkow N.D. d-Cycloserine accelerates the extinction of cocaine-induced conditioned place preference in C57BL/c mice. Behav. Brain Res. 2009, 199:345-349.
80. Thanos P.K., Bermeo C., Wang G.J., Volkow N.D. d-Cycloserine facilitates extinction of cocaine self-administration in rats. Synapse 2011, 65:938-944.
81. Thomas B.L., Vurbic D., Novak C. Extensive extinction in multiple contexts eliminates the renewal of conditioned fear in rats. Learn. Motiv. 2009, 40:147-159.
82. Todd T.P., Winterbauer N.E., Bouton M.E. Contextual control of appetite: renewal of inhibited food-seeking behavior in sated rats after extinction. Appetite 2012, 58:484-489.
83. Todd, T.P., Winterbauer, N.E., Bouton, M.E., in press. Effects of amount of acquisition and contextual generalization on the renewal of instrumental behavior after extinction. Learn. Behav.
84. Vengeliene V., Kiefer F., Spanagel R. d-Cycloserine facilitates extinction of conditioned alcohol-seeking behaviour in rats. Alcohol. 2008, 43:626-629.
85. Volpp K.G., John L.K., Troxel A.B., Norton L., Fassbender J., Loewenstein G. Financial incentive-based approaches for weight loss: a randomized trial. J. Am. Med. Assoc. 2008, 300:2631-2637.
86. Vurbic D., Gold B., Bouton M.E. Effects of d-cycloserine on the extinction of appetitive operant learning. Behav. Neurosci. 2011, 125:551-559.
87. Walker D.L., Ressler K.J., Lu K.-T., Davis M. Facilitation of conditioned fear extinction by systemic administration or intra-amygdala infusions of d-cycloserine as assessed with fear-potentiated startle in rats. J. Neurosci. 2002, 15:2343-2351.
88. Wilcocks A.N., McNally G.P. The role of context in re-acquisition of extinguished alcoholic beer-seeking. Behav. Neurosci. 2011, 125:541-550.
89. Winterbauer N.E., Bouton M.E. Mechanisms of resurgence of an extinguished operant response. J. Exp. Psychol.: Anim. Behav. Process. 2010, 36:343-353.
90. Winterbauer N.E., Bouton M.E. Mechanisms of resurgence II: Response-contingent reinforcers can reinstate a second extinguished behavior. Learn. Motiv. 2011, 42:154-164.
91. Winterbauer, N.E., Bouton, M.E., in press. Effects of thinning the rate at which the alternative behavior is reinforced on resurgence of an extinguished instrumental response. J. Exp. Psychol.: Anim. Behav. Process.
92. Winterbauer, N.E., Lucke, S., Bouton, M.E., in press. Some factors modulating the strength of resurgence after extinction of an instrumental behavior. Learn. Motiv.
93. Woods A.M., Bouton M.E. d-Cycloserine facilitates extinction but does not eliminate renewal of the conditioned emotional response. Behav. Neurosci. 2006, 120:1159-1162.
94. Woods A.M., Bouton M.E. Occasional reinforced responses during extinction can slow the rate of reacquisition of an operant response. Learn. Motiv. 2007, 38:56-74.
95. Zironi I., Burattini C., Aircardi G., Janak P.H. Context is a trigger for relapse to alcohol. Behav. Brain Res. 2006, 167:150-155.