A fundamental role for context in instrumental learning and extinction

Behavioural Processes

Volumn 104, Issue , 2014, Pages 91-98

  Bouton, Mark E ^a   Todd, Travis P ^a  

^a UNIVERSITY OF VERMONT   (United States)

Author keywords

Context; Extinction; Instrumental learning; Operant learning

Indexed keywords

HIERARCHICAL SYSTEM; LEARNING; LITERATURE REVIEW; RESEARCH WORK;

AVERSION; BEHAVIOR CHANGE; DISCRIMINATIVE STIMULUS; ENVIRONMENTAL CHANGE; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; NONHUMAN; REINFORCEMENT; REVIEW; SPECIES EXTINCTION; STRENGTH; TRAINING;

ANIMALIA;

EID: 84899973002     PISSN: 03766357     EISSN: 18728308     Source Type: Journal    
DOI: 10.1016/j.beproc.2014.02.012     Document Type: Review

References (61)

1. Context and Learning 1985, Lawrence Erlbaum Associates, Inc., Hillsdale, NJ. P.D. Balsam, A. Tomie (Eds.).
2. Baker A.G., Steinwald H., Bouton M.E. Contextual conditioning and reinstatement of extinguished instrumental responding. The Quarterly Journal of Experimental Psychology 1991, 43B:199-218.
3. Bolles R.C. Ethological learning theory. Theories of Learning: A Comparative Approach 1980, 178-207. F.E. Peacock Publishers, Itasca, IL. G.M. Gazda, R.J. Corsini (Eds.).
4. Bouton M.E. Context, ambiguity, and unlearning: sources of relapse after behavioral extinction. Biological Psychiatry 2002, 52:976-986.
5. Bouton M.E. Context and behavioral processes in extinction. Learning & Memory 2004, 11:485-494.
6. Bouton M.E., Bolles R.C. Contextual control of the extinction of conditioned fear. Learning and Motivation 1979, 10:445-466.
7. Bouton M.E., Frohardt R.J., Sunsay C., Waddell J., Morris R.W. Contextual control of inhibition with reinforcement: adaptation and timing mechanisms. Journal of Experimental Psychology: Animal Behavior Processes 2008, 34:223-236.
8. Bouton M.E., King D.A. Contextual control of the extinction of conditioned fear: tests for the associative value of the context. Journal of Experimental Psychology: Animal Behavior Processes 1983, 9:248-265.
9. Bouton M.E., Peck C.A. Context effects on conditioning, extinction, and reinstatement in an appetitive conditioning preparation. Animal Learning & Behavior 1989, 17:188-198.
10. Bouton M.E., Nelson J.B. Context-specificity of target versus feature inhibition in a feature negative discrimination. Journal of Experimental Psychology: Animal Behavior Processes 1994, 20:51-65.
11. Bouton M.E., Nelson J.B. Mechanisms of feature-positive and feature-negative discrimination learning in an appetitive conditioning paradigm. Occasion Setting: Associative Learning and Cognition in Animals 1998, 69-112. American Psychological Association, Washington, DC. N. Schmajuk, P.C. Holland (Eds.).
12. Bouton M.E., Ricker S.T. Renewal of extinguished responding in a second context. Animal Learning & Behavior 1994, 22:317-324.
13. Bouton M.E., Swartzentruber D. Analysis of the associative and occasion-setting properties of contexts participating in Pavlovian discriminations. Journal of Experimental Psychology: Animal Behavior Processes 1986, 12:333-350.
14. Bouton M.E., Swartzentruber D. Slow reacquisition following extinction: context, encoding, and retrieval mechanisms. Journal of Experimental Psychology: Animal Behavior Processes 1989, 15:43-53.
15. Bouton M.E., Todd T.P., León S.P. Contextual control of a discriminated operant behavior. Journal of Experimental Psychology: Animal Learning and Cognition 2014, 40:92-105.
16. Bouton M.E., Todd T.P., Vurbic D., Winterbauer N.E. Renewal after the extinction of free operant behavior. Learning & Behavior 2011, 39:57-67.
17. Bossert J.M., Liu S.Y., Lu L., Shaham Y. A role of ventral tegmental area glutamate in contextual cue-induced relapse to heroin seeking. The Journal of Neuroscience 2004, 24:10726-10730.
18. Chaudri N., Sahuque L.L., Janak P.H. Ethanol seeking triggered by environmental context is attenuated by blocking dopamine D1 receptors in the nucleus accumbens core and shell in rats. Psychopharmacology 2009, 207:303-314.
19. Colwill R.M., Rescorla R.A. Evidence for the hierarchical structure of instrumental learning. Animal Learning & Behavior 1990, 18:71-82.
20. Crombag H.S., Shaham Y. Renewal of drug seeking by contextual cues after prolonged extinction in rats. Behavioral Neuroscience 2002, 116:169-173.
21. Dickinson A. Instrumental conditioning. Animal Cognition and Learning 1994, 4-79. Academic Press, London. N.J. Mackintosh (Ed.).
22. Dickinson A., Nicholas D.J., Adams C.D. The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. Quarterly Journal of Experimental Psychology 1983, 35B:35-51.
23. Gibson J.J. The theory of affordances. Perceiving, Acting, and Knowing 1977, 67-82. Erlbaum, Hillsdale, NJ. R. Shaw, J. Bransford (Eds.).
24. Hall G., Honey R. Contextual effects in conditioning, latent inhibition, and habituation: associative and retrieval functions of contextual cues. Journal of Experiment Psychology: Animal Behavior Processes 1989, 15:232-241.
25. Hamlin A.S., Clemens K.J., McNally G.P. Renewal of extinguished cocaine-seeking. Neuroscience 2008, 151:659-670.
26. Hamlin A.S., Newby J., McNally G.P. The neural correlates and role of D1 dopamine receptors in renewal of extinguished alcohol-seeking. Neuroscience 2007, 146:525-536.
27. Harris J.A., Jones M.L., Bailey G.K., Westbrook R.F. Contextual control over conditioned responding in an extinction paradigm. Journal of Experimental Psychology: Animal Behavior Processes 2000, 26:174-185.
28. Holland P.C. Occasion setting in Pavlovian conditioning. The Psychology of Learning and Motivation 1992, vol. 28:69-125. Academic Press, New York.
29. Holland P.C., Coldwell S.E. Transfer of inhibitory stimulus control in operant feature-negative discrimination. Learning and Motivation 1993, 24:345-375.
30. Laborda M.A., Witnauer J.E., Miller R.R. Contrasting AAC and ABC renewal: the role of context associations. Learning & Behavior 2011, 39:46-56.
31. Lovibond P.F., Preston G.C., Mackintosh N.J. Context specificity of conditioning, extinction, and latent inhibition. Journal of Experimental Psychology: Animal Behavior Processes 1984, 10:360-375.
32. Marchant N.J., Li X., Shaham Y. Recent developments in animal models of drug relapse. Current Opinion in Neurobiology 2014, 23:675-683.
33. Morell J.R., Holland P.C. Summation and transfer of negative occasion setting. Animal Learning & Behavior 1993, 21:145-153.
34. Nakajima S., Tanaka S., Urushihara K., Imada H. Renewal of extinguished lever-press responses upon return to the training context. Learning and Motivation 2000, 31:416-431.
35. Nelson J.B. Context specificity of excitation and inhibition in ambiguous stimuli. Learning and Motivation 2002, 33:284-310.
36. Pearce J.M. Similarity and discrimination: a selective review and a connectionist model. Psychological Review 1994, 101:587-607.
37. Pearce J.M., Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review 1980, 87:532-552.
38. Polack C.W., Laborda M.A., Miller R.R. Extinction context as a conditioned inhibitor. Learning & Behavior 2011, 40:24-33.
39. Rescorla R.A. Inhibitory associations between S and R in extinction. Animal Learning & Behavior 1993, 21:327-336.
40. Rescorla R.A. Response inhibition in extinction. The Quarterly Journal of Experimental Psychology 1997, 50B:238-252.
41. Rescorla R.A. Within subject renewal in sign tracking. The Quarterly Journal of Experimental Psychology 2008, 61:1793-1802.
42. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory 1972, 64-99. Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
43. Rosas J.M., Bouton M.E. Context change and retention interval can have additive, rather than interactive, effects after taste aversion extinction. Psychonomic Bulletin & Review 1998, 5:79-83.
44. Rosas J.M., Callejas-Aguilera J.E. Context switch effects on acquisition and extinction in human predictive learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 2006, 32:461-474.
45. Rosas J.M., Todd T.P., Bouton M.E. Context change and associative learning. Wiley Interdisciplinary Reviews: Cognitive Science 2013, 4:237-244.
46. Spear N.E. The Processing of Memories: Forgetting and Retention 1978, Erlbaum, Hillsdale, NJ.
47. Swartzentruber D., Rescorla R.A. Modulation of trained and extinguished stimuli by facilitators and inhibitors. Animal Learning & Behavior 1993, 22:309-316.
48. Tamai N., Nakajima S. Renewal of formerly conditioned fear in rats after extensive extinction training. International Journal of Comparative Psychology 2000, 13:137-146.
49. Thomas B.L., Larsen N., Ayres J.J.B. Role of context similarity in ABA, ABC, and AAB renewal paradigms: implications for theories of renewal and for treating human phobias. Learning and Motivation 2003, 34:410-436.
50. Thrailkill, E., Bouton, M.E., in preparation. Contextual control of instrumental actions and habits. 2014 (in preparation).
51. Todd T.P. Mechanisms of renewal after the extinction of instrumental behavior. Journal of Experimental Psychology: Animal Behavior Processes 2013, 39:193-207.
52. Todd T.P., Vurbic D., Bouton M.E. Behavioral and neurobiological mechanisms of extinction in Pavlovian and instrumental learning. Neurobiology of Learning and Memory 2014, 108:52-64.
53. Todd T.P., Vurbic D., Bouton M.E. Mechanisms of renewal after the extinction of discriminated operant behavior. Journal of Experimental Psychology: Animal Learning and Cognition 2014, (in press).
54. Todd T.P., Winterbauer N.E., Bouton M.E. Contextual control of appetite: renewal of inhibited food-seeking behavior in sated rats after extinction. Appetite 2012, 58:484-489.
55. Todd T.P., Winterbauer N.E., Bouton M.E. Effects of the amount of acquisition and contextual generalization on the renewal of instrumental behavior after extinction. Learning & Behavior 2012, 40:145-157.
56. Trask, S., Bouton, M.E., in preparation. Contextual control of operant behavior: evidence for hierarchical associations in instrumental learning. 2014 (in preparation).
57. Tulving E., Thomson D.M. Encoding specificity and retrieval processes in episodic memory. Psychological Review 1973, 80:352-373.
58. Wagner A.R. Expectancies and the priming of STM. Cognitive Processes in Animal Behavior 1978, 177-209. Lawrence Erlbaum Associates, Inc., Hillsdale, NJ. S.H. Hulse, H. Fowler, W.K. Honig (Eds.).
59. Wagner A.R. Context-sensitive elemental theory. Quarterly Journal of Experimental Psychology B: Comparative and Physiological Psychology 2003, 56B:7-29.
60. Welker R.L., McAuley K. Reductions in resistance to extinction and spontaneous recovery as a function of changes in transportational and contextual stimuli. Animal Learning & Behavior 1978, 6:451-457.
61. Zironi I., Burattini C., Aircardi G., Janak P.H. Context is a trigger for relapse to alcohol. Behavioural Brain Research 2006, 167:150-155.