The functions of contexts in associative learning

Behavioural Processes

Volumn 104, Issue , 2014, Pages 2-12

  Urcelay, Gonzalo P ^a   Miller, Ralph R ^b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b BINGHAMTON UNIVERSITY   (United States)

Author keywords

Context; Contiguity; Instrumental learning; Occasion setter; Pavlovian fear conditioning; Trial spacing

Indexed keywords

AMBIGUITY; AMYGDALOID NUCLEUS; ASSERTIVENESS; ASSOCIATION; CONDITIONED REFLEX; DISCRIMINATIVE STIMULUS; DOUBLE DISSOCIATION; FACTORIAL DESIGN; FEAR; HUMAN; INSTRUMENTAL CONDITIONING; LATENT INHIBITION; NONHUMAN; PHASE 1 CLINICAL TRIAL (TOPIC); REINFORCEMENT; REVIEW; SPATIAL LEARNING; STATE DEPENDENT LEARNING; TASTE AVERSION; ANIMAL; CONDITIONING; ENVIRONMENT; LEARNING; PHYSIOLOGY;

ANIMALS; ASSOCIATION LEARNING; CONDITIONING (PSYCHOLOGY); CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; CUES; ENVIRONMENT; HUMANS;

EID: 84899905950     PISSN: 03766357     EISSN: 18728308     Source Type: Journal    
DOI: 10.1016/j.beproc.2014.02.008     Document Type: Review

References (117)

1. Amundson J.C., Miller R.R. Associative interference in Pavlovian conditioning: a function of similarity between the interfering and target associative structures. Quarterly Journal of Experimental Psychology 2008, 61:1340-1355.
2. Amundson J.C., Escobar M., Miller R.R. Proactive interference in first-order Pavlovian conditioning. Journal of Experimental Psychology: Animal Behavioral Processes 2003, 29:311-322.
3. Arnold K.M., McDermott K.B. Free recall enhances subsequent learning. Psychonomic Bulletin and Review 2013, 20:507-513.
4. Balaz M.A., Capra S., Hartl P., Miller R.R. Contextual potentiation of acquired behavior after devaluing direct context-US associations. Learning and Motivation 1981, 12:383-397.
5. Balaz M.A., Capra S., Kasprow W.J., Miller R.R. Latent inhibition of the conditioning context: further evidence of contextual potentiation of retrieval in the absence of context-US associations. Animal Learning and Behavior 1982, 10:242-248.
6. Balsam P. Relative time in trace conditioning. Annals of the New York Academy of Sciences 1984, 423:211-227.
7. Balsam P.D. The functions of context in learning and performance. Context and Learning 1985, 1-21. Erlbaum, Hillsdale, NJ. P.D. Balsam, A. Tomie (Eds.).
8. Barela P.B. Theoretical mechanisms underlying the trial-spacing effect in Pavlovian fear conditioning. Journal of Experimental Psychology: Animal Behavior Processes 1999, 25:177-193.
9. Barnet R.C., Grahame N.J., Miller R.R. Local context and the comparator hypothesis. Animal Learning and Behavior 1993, 21:1-13.
10. Barnet R.C., Grahame N.J., Miller R.R. Local time horizons in Pavlovian learning. Journal of Experimental Psychology: Animal Behavior Processes 1993, 19:215-230.
11. Barnet R.C., Grahame N.J., Miller R.R. Trial spacing effects in Pavlovian conditioning: a role for local context. Animal Learning and Behavior 1995, 23:340-348.
12. Batsell W.R., Wakefield E., Ulrey L., Reimink K., Rowe S.L., Dexheimer S. CS-US interval determines the transition from overshadowing to potentiation with flavor compounds. Learning and Behavior 2012, 40:180-194.
13. Bouton M.E. Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. Psychological Bulletin 1993, 114:80-99.
14. Bouton M.E. Context and behavioral processes in extinction. Learning & Memory 2004, 11:485-494.
15. Bouton M.E. The multiple forms of context in associative learning. The Mind in Context 2010, 233-258. Guilford, New York. L. Feldman Barrett, B. Mesquita, E. Smith (Eds.).
16. Bouton M.E., Bolles R.C. Role of conditioned contextual stimuli in reinstatement of extinguished fear. Journal of Experimental Psychology: Animal Behavior Processes 1979, 5:368-378.
17. Bouton M., Frohardt R., Sunsay C., Waddell J., Morris R. Contextual control of inhibition with reinforcement: adaptation and timing mechanisms. Journal of Experimental Psychology: Animal Behavior Processes 2008, 34:223-236.
18. Bouton M.E., Swartzentruber D. Analysis of the associative and occasion-setting properties of contexts participating in a Pavlovian discrimination. Journal of Experimental Psychology: Animal Behavior Processes 1986, 12:333-350.
19. Bower G.H. Mood and memory. American Psychologist 1981, 36:129-148.
20. Callejas-Aguilera J.E., Rosas J.M. Ambiguity and context processing in human predictive learning. Journal of Experimental Psychology: Animal Behavior Processes 2010, 36:482-494.
21. Cheng K. A purely geometric module in the rat's spatial representation. Cognition 1986, 23:149-178.
22. Cheng K. Whither geometry? Troubles of the geometric module. Trends in Cognitive Sciences 2008, 12:355-361.
23. Cheung T.H., Cardinal R.N. Hippocampal lesions facilitate instrumental learning with delayed reinforcement but induce impulsive choice in rats. BMC Neuroscience 2005, 6:36.
24. Clarke J.C., Westbrook R.F., Irwin J.J. Potentiation instead of overshadowing in the pigeon. Behavioral and Neural Biology 1979, 25:18-29.
25. Cole K., VanTilburg D., Burch-Vernon A., Riccio D. The importance of context in the US preexposure effect in CTA: novel versus latently inhibited contextual stimuli. Learning and Motivation 1996, 27:362-374.
26. Detert J.A., Kampa N.D., Moyer J.R. Differential effects of training intertrial interval on acquisition of trace and long-delay fear conditioning in rats. Behavioral Neuroscience 2008, 122:1318-1327.
27. Devenport L.D. Spontaneous recovery without interference: why remembering is adaptive. Animal Learning and Behavior 1998, 26:172-181.
28. Dickinson A., Charnock D.J. Contingency effects with maintained instrumental reinforcement. Quarterly Journal of Experimental Psychology 1985, 37B:397-416.
29. Dickinson A.A., Watt A.A., Griffiths W.J. Free-operant acquisition with delayed reinforcement. Quarterly Journal of Experimental Psychology 1992, 45B:241-258.
30. Doeller C.F., Burgess N. Distinct error-correcting and incidental learning of location relative to landmarks and boundaries. Proceedings of the National Academy of Sciences of the United States of America 2008, 105:5909-5914.
31. Doeller C.F., King J.A., Burgess N. Parallel striatal and hippocampal systems for landmarks and boundaries in spatial memory. Proceedings of the National Academy of Sciences of the United States of America 2008, 105:5915-5920.
32. Durlach P.J. Effect of signaling intertrial USs in autoshaping. Journal of Experimental Psychology: Animal Behavior Processes 1983, 9:374-389.
33. Fanselow M.S. Signaled shock-free periods and preference for signaled shock. Journal of Experimental Psychology: Animal Behavior Processes 1980, 6:65-80.
34. Fanselow M.S. From contextual fear to a dynamic view of memory systems. Trends in Cognitive Sciences 2010, 14:7-15.
35. Galef B.G., Osborne B. Novel taste facilitation of the association of visual cues with toxicosis in rats. Journal of Comparative and Physiological Psychology 1978, 92:907-916.
36. Gallistel C.R., Gibbon J. Time, rate and conditioning. Psychological Review 2000, 107:289-344.
37. Gallistel C.R. The Organization of Learning 1990, MIT Press.
38. Garcia J., Lasiter P.S., Bermudez-Rattoni F., Deems D.A. A general theory of aversion learning. Annals of the New York Academy of Sciences 1985, 443:8-21.
39. Gibbon J., Balsam P. Spreading association in time. Autoshaping and Conditioning Theory 1981, 219-253. Academic Press, New York. C.M. Locurto, H.S. Terrace, J. Gibbon (Eds.).
40. Godden D., Baddeley A. Context-dependent memory in two natural environments: on land and underwater. British Journal of Psychology 1975, 66:325-331.
41. Hall G., Honey R.C. Context-specific conditioning in the conditioned-emotional-response procedure. Journal of Experimental Psychology: Animal Behavior Processes 1990, 16:271-278.
42. Harris J.A. Elemental representations of stimuli in associative learning. Psychological Review 2006, 113:584-605.
43. Holland P.C. Occasion setting in Pavlovian conditioning. The Psychology of Learning and Motivation 1992, vol. 28:69-125. Academic Press, San Diego, CA.
44. Holland P.C., Bouton M.E. Hippocampus and context in classical conditioning. Current Opinion in Neurobiology 1999, 9:195-202.
45. Kamin L. Apparent adaptation effects in the acquisition of a conditioned emotional response. Canadian Journal of Psychology 1961, 15:176-188.
46. Kamin L.J. Attention-like processes in classical conditioning. Miami Symposium on the Prediction of Behavior: Aversive Stimulation 1968, 9-31. University of Miami Press, Miami, FL. M.R. Jones (Ed.).
47. Kaye H.H., Mackintosh N.J. A change of context can enhance performance of an aversive but not of an appetitive conditioned response. Quarterly Journal of Experimental Psychology 1990, 42B:113-134.
48. Laborda M.A., Miller R.R. Reactivated memories compete for expression after Pavlovian extinction. Behavioural Processes 2012, 90:20-27.
49. Le Pelley M.E. The role of associative history in models of associative learning: a selective review and a hybrid model. Quarterly Journal of Experimental Psychology 2004, 57B:193-243.
50. Lubow R.E., Moore A.U. Latent inhibition: the effect of nonreinforced preexposure to the conditioned stimulus. Journal of Comparative and Physiological Psychology 1959, 52:415-419.
51. Mackintosh N.J. A theory of attention: variations in the associability of stimuli with reinforcement. Psychological Review 1975, 82:276-298.
52. Marchand A.R., Luck D., Di Scala G. Trace fear conditioning: a role for context?. Archives Italienes de Biologie 2004, 142:251-263.
53. Maren S., Phan K.L., Liberzon I. The contextual brain: implications for fear conditioning, extinction and psychopathology. Nature Review of Neuroscience 2013, 14:417-428.
54. Marlin N.A. Contextual associations in trace conditioning. Animal Learning and Behavior 1981, 9:519-523.
55. Matzel L.D., Brown A., Miller R.R. Associative effects of US preexposure: modulation of conditioned responding by an excitatory training context. Journal of Experimental Psychology: Animal Behavior Processes 1987, 13:65-72.
56. McClelland J.L., Rumelhart D.E. Distributed memory and the representation of general and specific information. Journal of Experimental Psychology: General 1985, 114:159-188.
57. McLaren I.L., Mackintosh N.J. An elemental model of associative learning: I. Latent inhibition and perceptual learning. Animal Learning and Behavior 2000, 28:211-246.
58. Miguez G., Cham H.X., Miller R.R. Spontaneous recovery and ABC renewal from retroactive cue interference. Learning and Behavior 2012, 40:42-53.
59. Miguez G., Witnauer J.E., Laborda M.A., Miller R.R. Trial spacing during extinction: the role of context-US associations. Journal of Experimental Psychology: Animal Learning and Cognition 2014, 40:81-91.
60. Miguez G., Witnauer J.E., Miller R.R. The role of contextual associations in producing the partial reinforcement acquisition deficit. Journal of Experimental Psychology: Animal Behavior Processes 2012, 38:40-51.
61. Millenson J., Hendry D. Quantification of response suppression in conditioned anxiety training. Canadian Journal of Psychology 1967, 21:242-252.
62. Miller R.R. Effects of environmental complexity on amnesia induced by electroconvulsive shock in the rat. Journal of Comparative and Physiological Psychology 1970, 71:267-275.
63. Miller R.R. Effects of intertrial reinstatement of training stimuli on complex maze learning in rats: evidence that 'acquisition' curves reflect more than acquisition. Journal of Experimental Psychology: Animal Behavior Processes 1982, 8:86-109.
64. Miller R.R., Escobar M. Associative interference between cues and between outcomes presented together and presented apart: an integration. Behavioural Processes 2002, 57:163-185.
65. Miller R.R., Matute H. Biological significance in forward and backward blocking: resolution of a discrepancy between animal conditioning and human causal judgment. Journal of Experimental Psychology: General 1996, 125:370-386.
66. Miller R.R., Matzel L.D. The comparator hypothesis: a response rule for the expression of associations. The Psychology of Learning and Motivation 1988, vol. 22:51-92. Academic Press, Orlando, FL.
67. Miller R.R., Schachtman T.R. The several roles of context at the time of retrieval. Context and Learning 1985, 167-194. Erlbaum, Hillsdale, NJ. P.D. Balsam, A. Tomie (Eds.).
68. Miller N.Y., Shettleworth S.J. Learning about environmental geometry: an associative model. Journal of Experimental Psychology: Animal Behavior Processes 2007, 33:191-212.
69. Molet M., Urcelay G.P., Miguez G., Miller R.R. Using context to resolve temporal ambiguity. Journal of Experimental Psychology: Animal Behavior Processes 2010, 36:126-136.
70. Morris R.M. Spatial localization does not require the presence of local cues. Learning and Motivation 1981, 12:239-260.
71. Moser M., Moser E. Functional differentiation in the hippocampus. Hippocampus 1998, 8:608-619.
72. Oberling P., Gunther L., Miller R.R. Latent inhibition and learned irrelevance of occasion setting. Learning and Motivation 1999, 30:157-182.
73. Odling-Smee F.J. The overshadowing of background stimuli: some effects of varying amounts of training and UCS intensity. Quarterly Journal of Experimental Psychology 1978, 30:737-746.
74. Orinstein A.J., Urcelay G.P., Miller R.R. Expanding the intertrial interval during extinction: response cessation and recovery. Behavior Therapy 2010, 41(1):14-29.
75. Overton D.A. State dependent or dissociated learning produced with pentobarbital. Journal of Physiological and Comparative Psychology 1964, 57:3-12.
76. Overton D.A. Contextual stimulus effects of drugs and internal states. Context and Learning 1985, 357-384. Erlbaum, Hillsdale, NJ. P.D. Balsam, A. Tomie (Eds.).
77. O'Keefe J., Nadel L. The Hippocampus as a Cognitive Map 1978, Oxford University Press.
78. Pavlov, I.P. (1927) Conditioned Reflexes. (G.V. Anrep, Ed. & Trans.) Oxford University Press: London.
79. Pearce J.M. A model for stimulus generalization in Pavlovian conditioning. Psychological Review 1987, 94:61-73.
80. Pearce J.M., Graham M., Good M.A., Jones P.M., McGregor A. Potentiation, overshadowing, and blocking of spatial learning based on the shape of the environment. Journal of Experimental Psychology: Animal Behavior Processes 2006, 32:201-214.
81. Pearce J.M., Hall G. The influence of context-reinforcer associations on instrumental performance. Animal Learning and Behavior 1979, 7:504-508.
82. Pearce J.M., Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review 1980, 87:532-552.
83. Pickens C.L., Golden S.A., Adams-Deutsch T., Nair S.G., Shaham Y. Long-lasting incubation of conditioned fear in rats. Biological Psychiatry 2009, 65:881-886.
84. Polack C.W., Laborda M.A., Miller R.R. Extinction context as a conditioned inhibitor. Learning and Behavior 2012, 40:24-33.
85. Polack C.W., Laborda M.A., Miller R.R. On the differences in degree of renewal produced by the different renewal designs. Behavioural Processes 2013, 99:112-120.
86. Postman L., Stark K., Fraser J. Temporal changes in interference. Journal of Verbal Learning and Verbal Behavior 1968, 7:672-694.
87. Randich A., LoLordo V.M. Associative and nonassociative theories of the UCS preexposure phenomenon: implications for Pavlovian conditioning. Psychological Bulletin 1979, 86:523-548.
88. Randich A., Ross R. Mechanisms of blocking by contextual stimuli. Learning and Motivation 1984, 15:106-117.
89. Reed P., Reilly S. Context extinction following conditioning with delayed reward enhances subsequent instrumental responding. Journal of Experimental Psychology: Animal Behavior Processes 1990, 16:48-55.
90. Rescorla R.A. Probability of shock in the presence and absence of CS in fear conditioning. Journal of Comparative and Physiological Psychology 1968, 66:1-5.
91. Rescorla R.A. Pavlovian conditioned inhibition. Psychological Bulletin 1969, 72:77-94.
92. Rescorla R.A. Behavioral studies of Pavlovian conditioning. Annual Review of Neuroscience 1988, 11:329-352.
93. Rescorla R.A. Within-subject renewal in sign tracking. Quarterly Journal of Experimental Psychology 2008, 61:1793-1802.
94. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory 1972, 64-99. Appleton Century Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
95. Rosas J.M., Aguilera J., Álvarez M., Abad M. Revision of retrieval theory of forgetting: what does make information context-specific?. International Journal of Psychology and Psychological Therapy 2006, 6:147-166.
96. Rudy J.W. Context representations, context functions, and the parahippocampal-hippocampal system. Learning and Memory 2009, 16:573-585.
97. Selden N.R., Everitt B.J., Jarrard L.E., Robbins T.W. Complementary roles for the amygdala and hippocampus in aversive conditioning to explicit and contextual cues. Neuroscience 1991, 42:335-350.
98. Shanks D.R., Dickinson A. Instrumental judgment and performance under variations in action-outcome contingency and contiguity. Memory & Cognition 1991, 19:353-360.
99. Sissons H.T., Urcelay G.P., Miller R.R. Overshadowing and CS duration: counteraction and a reexamination of the role of within-compound associations in cue competition. Learning and Behavior 2009, 37:254-268.
100. Spear N.E. Retrieval of memories in animals. Psychological Review 1973, 80:163-194.
101. Stout S.C., Miller R.R. Sometimes-competing retrieval (SOCR): a formalization of the comparator hypothesis. Psychological Review 2007, 114:759-783.
102. Sutton R.S. Learning to predict by the methods of temporal differences. Machine Learning 1988, 3:9-44.
103. Tolman E.C., Honzik C.H. Insight in Rats 1930, University of California Publications in Psychology.
104. Tomie A. Interference with autoshaping by prior context conditioning. Journal of Experimental Psychology: Animal Behavior Processes 1976, 2:323-334.
105. Tulving E., Thomson D.M. Encoding specificity and retrieval processes in episodic memory. Psychological Review 1973, 80:352-373.
106. Underwood B.J. Attributes of memory. Psychological Review 1969, 76:559-573.
107. Urcelay G.P. Exposure techniques: the role of extinction learning. Exposure Therapy: Rethinking the Model-Refining the Method 2012, 35-63. Springer Science/Business Media, New York, NY, USA. 10.1007/978-1-4614-3342-2_4. P. Neudeck, H. Wittchen (Eds.).
108. Urcelay G.P., Miller R.R. Counteraction between overshadowing and degraded contingency treatments: support for the extended comparator hypothesis. Journal of Experimental Psychology: Animal Behavior Processes 2006, 32:21-32.
109. Urcelay G.P., Miller R.R. Retrieval from memory. Learning Theory and Behavior. Vol. 1: Learning and Memory - A Comprehensive Reference 2008, 53-74. Byrne, J.H. (Ed-in-Chief), Elsevier, Oxford, UK. R. Menzel (Ed.).
110. Urcelay G.P., Miller R.R. Potentiation and overshadowing in Pavlovian fear conditioning. Journal of Experimental Psychology: Animal Behavior Processes 2009, 35:340-356.
111. Urcelay G.P., Miller R.R. Two roles for the context in Pavlovian fear conditioning. Journal of Experimental Psychology: Animal Behavior Processes 2010, 36:268-280.
112. Urcelay G.P., Witnauer J.E., Miller R.R. The dual role of the context in postpeak performance decrements resulting from extended training. Learning and Behavior 2012, 40:476-493.
113. Urushihara K., Wheeler D.S., Miller R.R. Outcome pre- and postexposure effects: retention interval interacts with primacy and recency. Journal of Experimental Psychology: Animal Behavior Processes 2004, 30:283-298.
114. Wagner A.R. SOP: a model of automatic memory processing in animal behavior. Information Processing in Animals: Memory Mechanisms 1981, 5-47. Erlbaum, Hillsdale, NJ. N.E. Spear, R.R. Miller (Eds.).
115. Wiltgen B., Silva A. Memory for context become less specific with time. Learning and Memory 2007, 14:313-317.
116. Witnauer J.E., Urcelay G.P., Miller R.R. The error in total error reduction. Neurobiology of Learning and Memory 2013, 10.1016/j.nlm.2013.07.018.
117. Wright A.A., Santiago H.C., Sands S.F., Kendrick D.F., Cook R.G. Memory processing of serial lists by pigeons, monkeys, and people. Science 1985, 229:287-289.