Experimental extinction in Pavlovian conditioning: Behavioural and neuroscience perspectives

Quarterly Journal of Experimental Psychology Section B: Comparative and Physiological Psychology

Volumn 57, Issue 2, 2004, Pages 97-132

  Delamater, Andrew R ^a  

^a CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE; N METHYL DEXTRO ASPARTIC ACID RECEPTOR;

AMYGDALOID NUCLEUS; ANIMAL; ATTENTION; CONDITIONED REFLEX; HIPPOCAMPUS; INHIBITION (PSYCHOLOGY); METABOLISM; NERVE CELL; NEUROSCIENCE; PHYSIOLOGY; PREFRONTAL CORTEX; REINFORCEMENT; REVIEW;

AMYGDALA; ANIMALS; ATTENTION; CONDITIONING, CLASSICAL; DOPAMINE; EXTINCTION, PSYCHOLOGICAL; HIPPOCAMPUS; INHIBITION (PSYCHOLOGY); NEURONS; NEUROSCIENCES; PREFRONTAL CORTEX; RECEPTORS, N-METHYL-D-ASPARTATE; REINFORCEMENT (PSYCHOLOGY);

EID: 1842814143     PISSN: 02724995     EISSN: None     Source Type: Journal    
DOI: 10.1080/02724990344000097     Document Type: Review

References (96)

1. Abel, T., & Lattal, K. M. (2001). Molecular mechanisms of memory acquisition, consolidation and retrieval. Current Opinion in Neurobiology, 11, 180-187.
2. Aguado, L., de Brugada, I., & Hall, G. (2001). Tests for inhibition after extinction of a conditioned stimulus in the flavour aversion procedure. Quarterly Journal of Experimental Psychology, 54B, 201-218.
3. Armony, J. L., Quirk, G. J., & LeDoux, J. E. (1998). Differential effects of amygdala lesions on early and late plastic components of auditory cortex spike trains during fear conditioning. Journal of Neuroscience, 18, 2592-2601.
4. Baker, J. D., & Azorlosa, J. L. (1996). The NMDA antagonist MK-801 blocks the extinction of Pavlovian fear conditioning. Behavioral Neuroscience, 110, 618-620.
5. Herman, D. E., & Dudai, Y. (2001). Memory extinction, learning anew, and learning the new: Dissociations in the molecular machinery of learning in cortex. Science, 291, 2417-2419.
6. Blundell, P., Hall, G., & Killcross, S. (2001). Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats. Journal of Neuroscience, 21, 9018-9026.
7. Borowski, T. B., & Kokkinidis, L. (1998). The effects of cocaine, amphetamine, and the dopamine Dl receptor agonist SKF 38393 on fear extinction as measured with potentiated startle: Implications for psychomotor stimulant psychosis. Behavioral Neuroscience, 112, 952-965.
8. Bouton, M. E. (1986). Slow reacquisition following the extinction of conditioned suppression. Learning & Motivation, 17, 1-15.
9. Bouton, M. E. (1991). Context and retrieval in extinction and in other examples of interference in simple associative learning. In L. Dachowski & C. F. Flaherty (Eds.), Current topics in animal learning: Brain emotion and cognition (pp. 25-53). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
10. Bouton, M. E. (1993). Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. Psychological Bulletin, 114, 80-99.
11. Bouton, M. E., & Bolles, R. C. (1985). Contexts, event-memories, and extinction. In P. D. Balsam & A. Tomie (Eds.), Context and learning. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
12. Bouton, M. E., & King, D. A. (1986). Effect of context on performance to conditioned stimuli with mixed histories of reinforcement and nonreinforcement. Journal of Experimental Psychology: Animal Behavior Processes, 12, 4-15.
13. Bouton, M. E., & Ricker, S. T. (1994). Renewal of extinguished responding in a second context. Animal Learning & Behavior, 22, 317-324.
14. Bouton, M. E., & Swartzentruber, D. (1989). Slow reacquisition following extinction: Context, encoding, and retrieval mechanisms. Journal of Experimental Psychology: Animal Behavior Processes, 15, 43-53.
15. Calton, J. L., Mitchell, K. G., & Schachtman, T. R. (1996). Conditioned inhibition produced by extinction of a conditioned stimulus. Learning & Motivation, 27, 335-361.
16. Colwill, R. M. (1991). Negative discriminative stimuli provide information about the identity of omitted response-contingent outcomes. Animal Learning & Behavior, 19, 326-336.
17. Corcoran, K. A., & Maren, S. (2001). Hippocampal inactivation disrupts contextual retrieval of fear memory after extinction. Journal of Neuroscience, 21, 1720-1726.
18. Cox, J., & Westbrook, R. F. (1994). The NMDA receptor antagonist MK-801 blocks acquisition and extinction of conditioned hypoalgesic responses in the rat. Quarterly Journal of Experimental Psychology, 47B, 187-210.
19. Davis, M., Falls, W. A., & Gewirtz, J. (2000). Neural systems involved in fear inhibition: Extinction and conditioned inhibition. In M. S. Myslobodsky & I. Weiner (Eds.), Contemporary issues in modeling psychopathology (pp. 113-142). Boston, MA: Kluwer Academic Publishers.
20. Delamater, A. R. (1995). Outcome-selective effects of intertrial reinforcement in a Pavlovian appetitive conditioning paradigm with rats. Animal Learning & Behavior, 23, 31-39.
21. Delamater, A. R. (1996). Effects of several extinction treatments upon the integrity of Pavlovian stimulus-outcome associations. Animal Learning & Behavior, 24, 437-449.
22. Elizalde, G., & Sclafani, A. (1990). Flavor preferences conditioned by intragastric polycose infusions: A detailed analysis using an electronic esophagus preparation. Physiology & Behavior, 47, 63-77.
23. Falls, W. A., Miserendino, M. J., & Davis, M. (1992). Extinction of fear-potentiated startle: Blockade by infusion of an NMDA antagonist into the amygdala. Journal of Neuroscience, 12, 854-863.
24. Fox, G. D., & Holland, P. C. (1998). Neurotoxic hippocampal lesions fail to impair reinstatement of an appetitivtly conditioned response. Behavioral Neuroscience, 112, 255-260.
25. Frohardt, R. J., Guarraci, F. A., & Bouton, M. E. (2000). The effects of neurotoxic hippocampal lesions on two effects of context after fear extinction. Behavioral Neuroscience, 114, 227-240.
26. Gallistel, C. R., & Gibbon, J. (2000). Time, rate, and conditioning. Psychological Review, 107, 289-344.
27. Gewirtz, J. C., Falls, W. A., & Davis, M. (1997). Normal conditioned inhibition and extinction of freezing and fear-potentiated startle following electrolytic lesions of medical prefrontal cortex in rats. Behavioral Neuroscience, 111, 712-726.
28. Hall, G. (2002). Associative structures in Pavlovian and instrumental conditioning. In H. Pashler & R. Gallistel (Eds.), Steven's handbook of experimental psychology; Vol 3: Learning, motivation, and emotion (3rd ed., pp. 1-45). New York: John Wiley & Sons, Inc.
29. Hall, G., & Honey, R. C. (1989), Contextual effects in conditioning, latent inhibition, and habituation: Associative and retrieval functions of contextual cues. Journal of Experimental Psychology: Animal Behavior Processes, 15, 232-241.
30. Hall, G., & Mondragon, E. (1998). Contextual control as occasion setting. In N. A. Schmajuk & P. C. Holland (Eds.), Occasion setting: Associative learning and cognition in animals (pp. 199-222). Washington, DC: American Psychological Association.
31. Harris, J. A., Jones, M. L., Bailey, G. K., & Westbrook, R. F. (2000). Contextual control over conditioned responding in an extinction paradigm. Journal of Experimental Psychology: Animal Behavior Processes, 26, 174-185.
32. Harris, J. A., & Westbrook, R. F. (1998). Evidence that GABA transmission mediates context-specific extinction of learned fear. Psychopharmacology, 140, 105-115.
33. Hart, J. A., Bourne, M. J., & Schachtman, T. R. (1995). Slow reacquisition of a conditioned taste aversion. Animal Learning & Behavior, 23, 297-303.
34. Haselgrove, M., & Pearce, J. M. (2003). Facilitation of extinction by an increase or a decrease in trial duration. Journal of Experimental Psychology: Animal Behavior Processes, 29, 153-166.
35. Herry, C., & Garcia, R. (2002). Prefrontal cortex long-term potentiation, but not longterm depression, is associated with the maintenance of extinction of learned fear in mice. Journal of Neuroscience, 22, 577-583.
36. Holland, P. C. (1981). The effects of satiation after first- and second-order appetitive conditioning in rats. Pavlovian Journal of Biological Science, 16, 18-24.
37. Holland, P. C., & Gallagher, M. (1999). Amygdala circuitry in attentional and representational processes. Trends in Cognitive Science, 3, 65-73.
38. Holland, P. C., & Rescorla, R. A. (1975). The effect of two ways of devaluing the unconditioned stimulus after first-and second-order appetitive conditianing. Journal of Experimental Psychology: Animal Behavior Processes, 1, 355-363.
39. Holt, W., & Maren, S. (1999). Muscimol inactivation of the dorsal hippocampus impairs contextual retrieval of fear memory. Journal of Neuroscience, 19, 9054-9062.
40. Honey, R. C., & Good, M. (1993). Selective hippocampal lesions abolish the contextual specificity of latent inhibition and conditioning. Behavioral Neuroscience, 107, 23-33.
41. Johnson, D. M., Baker, J. D., & Azorlosa, J. L. (2000). Acquisition, extinction, and reinstatement of Pavlovian fear conditioning: The roles of the NMDA receptor and nitric oxide. Brain Research, 857, 66-70.
42. Kehoe, E. J., Macrae, M., & Hutchinson, C. L. (1996). MK-801 protects conditioned responses from extinction in the rabbit nictitating membrane preparation. Psychobiology, 24, 127-135.
43. Kehoe, E. J., & White, N. E. (2002). Extinction revisited: Similarities between extinction and reductions in US intensity in classical conditioning of the rabbit's nictitating membrane response. Animal Learning & Behavior, 30, 96-111.
44. Konorski, J. (1948). Conditioned reflexes and neuron organization. New York: Cambridge University Press.
45. Konorski, J. (1967). Integrative activity of the brain. Chicago: University of Chicago Press.
46. Lattal, K. M., & Abel, T. (2001). Different requirements for protein synthesis in acquisition and extinction of spatial preferences and context-evoked fear. Journal of Neuroscience, 21, 5773-5780.
47. Lee, H., & Kim, J. J. (1998). Amygdalar NMDA receptors are critical for new fear learning in previously fear-conditioned rats. Journal of Neuroscience, 18, 8444-8454.
48. Lu, K. T., Walker, D. L., & Davis, M. (2001). Mitogen-activated protein kinase cascade in the basolateral nucleus of amygdala is involved in extinction of fear-potentiated startle. Journal of Neuroscience, 21, RC 162.
49. Mackintosh, N. J. (1974). The psychology of animal learning. London: Academic Press.
50. McGaugh, J. L., Castellano, C., & Brioni, J. (1990). Picrotoxin enhances latent extinction of conditioned fear. Behavioral Neuroseience, 104, 264-267.
51. Milad, M. R., & Quirk, G. J. (2002). Neurons in medial prefrontal cortex signal memory for fear extinction. Nature, 420, 70-74.
52. Morgan, M. A., & LeDoux, J. E. (1995). Differential contribution of dorsal and ventral medial prefrontal cortex to the acquisition and extinction of conditioned fear in rats. Behavioral Neuroscience, 109, 681-688.
53. Morgan, M. A., & LeDoux, J. E. (1999). Contribution of ventrolateral prefrontal cortex to the acquisition and extinction of conditioned fear in rats. Neurobiology of Learning and Memory, 73, 244-251.
54. Morgan, M. A., Romanski, L. M., & LeDoux, J. E. (1993). Extinction of emotional learning: Contribution of medial prefrontal cortex. Neuroscience Letters, 163, 109-113.
55. Morrow, B. A., Elsworth, J. D., Rasmusson, A. M., & Roth, R. H. (1999). The role of mesoprefrontal dopamine neurons in the acquisition and expression of conditioned fear in the rat. Neuroscience, 92, 553-564.
56. Myers, K. M., & Davis, M. (2002). Behavioral and neural analysis of extinction. Neuron, 36, 567-584.
57. Nader, K., Schafe, G. E., & LeDoux, J. E. (2000). Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval. Nature, 406, 722-726.
58. Napier, R. M., Macrae, M., & Kehoe, E. J. (1992). Rapid reacquisition in conditioning of the rabbit's nictitating membrane response. Journal of Experimental Psychology: Animal Behavior Processes, 18, 182-192.
59. Ohyama, T., Gibbon, J., Deich, J. D., & Balsam, P. D. (1999). Temporal control during maintenance and extinction of conditioned keypecking in ring doves. Animal Learning & Behavior, 27, 89-98.
60. Pavlov, I. P. (1927). Conditioned reflexes. Oxford: Oxford University Press.
61. Pearce, J. M., & Bouton, M. E. (2001). Theories of associative learning in animals. Annual Reviers of Psychology, 52, 111-139.
62. Pearce J. M., & Hall, G. (1980). A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review, 87, 532-552.
63. Pearce, J. M., & Wilson, P. N. (1991). Effects of extinction with a compound conditioned stimulus. Journal of Experimental Psychology: Animal Behavior Processes, 17, 151-162.
64. Peck, C. A., & Bouton, M. E. (1990). Context and performance in aversive-to-appetitive and appetitive-to-aversive transfer. Learning & Motivation, 21, 1-31.
65. Perez, C., Ackroff, K., & Sclafani, A. (1996). Carbohydrate- and protein-conditioned flavor preferences: Effects of nutrient payloads. Physiology & Behavior, 59, 467-474.
66. Perez, C., Lucas, F., & Sclafani, A. (1998). Increased flavor acceptance and preference conditioned by the postingestive actions of glucose. Physiology & Behavior, 64, 483-492.
67. Quirk, G. J., Russo, G. K., Barron, J. L., & Lebron, K. (2000). The role of ventromedial prefrontal cortex in the recovery of extinguished fear. Journal of Neuroscience, 20, 6225-6231.
68. Rauhut, A. S., Thomas, B. L., & Ayres, J. J. (2001). Treatments that weaken Pavlovian conditioned fear and thwart its renewal in rats: Implications for treating human phobias. Journal of Experimental Psychology: Animal Behavior Processes, 27, 99-114.
69. Rescorla, R. A. (1982). Some consequences of associations between the excitor and the inhibitor in a conditioned inhibition paradigm. Journal of Experimental Psychology: Animal Behavior Processes, 8, 288-298.
70. Rescorla, R. A. (1993). Inhibitory associations between S and R in extinction. Animal Learning & Behavior, 21, 327-336.
71. Rescorla, R. A. (1996a). Preservation of Pavlovian associations through extinction. Quarterly Journal of Experimental Psychology, 49B, 245-258.
72. Rescorla, R. A. (1996b). Spontaneous recovery after training with multiple outcomes. Animal Learning & Behavior, 24, 11-18.
73. Rescorla, R. A. (1997a). Response-inhibition in extinction. Quarterly Journal of Experimental Psychology, 50B, 215-252.
74. Rescorla, R. A. (1997b). Spontaneous recovery of instrumental discriminative responding. Animal Learning & Behavior, 25, 485-497.
75. Rescorla, R. A. (1997c). Spontaneous recovery after Pavlovian conditioning with multiple outcomes. Animal Learning & Behavior, 25, 99-107.
76. Rescorla, R. A. (1999). Partial reinforcement reduces the associative change produced by nonreinforcement. Journal of Experimental Psychology: Animal Behavior Processes, 25, 403-414.
77. Rescorla, R. A. (2000a). Associative changes in excitors and inhibitors differ when they are conditioned in compound. Journal of Experimental Psychology: Animal Behavior Processes, 26, 428-438.
78. Rescorla, R. A. (2000b). Extinction can be enhanced by a concurrent excitor. Journal of Experimental Psychology: Animal Behavior Processes, 26, 251-260.
79. Rescorla, R. A. (2001c). Are associative changes in acquisition and extinction negatively accelerated? Journal of Experimental Psychology: Animal Behavior Processes, 27, 307-315.
80. Rescorla, R. A. (2001a). Experimental extinction, In R. R. Mowrer & S. B. Klein (Eds.), Handbook of contemporary learning theories (pp. 119-154). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
81. Rescorla, R. A. (2001b). Retraining of extinguished Pavlovian stimuli. Journal of Experimental Psychology: Animal Behavior Processes, 7, 115-124.
82. Rescorla, R. A. (2001d). Unequal associative changes when excitors and neutral stimuli arc conditioned in compound. Quarterly Journal of Experimental Psychology, 54B, 53-68.
83. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. P. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts.
84. Ricker, S. T., & Bouton, M. E. (1996). Reacquisition following extinction in appetitive conditioning. Animal Learning & Behavior, 24, 423-436.
85. Robbins, S. J. (1990). Mechanisms underlying spontaneous recovery in autoshaping. Journal of Experimental Psychology: Animal Behavior Processes, 16, 235-249.
86. Robinson, G. B., Port, R. L., & Stillwell, E. J. (1993). Latent inhibition of the classically conditioned rabbit nictitating membrane response is unaffected by the NMDA antagonist MK 801. Psychobiology 21, 120-124.
87. Santini, E., Muller, R. U., & Quirk, G. J. (2001). Consolidation of extinction learning involves transfer from NMDA-independent to NMDA-dependent memory. Journal of Neuroscience, 21, 9009-9017.
88. Schachtman, T. R., Threlkeld, R., & Meyer, K. (2000). Retention of conditioned inhibition produced by extinction. Learning & Motivation, 31, 283-300.
89. Takatsuki, K., Kawahara, S., Takehara, K., Kishimoto, Y., & Kirino, Y. (2001). Effects of the noncompetitive NMDA receptor antagonist MK-801 on classical eyeblink conditioning in mice. Neuropharmacology, 41, 618-628.
90. Tang, Y.-P., Wang, H., Feng, R., Kyin, M., & Tsien, J. Z. (2001). Differential effects of enrichment on learning and memory function in NR2B transgenic mice. Neuropharmacology, 41, 779-790.
91. Taylor, K. M., & Boakes, R. A. (2002). Extinction of conditioned taste aversions: Effects of concentration and over-shadowing. Quarterly Journal of Experimental Psychology, 55B, 213-240.
92. Wagner, A. R. (1981). SOP: A model of automatic memory processing in animal behavior. In N. E. M. Spear & R. R. Miller (Eds.), Information processing in animals: Memory mechanisms. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
93. Wagner, A. R., & Brandon, S. E. (1989). Evolution of a structured connectionist model of Pavlovian conditioning (AESOP). In S. B. Klein & R. R. Mowrer (Eds.), Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theory (pp. 149-189). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
94. Walker, D. L., Ressler, K. J., Lu, K. T., & Davis, M. (2002). Facilitation of conditioned fear extinction by systemic administration or intra-amygdala infusions of D-cycloserine as assessed with fear-potentiated startle in rats, Journal of Neuroscience, 22, 2343-2351.
95. Willick, M. L., & Kokkinidis, L. (1995). Cocaine enhances the expression of fear-potentiated startle: evaluation of state-dependent extinction and the shock-sensitization of acoustic startle. Behavioral Niuroscience, 109, 929-938.
96. Wilson, A., Brooks, D. C., & Bouton, M. E. (1995). The role of the rat hippocampal system in several effects of context in extinction. Behavioral Ntunscience, 109, 828-836.