The conditions that promote fear learning: Prediction error and Pavlovian fear conditioning

Neurobiology of Learning and Memory

Volumn 108, Issue , 2014, Pages 14-21

  Li, Susan Shi Yuan ^a   McNally, Gavan P ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Associability; Blocking; Conditioning; Fear; Prediction error

Indexed keywords

ASSOCIABILITY; BLOCKING; CONDITIONING; FEAR; PREDICTION ERROR;

ANIMALS; BRAIN; CONDITIONING, CLASSICAL; FEAR; HUMANS; LEARNING; MEMORY;

EID: 84893777971     PISSN: 10747427     EISSN: 10959564     Source Type: Journal    
DOI: 10.1016/j.nlm.2013.05.002     Document Type: Review

References (83)

1. Abercrombie E.D., Keefe K.A., DiFrischia D.S., Zigmond M.J. Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial frontal cortex. Journal of Neurochemistry 1989, 52:1655-1658.
2. Badrinarayan A., Wescott S.A., Vander Weele C.M., Saunders B.T., Couturier B.E., Maren S., et al. Aversive stimuli differentially modulate real-time dopamine transmission dynamics within the nucleus accumbens core and shell. Journal of Neuroscience 2012, 32(45):15779-15790.
3. Boll S., Gamer M., Gluth S., Finsterbusch J., Buchel C. Separate amygdala subregions signal surprise and predictiveness during associative fear learning in humans. The European Journal of Neuroscience 2013, 37(5):758-767.
4. Bolles R.C., Fanselow M.S. Endorphins and behavior. Annual Review of Psychology 1982, 33:87-101.
5. Bradfield L., McNally G.P. Unblocking in Pavlovian fear conditioning. Journal of Experimental Psychology. Animal Behavior Processes 2008, 34(2):256-265.
6. Brischoux F., Chakraborty S., Brierley D.I., Ungless M.A. Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proceedings of the National Academy of Sciences of the United States of America 2009, 106:4894-4899.
7. Carrive P. The periaqueductal gray and defensive behavior: Functional representation and neuronal organization. Behavioural Brain Research 1993, 58(1-2):27-47.
8. Coco M.L., Kuhn C.M., Ely T.D., Kilts C.D. Selective activation of mesoamygdaloid dopamine neurons by conditioned stress: Attenuation by dizapema. Brain Research 1992, 590:39-47.
9. Cole S., McNally G.P. Opioid receptors mediate direct predictive fear learning: Evidence from one-trial blocking. Learning and Memory 2007, 14(4):229-235. 10.1101/lm.489507.
10. Cole S., McNally G.P. Complementary roles for amygdala and periaqueductal gray in temporal-difference fear learning. Learning and Memory 2008, 16(1):1-7.
11. Corbit L.H., Muir J.L., Balleine B.W. The role of the nucleus accumbens in instrumental conditioning: Evidence of a functional dissociation between accumbens core and shell. The Journal of Neuroscience 2001, 21:3251-3260.
12. Di Scala G., Mana M.J., Jacobs W.J., Phillips A.G. Evidence of Pavlovian conditioned fear following electrical stimulation of the periaqueductal grey in the rat. Physiology and Behavior 1987, 40(1):55-63.
13. Dickinson A., Mackintosh N.J., Cotton M.M. Surprise and blocking: Effects of the number of compound trials. Animal Learning and Behavior 1980, 8(3):387-391.
14. Dunsmoor J.E., Bandettini P.A., Knight D.C. Neural correlates of unconditioned response diminution during Pavlovian conditioning. NeuroImage 2008, 40(2):811-817.
15. Dunsmoor J., Schmajuk N. Interpreting patterns of brain activation in human fear conditioning with an attentional-associative learning model. Behavioral Neuroscience 2009, 123(4):851-855.
16. Egan K.J., Carr J.E., Hunt D.D., Adamson R. Endogenous opiate system and systematic desensitization. Journal of Consulting and Clinical Psychology 1988, 56(2):287-291.
17. Eippert F., Bingel U., Schoell E., Yacubian J., Buchel C. Blockade of endogenous opioid neurotransmission enhances acquisition of conditioned fear in humans. The Journal of Neuroscience 2008, 28(21):5465-5472.
18. Eippert F., Gamer M., Buchel C. Neurobiological mechanisms underlying the blocking effect in aversive learning. The Journal of Neuroscience 2012, 32(38):13164-13176.
19. Eippert, F., Zurowski, B., McNally, G. P., Kalisch, R., & Buchel, C. (2012). Endogenous opioids in human fear extinction. Presented at the society for neuroscience annual meeting.
20. Fanselow M.S., Bolles R.C. Naloxone and shock-elicited freezing in the rat. Journal of Comparative and Physiological Psychology 1979, 93(4):736-744.
21. Furlong T.M., Cole S., Hamlin A.S., McNally G.P. The role of prefrontal cortex in predictive fear learning. Behavioral Neuroscience 2010, 124(5):574-586.
22. Garfield J.B.B., McNally G.P. The effects of FG7142 on overexpectation of Pavlovian fear conditioning. Behavioral Neuroscience 2009, 123(1):75-85.
23. Helmstetter F.J., Fanselow M.S. Effects of naltrexone on learning and performance of conditional fear-induced freezing and opioid analgesia. Physiology and Behavior 1987, 39(4):501-505.
24. Huh K.H., Guzman Y.F., Tronson N.C., Gueda A.L., Gao C., Radulovic J. Hippocampal ERK mechanisms linking prediction error to fear extinction: Roles of shock expectancy and contextual aversive valence. Learning and Memory 2009, 16:273-278.
25. Inglis F.M., Moghaddam B. Dopaminergic innervation of the amygdala is highly responsive to stress. Journal of Neurochemistry 1999, 72:1088-1094.
26. Iordanova M.D. Dopamine transmission in the amygdala modulates surprise in an aversive blocking paradigm. Behavioral Neuroscience 2010, 124(6):780-788.
27. Iordanova M., McNally G.P., Westbrook R.F. Opioid receptors in the nucleus accumbens regulate attentional learning in the blocking paradigm. The Journal of Neuroscience 2006, 26:4036-4045.
28. Iordanova M.D., Westbrook R.F., Killcross A.S. Dopamine activity in the nucleus accumbens modulates blocking in fear conditioning. The European Journal of Neuroscience 2006, 24(11):3265-3270.
29. Ito R., Robbins T.W., Everitt B.J. Differential control over cocaine-seeking behavior by nucleus accumbens core and shell. Nature Neuroscience 2004, 7:389-397.
30. Johansen J.P., Hamanaka H., Monfils M.-H., Behnia R., Deisseroth K., Blair H.T., et al. Optical activation of lateral amygdala pyramidal cells instructs associative fear learning. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(28):12692-12967.
31. Johansen J.P., Tarpley J.W., Ledoux J.E., Blair H.T. Neural substrates for expectation-modulated fear learning in the amygdala and periaqueductal gray. Nature Neuroscience 2010, 13(8):979-986.
32. Kamin L.J. Attention-like processes in classical conditioning. Miami Symposium on the Prediction of Behavior: Aversive Stimulation 1968, 9-33. University of Miami Press, Miami, FL. B.J. Campbell, R.M. Church (Eds.).
33. Kim J.H., Richardson R. The effect of the -opioid receptor antagonist naloxone on extinction of conditioned fear in the developing rat. Learning and Memory (Cold Spring Harbor, NY) 2009, 16(3):161-166.
34. Kozak A.T., Spates C.R., McChargue D.E., Bailey K.C., Schneider K.L., Liepman M.R. Naltrexone renders one-session exposure therapy less effective: A controlled pilot study. Journal of Anxiety Disorders 2007, 21(1):142-152.
35. Krout K.E., Loewy A.D. Periaqueductal gray matter projections to midline and intralaminar thalamic nuclei of the rat. The Journal of Comparative Neurology 2000, 424:111-141.
36. Le Pelley M.E. The role of associative history in models of associative learning: A selective review and a hybrid model. The Quarterly Journal of Experimental Psychology: Series B, Comparative and Physiological Psychology 2004, 57(3):193-243.
37. Lee J.L.C. Memory reconsolidation mediates the strengthening of memories by additional learning. Nature Neuroscience 2008, 11(11):1264-1266.
38. Lee J.L.C., Everitt B.J., Thomas K.L. Independent cellular processes for hippocampal memory consolidation and reconsolidation. Science (New York, NY) 2004, 304(5672):839-843.
39. Lee J.L.C., Hynds R.E. Divergent cellular pathways of hippocampal memory consolidation and reconsolidation. Hippocampus 2013, 23:233-244.
40. Letzkus J.J., Wolff S.B.E., Meyer E.M.M., Tovote P., Courtin J., Herry C., et al. A disinhibitory microcircuit for associative fear learning in the auditory cortex. Nature 2011, 480:331-335.
41. Ljungberg T., Apicella P., Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. Journal of Neurophysiology 1992, 67(1):145-163.
42. Mackintosh N.J. A theory of attention: Variations in the associability of stimuli with reinforcement. Psychological Review 1975, 82(4):276-298.
43. Mahan A.L., Ressler K.J. Fear conditioning, synaptic plasticity and the amygdala: Implications for posttraumatic stress disorder. Trends in Neurosciences 2011, 1-12.
44. Malkani S., Wallace K.J., Donley M.P., Rosen J.B. An egr-1 (zif268) antisense oligodeoxynucleotide infused into the amygdala disrupts fear conditioning. Learning and Memory 2004, 11:617-624.
45. Maren S., Quirk G.J. Neuronal signalling of fear memory. Nature Reviews. Neuroscience 2004, 5(11):844-852. 10.1038/nrn1535.
46. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459(7248):837-841.
47. McKernan M.G., Shinnick-Gallagher P. Fear conditioning induces a lasting potentiation of synaptic currents in vitro. Nature 1997, 1:609-611.
48. McNally G.P., Cole S. Opioid receptors in the midbrain periaqueductal gray regulate prediction errors during Pavlovian fear conditioning. Behavioral Neuroscience 2006, 120(2):313-323.
49. McNally G.P., Lee B.-W., Chiem J.Y., Choi E.A. The midbrain periaqueductal gray and fear extinction: Opioid receptor subtype and roles of cyclic AMP, protein kinase A, and mitogen-activated protein kinase. Behavioral Neuroscience 2005, 119(4):1023-1033.
50. McNally G.P., Pigg M., Weidemann G. Blocking, unblocking, and overexpectation of fear: A role for opioid receptors in the regulation of Pavlovian association formation. Behavioral Neuroscience 2004, 118(1):111-120.
51. McNally G.P., Pigg M., Weidemann G. Opioid receptors in the midbrain periaqueductal gray regulate extinction of pavlovian fear conditioning. The Journal of Neuroscience 2004, 24(31):6912-6919.
52. McNally G.P., Westbrook R.F. Opioid receptors regulate the extinction of Pavlovian fear conditioning. Behavioral Neuroscience 2003, 117(6):1292-1301.
53. McSweeney F.K., Swindell S. Common processes may contribute to extinction and habituation. Journal of General Psychology 2002, 129:364-400.
54. Merluzzi T.V., Taylor C.B., Boltwood M., Gotestam K.G. Opioid antagonist impedes exposure. Journal of Consulting and Clinical Psychology 1991, 59(3):425-430.
55. Mirenowicz J., Schultz W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 1996, 379:449-451.
56. Nader K., Hardt O. A single standard for memory: The case for reconsolidation. Nature Reviews. Neuroscience 2009, 10(3):224-234.
57. Parsons R.G., Gafford G.M., Helmstetter F.J. Regulation of extinction-related plasticity by opioid receptors in the ventrolateral periaqueductal gray matter. Frontiers in Behavioral Neuroscience 2010, 4(August):1-11. 10.3389/fnbeh.2010.00044.
58. Pearce J.M., Hall G. A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review 1980, 87(6):532-552.
59. Pezze M.A., Feldon J. Mesolimbic dopaminergic pathways in fear conditioning. Progress in Neurobiology 2004, 74(5):301-320.
60. Pezze M.A., Heidbreder C.A., Feldon J., Murphy C.A. Selective responding of nucleus accumbens core and shell dopamine to aversively conditioned contextual and discrete stimuli. Neuroscience 2001, 108(1):91-102.
61. Rescorla R.A. Reduction in the effectiveness of reinforcement after prior excitatory conditioning. Learning and Motivation 1970, 1(4):372-381.
62. Rescorla R.A. Unequal associative changes when excitors and neutral stimuli are conditioned in compound. The Quarterly Journal of Experimental Psychology: Series B, Comparative and Physiological Psychology 2001, 54B:53-68.
63. Rescorla R.A. Spontaneous recovery from overexpectation. Learning and Behavior 2006, 34(1):13-20.
64. Rescorla R.A. Renewal after overexpectation. Learning and Behavior 2007, 35(1):19-26.
65. Rescorla R.A, Wagner A.R A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory 1972, 64-99. Appleton Century Crofts, New York.
66. Roesch M.R., Esber G.R., Li J., Daw N.D., Schoenbaum G. Surprise! Neural correlates of Pearce-Hall and Rescorla-Wagner coexist within the brain. The European Journal of Neuroscience 2012, 35(7):1190-1200.
67. Rogan M.T., Staubli U.V., LeDoux J.E. Fear conditioning induces associative long-term potentiation in the amygdala. Nature 1998, 107:604-607.
68. Schafe G.E., Nader K., Blair H.T., Ledoux J.E. Memory consolidation of Pavlovian fear conditioning: A cellular and molecular perspective. Trends in Neurosciences 2001, 24(9):540-546.
69. Schoenbaum G., Roesch M.R., Stalnaker T.A., Takahashi Y.K. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nature Reviews. Neuroscience 2009, 10(12):885-892.
70. Schultz W. A neural substrate of prediction and reward. Science 1997, 275(5306):1593-1599.
71. Schultz W., Apicella P., Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. The Journal of Neuroscience 1993, 13:900-913.
72. Schultz W., Romo R. Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in theanesthetized monkey. Journal of Neurophsyiology 1987, 57:201-217.
73. Selden N.R.W., Everitt B.J., Jarrad L.E., Robbins T.W. Complementary roles for the amygdala and hippocampus in aversive conditioning to contextual cues. Neuroscience 1991, 42:335-350.
74. Stafford J.M., Lattal K.M. Direct comparison of the size and persistence of anisomycin-induced consolidation and reconsolidation deficits. Learning and Memory 2009, 24:494-503.
75. Tobler P.N., Dickinson A., Schultz W. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. The Journal of Neuroscience 2003, 23(32):10402-10410.
76. Tronson N.C., Corcoran K.A., Jovasevic V., Radulovic J. Fear conditioning and extinction: Emotional states encoded by distinct signaling pathways. Trends in Neurosciences 2012, 35(3):145-155.
77. Ungless M.A., Magill P.J., Bolam J.P. Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science (New York, NY) 2004, 303(5666):2040-2042.
78. Waelti P., Dickinson A., Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 2001, 412(6842):43-48.
79. Wagner A.R., Logan F.A., Haberlandt K., Price T. Stimulus selection in animal discrimination learning. Journal of Experimental Psychology 1968, 76:171-180.
80. Wagner A.R., Rescorla R.A. Inhibition in Pavlovian conditioning: Application of a theory. Inhibition and Learning 1972, 301-336. Academic Press, New York. R.A. Boakes, M.S. Halliday (Eds.).
81. Young A.M.J., Joseph M.H., Gray J.A. Latent inhibition of conditioned dopamine release in rat nucleus accumbens. Neuroscience 1993, 54:5-9.
82. Young A.M.J., Rees K.R. Dopamine relese in the amygdaloid complex the rat studied by microdialysis. Neuroscience Letters 1998, 249:49-52.
83. Zahm D.S., Borg J.S. On the significance of subterritories in the "accumbens" part of the rat ventral striatum. Neuroscience 1992, 50:751-767.