The neural correlates of negative prediction error signaling in human fear conditioning

NeuroImage

Volumn 54, Issue 3, 2011, Pages 2250-2256

  Spoormaker, V I ^a   Andrade, K C ^a   Schroter M S ^a   Sturm, A ^a   Goya Maldonado, R ^a   Samann P G ^a   Czisch, M ^a  

^a MAX PLANCK INSTITUTE OF PSYCHIATRY   (Germany)

Author keywords

Fear conditioning; Prediction error; Temporal difference, fMRI; VmPFC

Indexed keywords

ADULT; ARTICLE; BRAIN STEM; CONDITIONING; ELECTRIC SHOCK; ELECTRODERMAL RESPONSE; ELECTROSTIMULATION; FEAR; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; INSULA; MALE; NEUROIMAGING; PREDICTION; PRIORITY JOURNAL; VISUAL CORTEX; VISUAL STIMULATION;

ADULT; ALGORITHMS; BRAIN; BRAIN MAPPING; COLOR; CONDITIONING (PSYCHOLOGY); DATA INTERPRETATION, STATISTICAL; ELECTRIC STIMULATION; ELECTROPHYSIOLOGICAL PHENOMENA; EVOKED POTENTIALS; EXTINCTION, PSYCHOLOGICAL; FEAR; FEEDBACK, PSYCHOLOGICAL; GALVANIC SKIN RESPONSE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; YOUNG ADULT;

EID: 78650224097     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2010.09.042     Document Type: Article

References (49)

1. Brovelli A., Laksiri N., Nazarian B., Meunier M., Boussaoud D. Understanding the neural computations of arbitrary visuomotor learning through fMRI and associative learning theory. Cereb. Cortex 2008, 18:1485-1495.
2. Büchel C., Dolan R.J. Classical fear conditioning in functional neuroimaging. Curr. Opin. Neurobiol. 2000, 10:219-223.
3. Büchel C., Dolan R.J., Armony J.L., Friston K.J. Amygdala-hippocampal involvement in human aversive trace conditioning revealed through event-related functional magnetic resonance imaging. J. Neurosci. 1999, 19:10869-10876.
4. Buchel C., Morris J., Dolan R.J., Friston K.J. Brain systems mediating aversive conditioning: an event-related fMRI study. Neuron 1998, 20:947-957.
5. Burgos-Robles A., Vidal-Gonzalez I., Santini E., Quirk G.J. Consolidation of fear extinction requires NMDA receptor-dependent bursting in the ventromedial prefrontal cortex. Neuron 2007, 53:871-880.
6. Carlsson K., Andersson J., Petrovic P., Petersson K.M., Ohman A., Ingvar M. Predictability modulates the affective and sensory-discriminative neural processing of pain. Neuroimage 2006, 32:1804-1814.
7. Cheng D.T., Knight D.C., Smith C.N., Helmstetter F.J. Human amygdala activity during the expression of fear responses. Behav. Neurosci. 2006, 120:1187-1195.
8. Cheng D.T., Richards J., Helmstetter F.J. Activity in the human amygdala corresponds to early, rather than late period autonomic responses to a signal for shock. Learn. Mem. 2007, 14:485-490.
9. Delgado M.R., Nearing K.I., LeDoux J.E., Phelps E.A. Neural circuitry underlying the regulation of conditioned fear and its relation to extinction. Neuron 2008, 59:829-838.
10. Dolan R.J. Value encoding in the human brain. International Symposium: Fear, Anxiety and Anxiety Disorders, Münster, Germany 2009.
11. Dunsmoor J.E., Bandettini P.A., Knight D.C. Impact of continuous versus intermittent CS-UCS pairing on human brain activation during Pavlovian fear conditioning. Behav. Neurosci. 2007, 121:635-642.
12. Dunsmoor J.E., Bandettini P.A., Knight D.C. Neural correlates of unconditioned response diminution during Pavlovian conditioning. Neuroimage 2008, 40:811-817.
13. Genovese C.R., Lazar N.A., Nichols T.E. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 2002, 15:870-878.
14. Grings W.W., Lockhart R.A., Dameron L.E. Conditioning autonomic responses of mentally subnormal individuals. Psychol. Monogr. 1962, 76:1-35.
15. Haruno M., Kawato M. Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. J. Neurophysiol. 2006, 95:948-959.
16. Hayasaka S., Phan K.L., Liberzon I., Worsley K.J., Nichols T.E. Nonstationary cluster-size inference with random field and permutation methods. Neuroimage 2004, 22:676-687.
17. Jensen J., McIntosh A.R., Crawley A.P., Mikulis D.J., Remington G., Kapur S. Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 2003, 40:1251-1257.
18. Jensen J., Smith A.J., Willeit M., Crawley A.P., Mikulis D.J., Vitcu I., Kapur S. Separate brain regions code for salience vs. valence during reward prediction in humans. Hum. Brain Mapp. 2007, 28:294-302.
19. Kalisch R., Korenfeld E., Stephan K.E., Weiskopf N., Seymour B., Dolan R.J. Context-dependent human extinction memory is mediated by a ventromedial prefrontal and hippocampal network. J. Neurosci. 2006, 26:9503-9511.
20. Knight D.C., Nguyen H.T., Bandettini P.A. The role of the human amygdala in the production of conditioned fear responses. Neuroimage 2005, 26:1193-1200.
21. Knight D.C., Waters N.S., King M.K., Bandettini P.A. Learning-related diminution of unconditioned SCR and fMRI signal responses. Neuroimage 2010, 49:843-848.
22. Knutson B., Adams C.M., Fong G.W., Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J. Neurosci. 2001, 21:RC159.
23. LaBar K.S., Gatenby J.C., Gore J.C., LeDoux J.E., Phelps E.A. Human amygdala activation during conditioned fear acquisition and extinction: a mixed-trial fMRI study. Neuron 1998, 20:937-945.
24. Lebrón K., Milad M.R., Quirk G.J. Delayed recall of fear extinction in rats with lesions of ventral medial prefrontal cortex. Learn. Mem. 2004, 11:544-548.
25. Lissek S., Rabin S.J., McDowell D.J., Dvir S., Bradford D.E., Geraci M., Pine D.S., Grillon C. Impaired discriminative fear-conditioning resulting from elevated fear responding to learned safety cues among individuals with panic disorder. Behav. Res. Ther. 2009, 47:111-118.
26. Menon M., Jensen J., Vitcu I., Graff-Guerrero A., Crawley A., Smith M.A., Kapur S. Temporal difference modeling of the blood-oxygen level dependent response during aversive conditioning in humans: effects of dopaminergic modulation. Biol. Psychiatry 2007, 62:765-772.
27. Milad M.R., Pitman R.K., Ellis C.B., Gold A.L., Shin L.M., Lasko N.B., Zeidan M.A., Handwerger K., Orr S.P., Rauch S.L. Neurobiological basis of failure to recall extinction memory in posttraumatic stress disorder. Biol. Psychiatry 2009, 66:1075-1082.
28. Milad M.R., Rauch S.L. The role of the orbitofrontal cortex in anxiety disorders. Ann. N.Y. Acad. Sci. 2007, 1121:546-561.
29. Milad M.R., Wright C.I., Orr S.P., Pitman R.K., Quirk G.J., Rauch S.L. Recall of fear extinction in humans activates the ventromedial prefrontal cortex and hippocampus in concert. Biol. Psychiatry 2007, 62:446-454.
30. Morgan M.A., LeDoux J.E. Differential contribution of dorsal and ventral medial prefrontal cortex to the acquisition and extinction of conditioned fear in rats. Behav. Neurosci. 1995, 109:681-688.
31. Morris J.S., Dolan R.J. Dissociable amygdala and orbitofrontal responses during reversal fear conditioning. Neuroimage 2004, 22:372-380.
32. Mirenowicz J., Schultz W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 1996, 379:449-451.
33. Nitschke J.B., Sarinopoulos I., Mackiewicz K.L., Schaefer H.S., Davidson R.J. Functional neuroanatomy of aversion and its anticipation. Neuroimage 2006, 29:106-116.
34. O'Doherty J.P., Dayan P., Friston K., Critchley H., Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 2003, 38:329-337.
35. Phelps E.A., Delgado M.R., Nearing K.I., LeDoux J.E. Extinction learning in humans: role of the amygdala and vmPFC. Neuron 2004, 43:897-905.
36. Prokasy W.F., Ebel H.C. Three components of the classically conditioned GSR in human subjects. J. Exp. Psychol. 1967, 73:247-256.
37. Rauch S.L., Shin L.M., Phelps E.A. Neurocircuitry models of posttraumatic stress disorder and extinction: human neuroimaging research-past, present, and future. Biol. Psychiatry 2006, 60:376-382.
38. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Classical conditioning: II. Current research and theory 1972, 64-99. Appleton-Century-Crofts, New York. W.F. Black, W.F. Prokasky (Eds.).
39. Rogan M.T., Leon K.S., Perez D.L., Kandel E.R. Distinct neural signatures for safety and danger in the amygdala and striatum of the mouse. Neuron 2005, 46:309-320.
40. Rosenkranz J.A., Grace A.A. Dopamine-mediated modulation of odour-evoked amygdala potentials during Pavlovian conditioning. Nature 2002, 417:282-287.
41. Schiller D., Levy I., Niv Y., LeDoux J.E., Phelps E.A. From fear to safety and back: reversal of fear in the human brain. J. Neurosci. 2008, 28:11517-11525.
42. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 1998, 80:1-27.
43. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1598.
44. Sehlmeyer C., Schöning S., Zwitserlood P., Pfleiderer B., Kircher T., Arolt V., Konrad C. Human fear conditioning and extinction in neuroimaging: a systematic review. PLoS ONE 2009, 4:e5865.
45. Seymour B., O'Doherty J.P., Dayan P., Koltzenburg M., Jones A.K., Dolan R.J., Friston K.J., Frackowiak R.S. Temporal difference models describe higher-order learning in humans. Nature 2004, 429:664-667.
46. Seymour B., O'Doherty J.P., Koltzenburg M., Wiech K., Frackowiak R., Friston K., Dolan R. Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat. Neurosci. 2005, 8:1234-1240.
47. Straube T., Weiss T., Mentzel H.J., Miltner W.H. Time course of amygdala activation during aversive conditioning depends on attention. Neuroimage 2007, 34:462-469.
48. Sutton R.S., Barto A.G. Time-derivative models of Pavlovian reinforcement. Learning and Computational Neuroscience: Foundations of Adaptive Networks 1990, 497-537. The MIT Press, Cambridge, MA. M. Gabriel, J. Moore (Eds.).
49. Wessa M., Flor H. Failure of extinction of fear responses in posttraumatic stress disorder: evidence from second-order conditioning. Am. J. Psychiatry 2007, 164:1684-1692.