Delay and trace fear conditioning in a complex virtual learning environment-neural substrates of extinction

Frontiers in Human Neuroscience

Volumn 8, Issue MAY, 2014, Pages

  Ewald, Heike ^a   Glotzbach Schoon, Evelyn ^a   Gerdes, Antje B M ^a,b   Andreatta, Marta ^a   Müller, Mathias ^a   Mühlberger, Andreas ^a,c   Pauli, Paul ^a  

^a UNIVERSITY OF WÜRZBURG   (Germany)

^b UNIVERSITY OF MANNHEIM   (Germany)

^c UNIVERSITY OF REGENSBURG   (Germany)

Author keywords

Delay conditioning; Extinction; FMRI; Prefrontal cortex; Trace conditioning; Virtual reality

Indexed keywords

ADULT; ARTICLE; BRAIN FUNCTION; CONDITIONING; ELECTROSTIMULATION; FEAR; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING ENVIRONMENT; MALE; NORMAL HUMAN; PREFRONTAL CORTEX; REINFORCEMENT; STIMULUS RESPONSE; VIRTUAL REALITY;

EID: 84901604804     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00323     Document Type: Article

References (69)

1. Alvarez, R. P., Biggs, A., Chen, G., Pine, D. S., and Grillon, C. (2008). Contextual fear conditioning in humans: cortical-hippocampal and amygdala contributions. J. Neurosci. 28, 6211-6219. doi: 10.1523/JNEUROSCI.1246-08.2008
2. Andreatta, M., Mühlberger, A., Yarali, A., Gerber, B., and Pauli, P. (2010). A rift between implicit and explicit conditioned valence after pain-relief learning in humans. Proc. R. Scoc. B Biol. Sci. 277, 2411-3241. doi: 10.1098/rspb.2010.0103
3. Baas, J. M., Nugent, M., Lissek, S., Pine, D. S., and Grillon, C. (2004). Fear conditioning in virtual reality contexts: a new tool for the study of anxiety. Biol. Psychiatry 55, 1056-1060. doi: 10.1016/j.biopsych.2004.02.024
4. Baas, J. M., van Ooijen, L., Goudriaan, A., and Kenemans, J. L. (2008). Failure to condition to a cue is associated with sustained contextual fear. Acta Psychol. 127, 581-592. doi: 10.1016/j.actpsy.2007.09.009
5. Bellgowan, P. S., Bandettini, P. A., van Gelderen, P., Martin, A., and Bodurka, J. (2006). Improved BOLD detection in the medial temporal region using parallel imaging and voxel volume reduction. Neuroimage 29, 1244-1251. doi: 10.1016/j.neuroimage.2005.08.042
6. Bouton, M. E. (2002). Context, ambiguity, and unlearning: sources of relapse after behavioral extinction. Biol. Psychiatry 52, 976-986. doi: 10.1016/S0006-3223(02)01546-9
7. Bouton, M. E. (2004). Context and behavioral processes in extinction. Learn. Mem. 11, 485-494. doi: 10.1101/lm.78804
8. Büchel, C., Dolan, R. J., Armony, J. L., and Friston, K. J. (1999). Amygdala-hippocampal involvement in human aversive trace conditioning revealed through event-related functional magnetic resonance imaging. J. Neurosci. 19, 10869-10876.
9. Büchel, C., Morris, J., Dolan, R. J., and Friston, K. J. (1998). Brain systems mediating aversive conditioning: an event-related fMRI study. Neuron 20, 947-957. doi: 10.1016/S0896-6273(00)80476-6
10. Cheng, D. T., Disterhoft, J. F., Power, J. M., Ellis, D. A., and Desmond, J. E. (2008). Neural substrates underlying human delay and trace eyeblink conditioning. Proc. Natl. Acad. Sci. U.S.A. 105, 8108-8113. doi: 10.1073/pnas.0800374105
11. Clark, R. E., Manns, J. R., and Squire, L. R. (2002). Classical conditioning, awareness, and brain systems. Trends Cogn. Sci. 6, 524-531. doi: 10.1016/S1364-6613(02)02041-7
12. Coghill, R. C., Talbot, J. D., Evans, A. C., Meyer, E., Gjedde, A., Bushell, M. C., et al. (1994). Distributed processing of pain and vibration by the human brain. J. Neurosci. 14, 4095-4108.
13. Craig, A. D. (2010). Once an island, now the focus of attention. Brain Struct. Funct. 214, 395-396. doi: 10.1007/s00429-010-0270-0
14. D'Esposito, M., Postle, B. R., Ballard, D., and Lease, J. (1999). Maintenance versus manipulation of information held in working memory: an event-related fMRI study. Brain Cogn. 41, 66-86.
15. D'Esposito, M., Postle, B. R., and Rypma, B. (2000). Prefrontal cortical contributions toworking memory: evidence from event-related fMRI studies. Exp. Brain Res. 133, 3-11. doi: 10.1007/s002210000395
16. Delgado, M. R. (2007). Reward-related responses in the human striatum. Ann. N.Y. Acad. Sci. 1104, 70-88. doi: 10.1196/annals.1390.002
17. Delgado, M. R., Li, J., Schiller, D., and Phelps, E. A. (2008). The role of the striatum in aversive learning and aversive prediction errors. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363, 3787-3800. doi: 10.1098/rstb.2008.0161
18. Evans, A. C., Marrett, S., Nkelin, P., Collins, L., Worsley, K., Dai, W., et al. (1992). Anatomical mapping of functional activation in stereotactic coordinate space. Neuroimage 1, 43-53. doi: 10.1016/1053-8119(92)90006-9
19. Glotzbach, E., Ewald, H., Andreatta, M., Pauli, P., and Mühlberger, A. (2012). Contextual fear conditioning predicts subsequent avoidance behavior in a virtual reality environment. Cogn. Emot. 26, 1256-1272. doi: 10.1080/02699931.2012.656581
20. Gottfried, J. A., and Dolan, R. J. (2004). Human orbitofrontal cortex mediates extinction learning while accessing conditioned representations of value. Nat. Neurosci. 7, 1144-1152. doi: 10.1038/nn1314
21. Han, C. J., O'Tuathaigh, C. M., van Trigt, L., Quinn, J. J., Fanselow, M. S., Mangeau, R., et al. (2003). Trace but not delay fear conditioning requires attention and anterior cingulate cortex. Proc. Natl. Acad. Sci. U.S.A. 100, 13087-13092. doi: 10.1073/pnas.2132313100
22. Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., and Kapur, S. (2003). Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 40, 1251-1257. doi: 10.1016/S0896-6273(03)00724-4
23. Kalisch, R., Korenfeld, E., Stephan, K. E., Weiskopf, N., Seymour, B., and Dolan, R. J. (2006). Context-dependent human extinction memory is mediated by a ventromedial prefrontal and hippocampal network. J. Neurosci. 26, 9503-9511. doi: 10.1523/JNEUROSCI.2021-06.2006
24. Kiebel, S., and Holmes, A. P. (2003). "The general linear model, " in Human Brain Function, eds S. Zeki, J. T. Ashburner, W. D. Penny, R. S. J. Frackowiak, K. J. Friston, C. D. Frith, et al. (Oxford: Academic Press), 725-760.
25. Klucken, T., Kagerer, S., Schwenckendiek, J., Tabbert, K., Vaitl, D., and Stark, R. (2009). Contingency learning in human fear conditioning involves the ventral striatum. Hum. Brain Mapp. 30, 3636-3644. doi: 10.1002/hbm.20791
26. Knight, D. C., Smith, C. N., Cheng, D. T., Stein, E. A., and Helmstetter, F. J. (2004). Amygdala and hippocampal activity during acquisition and extinction of human fear conditioning. Cogn. Affect. Behav. Neurosci. 4, 317-325. doi: 10.3758/CABN.4.3.317
27. LaBar, K. S., Gatenby, J. C., Gore, J. C., LeDoux, J. E., and Phelps, E. A. (1998). Human amygdala activation during conditioned fear acquisition and extinction: a mixed-trial fMRI study. Neuron 20, 937-945. doi: 10.1016/S0896-6273(00)80475-4
28. Lebron, K., Milad, M. R., and Quirk, G. J. (2004). Delayed recall of fear extinction in rats with lesions of ventral medial prefrontal cortex. Learn. Mem. 11, 544-548. doi: 10.1101/lm.78604
29. LeDoux, J. E. (2000). Emotion circuits in the brain. Annu. Rev. Neurosci. 23, 155-184. doi: 10.1146/annurev.neuro.23.1.155
30. Maldjian, J. A., Laurienti, P. J., Kraft, R. A., and Burdette, J. H. (2003). An automated method for neuroanatomic and cytoarchitectonic atlas-based interro gation of fMRI data sets. Neuroimage 19, 1233-1239. doi: 10.1016/S1053-8119(03)00169-1
31. Manns, J. R., Clark, R. E., and Squire, L. (2001). Single-cue delay eyeblink conditioning is unrelated to awareness. Cogn. Affect. Behav. Neurosci. 1, 192-198. doi: 10.3758/CABN.1.2.192
32. Milad, M. R., Quinn, B. T., Pitman, R. K., Orr, S. P., Fischl, B., and Rauch, S. L. (2005). Thickness of ventromedial prefrontal cortex in humans is correlated with extinction memory. Proc. Natl. Acad. Sci. U.S.A. 102, 10706-10711. doi: 10.1073/pnas.0502441102
33. Milad, M. R., and Quirk, G. J. (2002). Neurons in medial prefrontal cortex signal memory for fear extinction. Nature 420, 70-74. doi: 10.1038/nature01138
34. Milad, M. R., Wright, C. I., Orr, S. P., Pitman, R. K., Quirk, G. J., and Rauch, S. L. (2007). Recall of fear extinction in humans activates the ventromedial prefrontal cortex and hippocampus in concert. Biol. Psychiatry 62, 446-454. doi: 10.1016/j.biopsych.2006.10.011
35. Morgan, M. A., and LeDoux, J. E. (1993). Differential contribution of dorsal and ventral medial prefrontal cortex to the acquisition and extinction of conditioned fear in rats. Behav. Neurosci. 109, 681-688. doi: 10.1037/0735-7044.109.4.681
36. Morgan, M. A., Schulkin, J., and LeDoux, J. E. (2003). Ventral medial prefrontal cortex and emotional perseveration: the memory for prior extinction training. Behav. Brain Res. 146, 121-130. doi: 10.1016/j.bbr.2003.09.021
37. Mühlberger, A., Bülthoff, H. H., Wiedemann, G., and Pauli, P. (2007a). Virtual reality for the psychophysiological assessment of phobic fear: responses during virtual tunnel driving. Psychol. Assess. 19, 340-346. doi: 10.1037/1040-3590.19.3.340
38. Mühlberger, A., Neumann, R., Wieser, M. J., and Pauli, P. (2008b). The impact of changes in spatial distance on emotional responses. Emotion 8, 192-198. doi: 10.1037/1528-3542.8.2.192
39. Mühlberger, A., Weik, A., Pauli, P., and Wiedemann, G. (2006). One-session virtual reality exposure treatment for fear of flying: 1-Year follow-up and graduation flight accompaniment effects. Psychother. Res. 16, 26-40. doi: 10.1080/10503300500090944
40. Mühlberger, A., Wieser, M. J., Kenntner-Mabiala, R., Pauli, P., and Wiederhold, B. K. (2007b). Pain modulation during drives through cold and hot virtual environments. Cyberpsychol. Behav. 10, 516-522. doi: 10.1089/cpb.2007.9996
41. Mühlberger, A., Wieser, M. J., and Pauli, P. (2008a). Darkness-enhanced startle responses in ecologically valid environments: a virtual tunnel driving experiment. Biol. Psychol. 77, 47-52. doi: 10.1016/j.biopsycho.2007.09.004
42. Myers, K. M., and Davis, M. (2002). Behavioral and neural analysis of extinction. Neuron 36, 567-584. doi: 10.1016/S0896-6273(02)01064-4
43. O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., and Andrews, C. (2001). Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4, 95-102. doi: 10.1038/82959
44. O'Keefe, J., and Dostrovsky, J. (1971). The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res. 34, 171-175. doi: 10.1016/0006-8993(71)90358-1
45. Pavlov, I. P. (1927). Conditioned Reflexes. Oxford: Oxford University Press.
46. Phelps, E. A., Delgado, M. R., Nearing, K. I., and LeDoux, J. E. (2004). Extinction learning in humans: role of the amygdala and vmPFC. Neuron 43, 897-905. doi: 10.1016/j.neuron.2004.08.042
47. Phelps, E. A., O'Connor, K. J., Gatenby, J. C., Gore, J. C., Grillon, C., and Davis, M. (2001). Activation of the left amygdala to a cognitive representation of fear. Nat. Neurosci. 4, 437-441. doi: 10.1038/86110
48. Phillips, R. G., and LeDoux, J. E. (1992). Differential contribution of Amygdala and Hippocampus to cued and contextual fear conditioning. Behav. Neurosci. 106, 274-285. doi: 10.1037/0735-7044.106.2.274
49. Ploghaus, A., Tracey, I., Gati, J. S., Clare, S., Menon, R. S., Matthews, P. M., et al. (1999). Dissociating pain from its anticipation in the human brain. Science 284, 1979-1981. doi: 10.1126/science.284.5422.1979
50. Postle, B. R., Berger, J. S., and D'Esposito, M. (1999). Functional neuroanatomical double dissociation of mnemonic and executive control processes contributing to working memory performance. Proc. Natl. Acad. Sci. U.S.A. 96, 12959-12964. doi: 10.1073/pnas.96.22.12959
51. Quirk, G. J. (2002). Memory for extinction of conditioned fear is long-lasting and persists following spontaneous recovery. Learn. Mem. 9, 402-407. doi: 10.1101/lm.49602
52. Quirk, G. J., Gonzalez-Lima, F., and Garcia, R. (2006). Prefrontal mechanisms in extinction of conditioned fear. Biol. Psychiatry 60, 337-343. doi: 10.1016/j.biopsych.2006.03.010
53. Quirk, G. J., Russo, G. K., Barron, J. L., and Lebron, K. (2000). The role of ventromedial prefrontal cortex in the recovery of extinguished fear. J. Neurosci. 20, 6225-6231.
54. Raczka, K. A., Mechias, M. L., Gartmann, N., Reif, A., Deckert, J., Pessiglione, M., et al. (2011). Empirical support for an involvement of the mesostriatal dopamine system in human fear extinction. Transl. Psychiatry 1:e12. doi: 10.1038/tp.2011.10
55. Rauch, S. L., Shin, L. M., and Phelps, E. A. (2006). Neurocircuitry models of posttraumatic stress disorder and extinction: human neuroimaging research-past, present, and future. Biol. Psychiatry 60, 376-382. doi: 10.1016/j.biopsych.2006.06.004
56. Schiller, D., Levy, I., Niv, Y., LeDoux, J. E., and Phelps, E. (2008). From fear to safety and back: reversal of fear in the human brain. J. Neurosci. 28, 11517-11525. doi: 10.1523/JNEUROSCI.2265-08.2008
57. Schiller, D., Raio, C. M., and Phelps, E. A. (2012). Extincion training during the reconsolidation window prevents recovery of fear. J. Vis. Exp. 24:e3893. doi: 10.3791/3893
58. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599. doi: 10.1126/science.275.5306.1593
59. Sehlmeyer, C., Schöning, S., Zwitserlood, P., Pfleiderer, B., Kirchner, T., Arolt, V., et al. (2009). Human fear conditioning and extinction in neuroimaging: a systematic review. PLoS ONE 4:e5865. doi: 10.1371/journal.pone.0005865
60. Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., and Friston, K. (2005). Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat. Neurosci. 8, 1234-1240. doi: 10.1038/nn1527
61. Sotres-Bayon, F., Bush, D. E., and LeDoux, J. E. (2004). Emotional perseveration: an update on prefrontal-amygdala interactions in fear extinction. Learn. Mem. 11, 525-535. doi: 10.1101/lm.79504
62. Sotres-Bayon, F., Bush, D. E., and LeDoux, J. E. (2007). Acquisition of fear extinction requires activation of NR2B-containing NMDA receptors in the lateral amygdala. Neuropsychopharmacology 32, 1929-1940. doi: 10.1038/sj.npp.1301316
63. Stocker, T., Kellermann, T., Schneider, F., Habel, U., Amunts, K., Pieperhoff, P., et al. (2006). Dependence of amygdala activation on echo time: results from olfactory fMRI experiments. Neuroimage 30, 151-159. doi: 10.1016/j.neuroimage.2005.09.050
64. Tabbert, K., Merz, C. J., Klucken, T., Schwenckendiek, J., Vaitl, D., Wolf, O. T., et al. (2011). Influence of contingency awareness on neural, electrodermal and evaluative responses during fear conditioning. Soc. Cogn. Affect. Neurosci. 6, 495-506. doi: 10.1093/scan/nsq070
65. Tröger, C., Ewald, H., Glotzbach, E., Pauli, P., and Mühlberger, A. (2012). Does pre-exposure inhibit fear context conditioning? A virtual reality study. J. Neural Transm. 119, 709-719. doi: 10.1007/s00702-011-0757-8
66. Weike, A. I., Schupp, H. T., and Hamm, A. O. (2007). Fear acquisition requires awareness in trace but not delay conditioning. Psychophysiology 44, 170-180. doi: 10.1111/j.1469-8986.2006.00469.x
67. Weiss, C., and Disterhoft, J. F. (2011). Exploring prefrontal cortical memory with eyeblink conditioning. Behav. Neurosci. 125, 318-326. doi: 10.1037/a0023520
68. Wiech, K., Lin, C., Brodersen, K. H., Bingel, U., Ploner, M., and Tracey, I. (2010). Anterior insula integrates information about salience into perceptual decisions about pain. J. Neurosci. 30, 16324-16331. doi: 10.1523/JNEUROSCI.2087-10.2010
69. Yaguez, L., Coen, S., Gregory, L. J., Amaro, E. Jr., Altman, C., Brammer, M. J., et al. (2005). Brain response to visceral aversive conditioning: a functional magnetic resonance imaging study. Gastroenterology 128, 1819-1829. doi: 10.1053/j.gastro.2005.02.068