The Perception of Dynamic and Static Facial Expressions of Happiness and Disgust Investigated by ERPs and fMRI Constrained Source Analysis

PLoS ONE

Volumn 8, Issue 6, 2013, Pages

  Trautmann Lengsfeld, Sina Alexa ^a,b   Domínguez Borràs, Judith ^c,d   Escera, Carles ^c,e   Herrmann, Manfred ^a   Fehr, Thorsten ^a,f  

^a UNIVERSITY OF BREMEN   (Germany)

^b UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

^c UNIVERSITY OF BARCELONA   (Spain)

^d UNIVERSITY OF GENEVA MEDICAL SCHOOL   (Switzerland)

^e Hanse Wissenschaftskolleg   (Germany)

^f OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ADOLESCENT; ADULT; ARTICLE; BRAIN DEPTH STIMULATION; BRAIN REGION; DISGUST; DYNAMICS; ELECTROENCEPHALOGRAPHY; EMOTION; EVENT RELATED POTENTIAL; FACIAL EXPRESSION; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM GYRUS; HAPPINESS; HUMAN; HUMAN EXPERIMENT; NERVE CELL NETWORK; NEUROMODULATION; NORMAL HUMAN; PATTERN RECOGNITION; PERCEPTION; SPATIOTEMPORAL ANALYSIS; VENTROMEDIAL PREFRONTAL CORTEX; VISION;

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EMOTIONS; EVOKED POTENTIALS; FACE; FACIAL EXPRESSION; FEMALE; HAPPINESS; HUMANS; KINETICS; MAGNETIC RESONANCE IMAGING; PHOTIC STIMULATION; TIME FACTORS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84879259964     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0066997     Document Type: Article

References (69)

1. Adolphs R, (2002) Recognizing emotion from facial expressions: psychological and neurological mechanisms. Behav Cogn Neurosci Rev 1: 21-62.
2. Posamentier MT, Abdi H, (2003) Processing faces and facial expressions. Neuropsychol Rev 13: 113-143.
3. Vuilleumier P, Pourtois G, (2007) Distributed and interactive brain mechanisms during emotion face perception: evidence from functional neuroimaging. Neuropsychologia 45: 174-194 doi:10.1016/j.neuropsychologia.2006.06.003.
4. Hasselmo ME, Rolls ET, Baylis GC, (1989) The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behav Brain Res 32: 203-218.
5. Allison T, Puce A, Spencer DD, McCarthy G, (1999) Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cereb Cortex 9: 415-430.
6. Batty M, Taylor MJ, (2003) Early processing of the six basic facial emotional expressions. Brain Res Cogn Brain Res 17: 613-620.
7. Blau VC, Maurer U, Tottenham N, McCandliss BD, (2007) The face-specific N170 component is modulated by emotional facial expression. Behav Brain Funct 3: 7 doi:10.1186/1744-9081-3-7.
8. Williams LM, Palmer D, Liddell BJ, Song L, Gordon E, (2006) The "when" and "where" of perceiving signals of threat versus non-threat. Neuroimage 31: 458-467 doi:10.1016/j.neuroimage.2005.12.009.
9. Ashley V, Vuilleumier P, Swick D, (2004) Time course and specificity of event-related potentials to emotional expressions. Neuroreport 15: 211-216.
10. Schupp HT, Ohman A, Junghöfer M, Weike AI, Stockburger J, et al. (2004) The facilitated processing of threatening faces: an ERP analysis. Emotion 4: 189-200 doi:10.1037/1528-3542.4.2.189.
11. Eimer M, Holmes A, McGlone FP, (2003) The role of spatial attention in the processing of facial expression: an ERP study of rapid brain responses to six basic emotions. Cogn Affect Behav Neurosci 3: 97-110.
12. Recio G, Sommer W, Schacht A, (2011) Electrophysiological correlates of perceiving and evaluating static and dynamic facial emotional expressions. Brain Res 1376: 66-75 doi:10.1016/j.brainres.2010.12.041.
13. Pizzagalli DA, Lehmann D, Hendrick AM, Regard M, Pascual-Marqui RD, et al. (2002) Affective judgments of faces modulate early activity (approximately 160 ms) within the fusiform gyri. Neuroimage 16: 663-677.
14. Sprengelmeyer R, Jentzsch I, (2006) Event related potentials and the perception of intensity in facial expressions. Neuropsychologia 44: 2899-2906 doi:10.1016/j.neuropsychologia.2006.06.020.
15. Cornwell BR, Carver FW, Coppola R, Johnson L, Alvarez R, et al. (2008) Evoked amygdala responses to negative faces revealed by adaptive MEG beamformers. Brain Res 1244: 103-112 doi:10.1016/j.brainres.2008.09.068.
16. Halgren E, Raij T, Marinkovic K, Jousmäki V, Hari R, (2000) Cognitive response profile of the human fusiform face area as determined by MEG. Cereb Cortex 10: 69-81.
17. Hung Y, Smith ML, Bayle DJ, Mills T, Cheyne D, et al. (2010) Unattended emotional faces elicit early lateralized amygdala-frontal and fusiform activations. Neuroimage 50: 727-733 doi:10.1016/j.neuroimage.2009.12.093.
18. Lewis S, Thoma RJ, Lanoue MD, Miller GA, Heller W, et al. (2003) Visual processing of facial affect. Neuroreport 14: 1841-1845 doi:10.1097/01.wnr.0000089133.26479.ec.
19. Streit M, Ioannides AA, Liu L, Wölwer W, Dammers J, et al. (1999) Neurophysiological correlates of the recognition of facial expressions of emotion as revealed by magnetoencephalography. Brain Res Cogn Brain Res 7: 481-491.
20. Junghöfer M, Bradley MM, Elbert TR, Lang PJ, (2001) Fleeting images: a new look at early emotion discrimination. Psychophysiology 38: 175-178.
21. Schupp HT, Junghöfer M, Weike AI, Hamm AO, (2003) Emotional facilitation of sensory processing in the visual cortex. Psychol Sci 14: 7-13.
22. Sabatinelli D, Lang PJ, Keil A, Bradley MM, (2007) Emotional perception: correlation of functional MRI and event-related potentials. Cereb Cortex 17: 1085-1091 doi:10.1093/cercor/bhl017.
23. Hopfinger J, Khoe W, Song A (2005) Combining Electrophysiology with structural and functional Neuroimaging: ERP's, PET, MRI, fMRI. Event-Related Potentials. A Methods Handbook. Cambridge, Massachusetts, London, England: The MIT Press.
24. Michel CM, Murray MM, Lantz G, Gonzalez S, Spinelli L, et al. (2004) EEG source imaging. Clin Neurophysiol 115: 2195-2222 doi:10.1016/j.clinph.2004.06.001.
25. Scherg M, Berg P, (1991) Use of prior knowledge in brain electromagnetic source analysis. Brain Topogr 4: 143-150.
26. Im C-H, (2007) Dealing with mismatched fMRI activations in fMRI constrained EEG cortical source imaging: a simulation study assuming various mismatch types. Med Biol Eng Comput 45: 79-90 doi:10.1007/s11517-006-0142-1.
27. Trautmann SA, Fehr T, Herrmann M, (2009) Emotions in motion: dynamic compared to static facial expressions of disgust and happiness reveal more widespread emotion-specific activations. Brain Res 1284: 100-115 doi:10.1016/j.brainres.2009.05.075.
28. Ambadar Z, (2005) Schooler JW, Cohn JF (2005) Deciphering the enigmatic face: the importance of facial dynamics in interpreting subtle facial expressions. Psychol Sci 16: 403-410 doi:10.1111/j.0956-7976.2005.01548.x.
29. Gepner B, Deruelle C, Grynfeltt S, (2001) Motion and emotion: a novel approach to the study of face processing by young autistic children. J Autism Dev Disord 31: 37-45.
30. Harwood NK, Hall LJ, Shinkfield AJ, (1999) Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation. Am J Ment Retard 104: 270-278 doi:;10.1352/0895-8017(1999)104<0270:ROFEEF>2.0.CO;2.
31. LaBar KS, Crupain MJ, Voyvodic JT, McCarthy G, (2003) Dynamic perception of facial affect and identity in the human brain. Cereb Cortex 13: 1023-1033.
32. Sato W, Kochiyama T, Yoshikawa S, Naito E, Matsumura M, (2004) Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study. Brain Res Cogn Brain Res 20: 81-91 doi:10.1016/j.cogbrainres.2004.01.008.
33. Fichtenholtz HM, Hopfinger JB, Graham R, Detwiler JM, LaBar KS, (2009) Event-related potentials reveal temporal staging of dynamic facial expression and gaze shift effects on attentional orienting. Soc Neurosci 4: 317-331 doi:10.1080/17470910902809487.
34. Mayes AK, Pipingas A, Silberstein RB, Johnston P, (2009) Steady state visually evoked potential correlates of static and dynamic emotional face processing. Brain Topogr 22: 145-157 doi:10.1007/s10548-009-0106-5.
35. Lange K, Williams LM, Young AW, Bullmore ET, Brammer MJ, et al. (2003) Task instructions modulate neural responses to fearful facial expressions. Biol Psychiatry 53: 226-232.
36. Werheid K, Alpay G, Jentzsch I, Sommer W, (2005) Priming emotional facial expressions as evidenced by event-related brain potentials. Int J Psychophysiol 55: 209-219 doi:10.1016/j.ijpsycho.2004.07.006.
37. Oldfield RC, (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9: 97-113.
38. Domínguez-Borràs J, Trautmann S-A, Erhard P, Fehr T, Herrmann M, et al. (2009) Emotional context enhances auditory novelty processing in superior temporal gyrus. Cereb Cortex 19: 1521-1529 doi:10.1093/cercor/bhn188.
39. Kemp AH, Silberstein RB, Armstrong SM, Nathan PJ, (2004) Gender differences in the cortical electrophysiological processing of visual emotional stimuli. Neuroimage 21: 632-646 doi:10.1016/j.neuroimage.2003.09.055.
40. Hofer A, Siedentopf CM, Ischebeck A, Rettenbacher MA, Verius M, et al. (2007) Sex differences in brain activation patterns during processing of positively and negatively valenced emotional words. Psychol Med 37: 109-119 doi:10.1017/S0033291706008919.
41. Goldstein JM, Seidman LJ, Horton NJ, Makris N, Kennedy DN, et al. (2001) Normal sexual dimorphism of the adult human brain assessed by in vivo magnetic resonance imaging. Cereb Cortex 11: 490-497.
42. Canli T, Desmond JE, Zhao Z, Gabrieli JDE, (2002) Sex differences in the neural basis of emotional memories. Proc Natl Acad Sci USA 99: 10789-10794 doi:10.1073/pnas.162356599.
43. Friston KJ, Zarahn E, Josephs O, Henson RN, Dale AM, (1999) Stochastic designs in event-related fMRI. Neuroimage 10: 607-619 doi:10.1006/nimg.1999.0498.
44. Luck S (2005) An introduction to the event-related potential technique. Cambridge, MA: MIT Press.
45. Bledowski C, Cohen Kadosh K, Wibral M, Rahm B, Bittner RA, et al. (2006) Mental chronometry of working memory retrieval: a combined functional magnetic resonance imaging and event-related potentials approach. J Neurosci 26: 821-829 doi:10.1523/JNEUROSCI.3542-05.2006.
46. Scherg M, Berg P (1996) New concepts of brain source imaging and localization. Electroencephalogr Clin Neurophysiol Suppl 46: 127-137.
47. Scherg M, Von Cramon D, (1986) Evoked dipole source potentials of the human auditory cortex. Electroencephalogr Clin Neurophysiol 65: 344-360.
48. Scherg M, Picton TW (1991) Separation and identification of event-related potential components by brain electric source analysis. Electroencephalogr Clin Neurophysiol Suppl 42: 24-37.
49. Wibral M, Turi G, Linden DEJ, Kaiser J, Bledowski C, (2008) Decomposition of working memory-related scalp ERPs: crossvalidation of fMRI-constrained source analysis and ICA. Int J Psychophysiol 67: 200-211 doi:10.1016/j.ijpsycho.2007.06.009.
50. Vanni S, Warnking J, Dojat M, Delon-Martin C, Bullier J, et al. (2004) Sequence of pattern onset responses in the human visual areas: an fMRI constrained VEP source analysis. Neuroimage 21: 801-817 doi:10.1016/j.neuroimage.2003.10.047.
51. Allison Puce, (2000) McCarthy (2000) Social perception from visual cues: role of the STS region. Trends Cogn Sci (Regul Ed) 4: 267-278.
52. Eimer M, Holmes A, (2002) An ERP study on the time course of emotional face processing. Neuroreport 13: 427-431.
53. Bruce V, Young A, (1986) Understanding face recognition. Br J Psychol 77 (Pt 3): 305-327.
54. Leppänen JM, Kauppinen P, Peltola MJ, Hietanen JK, (2007) Differential electrocortical responses to increasing intensities of fearful and happy emotional expressions. Brain Res 1166: 103-109 doi:10.1016/j.brainres.2007.06.060.
55. Amaral DG, Behniea H, Kelly JL, (2003) Topographic organization of projections from the amygdala to the visual cortex in the macaque monkey. Neuroscience 118: 1099-1120.
56. Kanwisher N, McDermott J, Chun MM, (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 17: 4302-4311.
57. Kanwisher N, Yovel G, (2006) The fusiform face area: a cortical region specialized for the perception of faces. Philos Trans R Soc Lond, B, Biol Sci 361: 2109-2128 doi:10.1098/rstb.2006.1934.
58. Buccino G, Binkofski F, Fink GR, Fadiga L, Fogassi L, et al. (2001) Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur J Neurosci 13: 400-404.
59. Leslie KR, Johnson-Frey SH, Grafton ST, (2004) Functional imaging of face and hand imitation: towards a motor theory of empathy. Neuroimage 21: 601-607 doi:10.1016/j.neuroimage.2003.09.038.
60. Rizzolatti G, Fogassi L, Gallese V, (2001) Neurophysiological mechanisms underlying the understanding and imitation of action. Nat Rev Neurosci 2: 661-670 doi:10.1038/35090060.
61. Lane RD, Reiman EM, Ahern GL, Schwartz GE, Davidson RJ, (1997) Neuroanatomical correlates of happiness, sadness, and disgust. Am J Psychiatry 154: 926-933.
62. O'Doherty J, Winston J, Critchley H, Perrett D, Burt DM, et al. (2003) Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia 41: 147-155.
63. Ekman P, Friesen WV, O'Sullivan M, Chan A, Diacoyanni-Tarlatzis I, et al. (1987) Universals and cultural differences in the judgments of facial expressions of emotion. J Pers Soc Psychol 53: 712-717.
64. Ekman P, Friesen WV, Ellsworth P (1972) Emotion in the Human Face. New York: Pergamon.
65. Biele C, Grabowska A, (2006) Sex differences in perception of emotion intensity in dynamic and static facial expressions. Exp Brain Res 171: 1-6 doi:10.1007/s00221-005-0254-0.
66. Simons RF, Detenber BH, Roedema TM, Reiss JE, (1999) Emotion processing in three systems: the medium and the message. Psychophysiology 36: 619-627.
67. Fehr T, Strüber D, Herrmann M, Roth G (2007) Neural Correlates of Perceiving Aggressive Behavior. Topics in Advanced Neuroimaging. Oldenburg: bis-Publishers. 27-30.
68. Hasson U, Nir Y, Levy I, Fuhrmann G, Malach R, (2004) Intersubject synchronization of cortical activity during natural vision. Science 303: 1634-1640 doi:10.1126/science.1089506.
69. Regenbogen C, Herrmann M, Fehr T, (2010) The neural processing of voluntary completed, real and virtual violent and nonviolent computer game scenarios displaying predefined actions in gamers and nongamers. Soc Neurosci 5: 221-240 doi:10.1080/17470910903315989.