Recognizing dynamic facial expressions of emotion: Specificity and intensity effects in event-related brain potentials

Biological Psychology

Volumn 96, Issue 1, 2014, Pages 111-125

  Recio, Guillermo ^a,b   Schacht, Annekathrin ^c   Sommer, Werner ^a  

^a HUMBOLDT UNIVERSITY   (Germany)

^b UNIVERSITY OF ULM   (Germany)

^c UNIVERSITY OF GÖTTINGEN   (Germany)

Author keywords

Dynamic facial expressions; Event related potentials; Intensity; Rise time; Selective attention

Indexed keywords

ADULT; AMPLITUDE MODULATION; ANGER; ARTICLE; BRAIN FUNCTION; DISGUST; EMOTION; EVENT RELATED POTENTIAL; FACIAL EXPRESSION; FACILITATION; FEAR; FEMALE; HAPPINESS; HUMAN; HUMAN EXPERIMENT; MALE; NEUROMODULATION; NEUTRAL EMOTION; NORMAL HUMAN; PRIORITY JOURNAL; RESPONSE TIME; SADNESS; STATISTICAL ANALYSIS; STIMULUS RESPONSE; TASK PERFORMANCE;

DYNAMIC FACIAL EXPRESSIONS; EVENT-RELATED POTENTIALS; INTENSITY; RISE TIME; SELECTIVE ATTENTION;

ADULT; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EMOTIONS; EVOKED POTENTIALS; FACIAL EXPRESSION; FEMALE; HUMANS; MALE; NONLINEAR DYNAMICS; PHOTIC STIMULATION; PSYCHOPHYSICS; REACTION TIME; RECOGNITION (PSYCHOLOGY); YOUNG ADULT;

EID: 84891640777     PISSN: 03010511     EISSN: 18736246     Source Type: Journal    
DOI: 10.1016/j.biopsycho.2013.12.003     Document Type: Article

References (72)

1. Abrosoft FantaMorph (version 5.0) 2010, [computer software].
2. Adolphs R. Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews 2002, 1:21-61. 10.1177/1534582302001001003.
3. Ambadar Z., Schooler J.W., Cohn J.F. Deciphering the enigmatic face. The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science 2005, 16:403-410. 10.1111/j.0956-7976.2005.01548.x.
4. Arsalidou M., Morris D., Taylor M.J. Converging for the advantage of dynamic facial expressions. Brain Topography 2011, 24:149-163. 10.1007/s10548-011-0171-4.
5. Ashley V., Vuilleumier P., Swick D. Time course and specificity of event-related potentials to emotional expressions. NeuroReport 2004, 15:211-216. 10.1097/00001756-200401190-00041.
6. Balconi M., Pozzoli U. Face-selective processing and the effect of pleasant and unpleasant emotional expressions on ERP correlates. International Journal of Psychophysiology 2003, 49:67-74. 10.1016/S0167-8760(03)00081-3.
7. Barrett L.F. Constructing emotion. Psychological Topics 2011, 3:359-380.
8. Bassili J.N. Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology: Human Perception and Performance 1978, 4:373-379. 10.1037/0096-1523.4.3.373.
9. Batty M., Taylor M.J. Early processing of the six basic facial emotional expressions. Cognitive Brain Research 2003, 17:613-620. 10.1016/S0926-6410(03)00174-5.
10. Biele C., Grabowska A. Sex differences in perception of emotion intensity in dynamic and static facial expressions. Experimental Brain Research 2006, 171:1-6. 10.1007/s00221-005-0254-0.
11. Bould E., Morris N., Wink B. Recognising subtle emotional expressions: The role of facial movements. Cognition and Emotion 2008, 22:1569-1587. 10.1080/02699930801921156.
12. Bruce V., Young A. Understanding face recognition. British Journal of Psychology 1986, 77:305-327. 10.1111/j.2044-8295.1986.tb02199.x.
13. Calder A.J., Rowland D., Young A.W., Nimmo-Smith I., Keane J., Perrett D.I. Caricaturing facial expressions. Cognition 2000, 76:105-146. 10.1016/S0010-0277(00)00074-3.
14. Carroll J.M., Russell J.A. Facial expressions in Hollywood's portrayal of emotion. Journal of Personality and Social Psychology 1997, 72:164-176.
15. Carver C.S., Harmon-Jones E. Anger is an approach-related affect: Evidence and implications. Psychological Bulletin 2009, 135(2):183-204. 10.1037/a0013965.
16. Cunningham D.W., Wallraven C. Dynamic information for the recognition of conversational expressions. Journal of Vision 2009, 9:1-17. 10.1167/9.13.7.
17. Darwin C. The expression of the emotions in man and animals 1872/1998, Oxford University Press, New York. 3rd ed. P. Ekman (Ed.).
18. Eimer M. The face-sensitive N170 component of the event-related brain potential. Oxford handbook of face perception 2011, 329-344. Oxford University Press, Oxford. A.J. Calder, G. Rhodes, M.H. Johnson, J.V. Haxby (Eds.).
19. Eimer M., Holmes A., McGlone F. The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions. Cognitive, Affective, & Behavioral Neuroscience 2003, 3:97-110. 10.3758/CABN.3.2.97.
20. Ekman P., Friesen W. Constants across cultures in the face and emotion. Journal of Personality and Social Psychology 1971, 17:124-129. 10.1037/h0030377.
21. Ekman P., Friesen W., Ellsworth P. Emotion in the human face: Guidelines for research and an integration of findings 1972, Pergamon, New York.
22. Faul F., Erdfelder E., Lang A.G., Buchner A. Gz.ast;Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods 2007, 39:175-191. 10.3758/BF03193146.
23. Fusar-Poli P., Placentino A., Carletti F., Landi P., Allen P., Surguladze S., et al. Functional atlas of emotional faces processing: A voxel-based meta-analysis of 105 functional magnetic resonance imaging studies. Journal Psychiatry Neuroscience 2009, 34:418-432.
24. Haxby J.V., Hoffman E.A., Gobbini M.I. The distributed human neural system for face perception. Trends in Cognitive Sciences 2000, 4:223-233. 10.1016/S1364-6613(00)01482-0.
25. Horstmann G., Ansorge U. Visual search for facial expressions of emotions: A comparison of dynamic and static faces. Emotion 2009, 9:29-38. 10.1037/a0014147.
26. Itier R.J., Taylor M.J. N170 or N1? Spatiotemporal differences between object and face processing using ERPs. Cerebral Cortex 2004, 14:132-142. 10.1093/cercor/bhg111.
27. Izmailov C.A., Korshunova S.G., Sokolov E.N. Relationship between visual evoked potentials and subjective differences between emotional expressions in "face diagrams". Neuroscience and Behavioral Physiology 2001, 31:529-538. 10.1023/A: 1010431116303.
28. Johnston P.J., Katsikitis M., Carr V.J. A generalised deficit can account for problems in facial emotion recognition in schizophrenia. Biological Psychology 2001, 58:203-227. 10.1016/S0301-0511(01)00114-4.
29. Knappmeyer B., Thornton I.M., Bülthoff H.H. The use of facial motion and facial form during the processing of identity. Vision Research 2003, 43:1921-1936. 10.1016/S0042-6989(03)00236-0.
30. Lang P.J., Bradley M.M., Cuthbert B.N. Motivated attention: Affect, activation, and action. Attention and emotion: Sensory and motivational processes 1997, 97-135. Erlbaum, Mahwah. P.J. Lang, R.F. Simons, M. Balaban (Eds.).
31. Langner O., Dotsch R., Bijlstra G., Wigboldus D.H.J., Hawk S.T., van Knippenberg A. Presentation and validation of the Radboud Faces Database. Cognition and Emotion 2010, 24:1377-1388. 10.1080/02699930903485076.
32. Lehmann D., Skrandies W. Reference-free identification of components of checkerboard-evoked multichannel potential fields. Electroencephalography and Clinical Neurophysiology 1980, 48:609-621. 10.1016/0013-4694(80)90419-8.
33. Leppänen J.M., Kauppinen P.K., Peltola M.J., Hietanen J.K. Differential electrocortical responses to increasing intensities of fearful and happy emotional expressions. Brain Research 2007, 1166:103-109. 10.1016/j.brainres.2007.06.060.
34. Levenson R.W. Basic emotion questions. Emotion Review 2011, 3:379-386. 10.1177/1754073911410743.
35. Luo W., Feng W., He W., Wang N.Y., Luo Y.J. Three stages of facial expression processing: ERP study with rapid serial visual presentation. Neuroimage 2010, 49:1857-1867. 10.1016/j.neuroimage.2009.09.018.
36. McCarthy G., Wood C.C. Scalp distributions of event-related potentials: An ambiguity associated with analysis of variance models. Electroencephalography and Clinical Neurophysiology 1985, 62:203-208. 10.1016/0013-4694(85)90858-2.
37. Montgomery K.J., Seeherman K.R., Haxby J.V. The well-tempered social brain. Psychological Science 2009, 20:1211-1213. 10.1111/j.1467-9280.2009.02428.x.
38. Miyoshi M., Katayama J., Morotomi T. Face-specific N170 component is modulated by facial expressional change. NeuroReport 2004, 15:911-914. 10.1097/00001756-200404090-00035.
39. Nieuwenhuis S., Aston-Jones G., Cohen J.D. Decision making, the P3, and the locus coeruleus-norepinephrine system. Psychological Bulletin 2005, 131:510-532. 10.1037/0033-2909.131.4.510.
40. Oldfield R. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 1971, 9:97-113. 10.1016/0028-3932(71)90067-4.
41. O'Toole A.J., Roark D., Abdi H. Recognizing moving faces: A psychological and neural synthesis. Trends in Cognitive Sciences 2002, 6:261-266. 10.1016/S1364-6613(02)01908-3.
42. Palermo R., Rhodes G. Are you always on my mind? A review of how face perception and attention interact. Neuropsychologia 2007, 45:75-92. 10.1016/j.neuropsychologia.2006.04.025.
43. Panksepp J., Watt D. What is basic about basic emotions? Lasting lessons from affective neuroscience. Emotion Review 2011, 3:387-396. 10.1177/1754073911410741.
44. Picton T.W., Bentin S., Berg P., Donchin E., Hillyard S.A., Johnson J.R. Guidelines for using human event-related potentials to study cognition: Recording standards and publication criteria. Psychophysiology 2000, 37:127-152. 10.1111/1469-8986.3720127.
45. Pourtois G., Grandjean D., Sander D., Vuilleumier P. Electrophysiological correlates of rapid spatial orienting towards fearful faces. Cerebral Cortex 2004, 14:619-633. 10.1093/cercor/bhh023.
46. Pourtois G., Schettino A., Vuilleumier P. Brain mechanisms for emotional influences on perception and attention: What is magic and what is not. Biological Psychology 2012, 10.1016/j.biopsycho.2012.02.007.
47. Recio G., Schacht A., Sommer W. Classification of dynamic facial expressions of emotion presented briefly. Cognition and Emotion 2013, 10.1080/02699931.2013.794128.
48. Recio G., Sommer W., Schacht A. Electrophysiological correlates of perceiving and evaluating static and dynamic facial emotional expressions. Brain Research 2011, 1376:66-75. 10.1016/j.brainres.2010.12.041.
49. Rellecke J., Palazova M., Sommer W., Schacht A. On the automaticity of emotion processing in words and faces: Event-related brain potentials evidence from a superficial task. Brain & Cognition 2011, 77:23-32. 10.1016/j.bandc.2011.07.001.
50. Rellecke J., Sommer W., Schacht A. Does processing of emotional facial expressions depend on intention? Time-resolved evidence from event-related brain potentials. Biological Psychology 2012, 90:23-32. 10.1016/j.biopsycho.2012.02.002.
51. Richardson C., Bowers D., Bauer R., Heilman K., Leonard C.M. Digitizing the moving face during dynamic displays of emotion. Neuropsychologia 2000, 38:1028-1039. 10.1016/S0028-3932(99)00151-7.
52. Rubenstein A.J. Variation in perceived attractiveness: Differences between dynamic and static faces. Psychological Science 2005, 16:759-762. 10.1111/j.1467-9280.2005.01610.x.
53. Russell J.A. Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin 1994, 155:102-141. 10.1037//0033-2909.115.1.102.
54. Russell J.A. Core affect and the psychological construction of emotion. Psychological Review 2003, 110:145-172. 10.1037//0033-295X.110.1.145.
55. Sabatinelli D., Keil A., Frank D.W., Lang P.J. Emotional perception: Correspondence of early and late event-related potentials with cortical and subcortical functional MRI. Biological Psychology 2012, 10.1016/j.biopsycho.
56. Sarkheil P., Goebel R., Schneider F., Mathiak K. Emotion unfolded by motion: A role for parietal lobe in decoding dynamic facial expressions. Social Cognitive Affective Neuroscience 2012, 10.1093/scan/nss092.
57. Sato W., Kochiyama T., Yoshikawa S., Matsumura M. Emotional expression boosts early visual processing of the face: ERP recording and its decomposition by independent component analysis. Neuroreport 2001, 12:709-714. 10.1097/00001756-200103260-00019.
58. Sato W., Yoshikawa S. The dynamic aspects of emotional facial expressions. Cognition and Emotion 2004, 18:701-710. 10.1080/02699930341000176.
59. Sato W., Yoshikawa S. Enhanced experience of emotional arousal in response to dynamic facial expressions. Journal of Nonverbal Behavior 2007, 31:119-135. 10.1007/s10919-007-0025-7.
60. Sato W., Fujimura T., Suzuki N. Enhanced facial EMG activity in response to dynamic facial expressions. International Journal of Psychophysiology 2008, 70:70-74. 10.1016/j.ijpsycho.2008.06.001.
61. Schacht A., Adler N., Chen P., Guo T., Sommer W. Association with positive outcome induces early effects in event-related brain potentials. Biological Psychology 2012, 89:130-136. 10.1016/j.biopsycho.2011.10.001.
62. Schacht A., Sommer W. Emotions in word and face processing: Early and late cortical responses. Brain Cognition 2009, 69:538-550. 10.1016/j.bandc.2008.11.005.
63. Schupp H.T., Flaisch T., Stockburger J., Junghöfer M. Emotion and attention: Event-related brain potential studies. Understanding emotions 2006, 31-51. Elsevier, Amsterdam. G.E.S. Anders, M. Junghöfer, J. Kissler, D. Wildgruber (Eds.).
64. Schupp H.T., Öhman A., Junghöfer M., Weike A.I., Stockburger J., Hamm A.O. The facilitated processing of threatening faces: An ERP analysis. Emotion 2004, 4:189-200. 10.1037/1528-3542.4.2.189.
65. Schupp H.T., Stockburger J., Codispoti M., Junghofer M., Weike A.I., Hamm A.O. Selective visual attention to emotion. Journal of Neuroscience 2007, 27:1082-1089. 10.1523/JNEUROSCI. 3223-06.2007.
66. Sprengelmeyer R., Jentzsch I. Event related potentials and the perception of intensity in facial expressions. Neuropsychologia 2006, 44:2899-2906. 10.1016/j.neuropsychologia.2006.06.020.
67. Stolarova M., Keil A., Moratti S. Modulation of the C1 visual event-related component by conditioned stimuli: Evidence for sensory plasticity in early affective perception. Cerebral Cortex 2006, 16(6):876-887. 10.1093/cercor/bhj031.
68. Susskind J.M., Littlewort G., Bartlett M.S., Movellan J., Anderson A.K. Human & computer recognition of facial expressions of emotion. Neuropsychologia 2007, 45:152-162. 10.1016/j.neuropsychologia.2006.05.001.
69. Vytal K., Hamann S. Neuroimaging support for discrete neural correlates of basic emotions: A voxel-based meta-analysis. Journal of Cognitive Neuroscience 2010, 22:2864-2885. 10.1162/jocn.2009.21366.
70. Wagner H. On measuring performance in category judgement studies for nonverbal behaviour. Journal of Nonverbal Behaviour 1993, 17:3-28.
71. Williams L.M., Palmer D., Liddell B.J., Song L., Gordon E. The 'when' and 'where' of perceiving signals of threat versus non-threat. NeuroImage 2006, 31:458-467. 10.1016/j.neuroimage.2005.12.009.
72. Yoshikawa S., Sato W. Dynamic facial expressions of emotion induce representational momentum. Cognitive, Affective, & Behavioral Neuroscience 2008, 8:25-31. 10.3758/CABN.8.1.25.