Perceptual and affective mechanisms in facial expression recognition: An integrative review

Cognition and Emotion

Volumn 30, Issue 6, 2016, Pages 1081-1106

  Calvo, Manuel G ^a   Nummenmaa, Lauri ^b,c  

^a UNIVERSIDAD DE LA LAGUNA   (Spain)

^b AALTO UNIVERSITY   (Finland)

^c UNIVERSITY OF TURKU   (Finland)

Author keywords

Affective priming; Emotion; Facial expression; Perception; Recognition

Indexed keywords

AFFECT; ARTICLE; COGNITION; EMOTION; FACIAL EXPRESSION; FACIAL RECOGNITION; HUMAN; INFORMATION PROCESSING; NEUROPHYSIOLOGY; PERCEPTION; PRIORITY JOURNAL; PHYSIOLOGY; RECOGNITION;

AFFECT; FACIAL EXPRESSION; HUMANS; RECOGNITION (PSYCHOLOGY); SOCIAL PERCEPTION;

EID: 84937798663     PISSN: 02699931     EISSN: 14640600     Source Type: Journal    
DOI: 10.1080/02699931.2015.1049124     Document Type: Article

References (142)

1. D.Adolph,, & G.W.Alpers, (2010). Valence and arousal: A comparison of two sets of emotional facial expressions. The American Journal of Psychology, 123, 209–219. doi:10.5406/amerjpsyc.123.2.0209
2. L.Aguado,, A.García-Gutiérrez,, E.Castañeda,, & C.Saugar, (2007). Effects of prime task on affective priming by facial expressions of emotion. The Spanish Journal of Psychology, 10, 209–217. doi:10.1017/S1138741600006478
3. Z.Ambadar,, J.W.Schooler,, & J.F.Cohn, (2005). Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science, 16, 403–410. doi:10.1111/j.0956-7976.2005.01548.x
4. N.Ambady,, & M.Weisbuch, (2011). On perceiving facial expressions: The role of culture and context. In A.J.Calder, G.Rhodes, J.V.Haxby, & M.H.Johnson (Eds.), Oxford handbook of face perception (pp. 479–488). Oxford: Oxford University Press.
5. M.Arsalidou,, D.Morris,, & M.J.Taylor, (2011). Converging evidence for the advantage of dynamic facial expressions. Brain Topography, 24, 149–163. doi:10.1007/s10548-011-0171-4
6. M.Balconi,, & G.Mazza, (2009). Consciousness and emotion: ERP modulation and attentive vs. pre-attentive elaboration of emotional facial expressions by backward masking. Motivation and Emotion, 33(2), 113–124. doi:10.1007/s11031-009-9122-8
7. S.Baron-Cohen,, S.Wheelwright,, J.Hill,, Y.Raste,, & I.Plumb, (2001). The “Reading the Mind in the Eyes” test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry, 42, 241–251. doi:10.1111/1469-7610.00715
8. L.F.Barrett, (2006). Are emotions natural kinds? Perspectives on Psychological Science, 1(1), 28–58. doi:10.1111/j.1745-6916.2006.00003.x
9. M.Batty,, & M.J.Taylor, (2003). Early processing of the six basic facial emotional expressions. Cognitive Brain Research, 17, 613–620. doi:10.1016/S0926-6410(03)00174-5
10. D.J.Bayle,, B.Schoendorff,, M.A.Henaff,, & P.Krolak-Salmon, (2011). Emotional facial expression detection in the peripheral visual field. PLoS ONE, 6(6), e21584. doi:10.1371/journal.pone.0021584.g003
11. O.Beaudry,, A.Roy-Charland,, M.Perron,, I.Cormier,, & R.Tapp, (2014). Featural processing in recognition of emotional facial expressions. Cognition and Emotion, 28, 416–432. doi:10.1080/02699931.2013.833500
12. A.Belitski,, A.Gretton,, C.Magri,, Y.Murayama,, M.A.Montemurro,, N.K.Logothetis,, & S.Panzeri, (2008). Low-frequency local field potentials and spikes in primary visual cortex convey independent visual information. Journal of Neuroscience, 28, 5696–5709. doi:10.1523/JNEUROSCI.0009-08.2008
13. D.Beltrán,, & M.G.Calvo, (in press). Brain signatures of perceiving a smile: Time course and source localization. Human Brain Mapping.
14. D.L.Bimler,, & G.V.Paramei, (2006). Facial-expression affective attributes and their configural correlates: Components and categories. The Spanish Journal of Psychology, 9, 19–31.
15. C.Blais,, R.E.Jack,, C.Scheepers,, D.Fiset,, & R.Caldara, (2008). Culture shapes how we look at faces. PLoS ONE, 3(8), e3022.
16. D.Bombari,, P.C.Schmid,, M.Schmid-Mast,, S.Birri,, F.W.Mast,, & J.S.Lobmaier, (2013). Emotion recognition: The role of featural and configural face information. The Quarterly Journal of Experimental Psychology, 66, 2426–2442.
17. A.Borji,, & L.Itti, (2013). State-of-the-art in visual attention modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 185–207. doi:10.1109/TPAMI.2012.89
18. E.Bould,, N.Morris,, & B.Wink, (2008). Recognising subtle emotional expressions: The role of facial movements. Cognition and Emotion, 22, 1569–1587. doi:10.1080/02699930801921156
19. A.J.Calder,, D.Rowland,, A.W.Young,, I.Nimmo-Smith,, J.Keane,, & D.I.Perrett, (2000). Caricaturing facial expressions. Cognition, 76(2), 105–146. doi:10.1016/S0010-0277(00)00074-3
20. A.J.Calder,, & A.W.Young, (2005). Understanding the recognition of facial identity and facial expression. Nature Reviews Neuroscience, 6, 641–651. doi:10.1038/nrn1724
21. A.J.Calder,, A.W.Young,, J.Keane,, & M.Dean, (2000). Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance, 26, 527–551. doi:10.1037/0096-1523.26.2.527
22. M.G.Calvo,, P.Avero,, A.Fernández-Martín,, & G.Recio, (2015). Recognition thresholds for static and dynamic emotional faces with variable expressive intensity. Manuscript submitted for publication.
23. M.G.Calvo,, & D.Beltrán, (2013). Recognition advantage of happy faces: Tracing the neurocognitive processes. Neuropsychologia, 51, 2051–2060. doi:10.1016/j.neuropsychologia.2013.07.010
24. M.G.Calvo,, & D.Beltrán, (2014). Brain lateralization of holistic versus analytic processing of emotional facial expressions. NeuroImage, 92, 237–247. doi:10.1016/j.neuroimage.2014.01.048
25. M.G.Calvo,, D.Beltrán,, & A.Fernández-Martín, (2014). Early processing of happy facial expressions in peripheral vision: Neurophysiological evidence. Biological Psychology, 100, 60–70. doi:10.1016/j.biopsycho.2014.05.007
26. M.G.Calvo,, & A.Fernández-Martín, (2013). Can the eyes reveal a person’s emotions? Biasing role of the mouth expression. Motivation and Emotion, 37, 202–211. doi:10.1007/s11031-012-9298-1
27. M.G.Calvo,, A.Fernández-Martín,, & L.Nummenmaa, (2012). Perceptual, categorical, and affective processing of ambiguous smiling facial expressions. Cognition, 125, 373–393. doi:10.1016/j.cognition.2012.07.021
28. M.G.Calvo,, A.Fernández-Martín,, & L.Nummenmaa, (2013). A smile biases the recognition of eye expressions: Configural projection from a salient mouth. The Quarterly Journal of Experimental Psychology, 66, 1159–1181. doi:10.1080/17470218.2012.732586
29. M.G.Calvo,, A.Fernández-Martín,, & L.Nummenmaa, (2014). Facial expression recognition in peripheral versus central vision: Role of the eyes and the mouth. Psychological Research, 78, 180–195. doi:10.1007/s00426-013-0492-x
30. M.G.Calvo,, A.Gutiérrez-García,, P.Avero,, & D.Lundqvist, (2013). Attentional mechanisms in judging genuine and fake smiles: Eye-movement patterns. Emotion, 13, 792–802. doi:10.1037/a0032317
31. M.G.Calvo,, A.Gutiérrez-García,, A.Fernández-Martín,, & L.Nummenmaa, (2014). Recognition of facial expressions of emotion is related to their frequency in everyday life. Journal of Nonverbal Behavior, 38, 549–567. doi:10.1007/s10919-014-0191-3
32. M.G.Calvo,, & D.Lundqvist, (2008). Facial expressions of emotion (KDEF): Identification under different display-duration conditions. Behavior Research Methods, 40(1), 109–115. doi:10.3758/BRM.40.1.109
33. M.G.Calvo,, & H.Marrero, (2009). Visual search of emotional faces: The role of affective content and featural distinctiveness. Cognition and Emotion, 23, 782–806. doi:10.1080/02699930802151654
34. M.G.Calvo,, H.Marrero,, & D.Beltrán, (2013). When does the brain distinguish between genuine and ambiguous smiles? An ERP study. Brain and Cognition, 81, 237–246. doi:10.1016/j.bandc.2012.10.009
35. M.G.Calvo,, & L.Nummenmaa, (2008). Detection of emotional faces: Salient physical features guide effective visual search. Journal of Experimental Psychology: General, 137, 471–494. doi:10.1037/a0012771
36. M.G.Calvo,, & L.Nummenmaa, (2009). Eye-movement assessment of the time course in facial expression recognition: Neurophysiological implications. Cognitive, Affective and Behavioral Neuroscience, 9, 398–411. doi:10.3758/CABN.9.4.398
37. M.G.Calvo,, L.Nummenmaa,, & P.Avero, (2010). Recognition advantage of happy faces in extrafoveal vision: Featural and affective processing. Visual Cognition, 18, 1274–1297. doi:10.1080/13506285.2010.481867
38. J.M.Carroll,, & J.A.Russell, (1997). Facial expressions in Hollywood’s portrayal of emotion. Journal of Personality and Social Psychology, 72, 164–176. doi:10.1037/0022-3514.72.1.164
39. N.C.Carroll,, & A.W.Young, (2005). Priming of emotion recognition. The Quarterly Journal of Experimental Psychology, 58, 1173–1197. doi:10.1080/02724980443000539
40. K.R.Cave,, & M.J.Batty, (2006). From searching for features to searching for threat: Drawing the boundary between preattentive and attentive vision. Visual Cognition, 14, 629–646. doi:10.1080/13506280500193107
41. G.W.Cottrell,, & J.H.Hsiao, (2011). Neurocomputational models of face processing. In A.J.Calder, G.Rhodes, M.Johnson, and J.Haxby (Eds.), The Oxford handbook of face perception (pp. 401–425). Oxford: Oxford University Press
42. M.N.Dailey,, G.W.Cottrell,, C.Padgett,, & R.Adolphs, (2002). EMPATH: A neural network that categorizes facial expressions. Journal of Cognitive Neuroscience, 14, 1158–1173. doi:10.1016/S0010-0277(97)00003-6
43. M.N.Dailey,, C.Joyce,, M.J.Lyons,, M.Kamachi,, H.Ishi,, J.Gyoba,, & G.W.Cottrell, (2010). Evidence and a computational explanation of cultural differences in facial expression recognition. Emotion, 10, 874–893. doi:10.1037/a0020019
44. S.Du,, Y.Tao,, & A.M.Martinez, (2014). Compound facial expressions of emotion. Proceedings of the National Academy of Sciences, 111(15), E1454–E1462. doi:10.1073/pnas.1322355111
45. M.Eimer,, A.Holmes,, & F.P.McGlone, (2003). The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions. Cognitive, Affective, and Behavioral Neuroscience, 3(2), 97–110. doi:10.3758/CABN.3.2.97
46. H.Eisenbarth,, G.W.Alpers,, D.Segré,, A.Calogero,, & A.Angrilli, (2008). Categorization and evaluation of emotional faces in psychopathic women. Psychiatry Research, 159, 189–195. doi:10.1016/j.psychres.2007.09.001
47. P.Ekman, (1992). Are there basic emotions? Psychological Review, 99, 550–553. doi:10.1037/0033-295X.99.3.550
48. P.Ekman, (1994). Strong evidence for universals in facial expressions: A reply to Russell’s mistaken critique. Psychological Bulletin, 115, 268–287. doi:10.1037/0033-2909.115.2.268
49. P.Ekman,, & D.Cordaro, (2011). What is meant by calling emotions basic. Emotion Review, 3, 364–370. doi:10.1177/1754073911410740
50. P.Ekman,, & W.V.Friesen, (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press.
51. P.Ekman,, W.V.Friesen,, & J.C.Hager, (2002). Facial action coding system. Investigator’s guide. Salt Lake City, UT: Human Face.
52. H.A.Elfenbein, (2013). Nonverbal dialects and accents in facial expressions of emotion. Emotion Review, 5(1), 90–96. doi:10.1177/1754073912451332
53. H.A.Elfenbein,, & N.Ambady, (2002). On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin, 128, 203–235. doi:10.1037/0033-2909.128.2.203
54. H.A.Elfenbein,, & N.Ambady, (2003). When familiarity breeds accuracy: Cultural exposure and facial emotion recognition. Journal of Personality and Social Psychology, 85, 276–290. doi:10.1037/0022-3514.85.2.276
55. A.D.Engell,, & J.V.Haxby, (2007). Facial expression and gaze-direction in human superior temporal sulcus. Neuropsychologia, 45, 3234–3241. doi:10.1016/j.neuropsychologia.2007.06.022
56. J.M.Fernández-Dols,, & C.Crivelli, (2013). Emotion and expression: Naturalistic studies. Emotion Review, 5, 24–29.
57. C.Fiorentini,, & P.Viviani, (2009). Perceiving facial expressions. Visual Cognition, 17, 373–411. doi:10.1080/13506280701821019
58. C.Fiorentini,, & P.Viviani, (2011). Is there a dynamic advantage for facial expressions? Journal of Vision, 11(3), 17. doi:10.1167/11.3.17
59. S.Frühholz,, T.Fehr,, & M.Herrmann, (2009). Early and late temporo-spatial effects of contextual interference during perception of facial affect. International Journal of Psychophysiology, 74, 1–13.
60. J.M.B.Fugate, (2013). Categorical perception for emotional faces. Emotion Review, 5(1), 84–89. doi:10.1177/1754073912451350
61. M.Gendron,, D.Roberson,, J.M.van der Vyver,, & L.F.Barret, (2014). Perceptions of emotion from facial expressions are not culturally universal: Evidence from a remote culture. Emotion, 14, 251–262. doi:10.1037/a0036052
62. A.J.Gerber,, J.Posner,, D.Gorman,, T.Colibazzi,, S.Yu,, B.S.Peterson, (2008). An affective circumplex model of neural systems subserving valence, arousal, and cognitive overlay during the appraisal of emotional faces. Neuropsychologia, 46, 2129–2139. doi:10.1016/j.neuropsychologia.2008.02.032
63. D.Goren,, & H.R.Wilson, (2006). Quantifying facial expression recognition across viewing conditions. Vision Research, 46, 1253–1262. doi:10.1016/j.visres.2005.10.028
64. S.N.Haber, & B.Knutson, (2010). The reward circuit: Linking primate anatomy and human imaging. Neuropsychopharmacology, 35(1), 4–26. doi:10.1038/npp.2009.129
65. J.Haidt,, & D.Keltner, (1999). Culture and facial expression: Open-ended methods find more expressions and a gradient of recognition. Cognition and Emotion, 13, 225–266. doi:10.1080/026999399379267
66. S.Hamann, (2012). Mapping discrete and dimensional emotions onto the brain: Controversies and consensus. Trends in Cognitive Sciences, 16, 458–466. doi:10.1016/j.tics.2012.07.006
67. R.J.Harris,, A.W.Young,, & T.J.Andrews, (2012). Morphing between expressions dissociates continuous from categorical representations of facial expression in the human brain. Proceedings of the National Academy of Sciences, 109, 21164–21169. doi:10.1073/pnas.1212207110
68. R.R.Hassin,, H.Aviezer,, & S.Bentin, (2013). Inherently ambiguous: Facial expressions of emotions in context. Emotion Review, 5(1), 60–65. doi:10.1177/1754073912451331
69. J.V.Haxby,, E.A.Hoffman,, M.I.Gobbini, (2000). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4, 223–233. doi:10.1016/S1364-6613(00)01482-0
70. U.Hess,, & S.Blairy, (2001). Facial mimicry and emotional contagion to dynamic emotional facial expressions and their influence on decoding accuracy. International Journal of Psychophysiology, 40(2), 129–141. doi:10.1016/S0167-8760(00)00161-6
71. U.Hess,, S.Blairy,, & R.E.Kleck, (1997). The relationship between the intensity of emotional facial expressions and observers’ decoding. Journal of Nonverbal Behavior, 21, 241–257. doi:10.1023/A:1024952730333
72. A.G.Huth,, S.Nishimoto,, A.T.Vu,, & J.L.Gallant, (2012). A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron, 76, 1210–1224. doi:10.1016/j.neuron.2012.10.014
73. C.E.Izard, (1994). Innate and universal facial expressions: Evidence from developmental and cross-cultural research. Psychological Bulletin, 115, 288–299. doi:10.1037/0033-2909.115.2.288
74. R.E.Jack,, C.Blais,, C.Scheepers,, P.G.Schyns,, & R.Caldara, (2009). Cultural confusions show that facial expressions are not universal. Current Biology, 19, 1543–1548. doi:10.1016/j.cub.2009.07.051
75. R.E.Jack,, R.Caldara,, & P.G.Schyns, (2012). Internal representations reveal cultural diversity in expectations of facial expressions of emotion. Journal of Experimental Psychology: General, 141(1), 19–25. doi:10.1037/a0023463
76. R.E.Jack,, O.G.B.Garrod,, & P.G.Schyns, (2014). Dynamic facial expressions of emotion transmit an evolving hierarchy of signals over time. Current Biology, 24, 187–192. doi:10.1016/j.cub.2013.11.064
77. R.E.Jack,, O.G.B.Garrod,, H.Yu,, R.Caldara,, & P.G.Schyns, (2012). Facial expressions of emotion are not culturally universal. Proceedings of the National Academy of Sciences of the USA, 109, 7241–7244. doi:10.1073/pnas.1200155109
78. Z.Jiang,, W.Li,, G.Recio,, Y.Liu,, W.Luo,, D.Zhang,, & D.Sun, (2014). Time pressure inhibits dynamic advantage in the classification of facial expressions of emotion. PLoS One, 9(6), e100162. doi:10.1371/journal.pone.0100162.t002
79. M.H.Kayyal,, & J.A.Russell, (2013). Americans and Palestinians judge spontaneous facial expressions of emotion. Emotion, 13, 891–904. doi:10.1037/a0033244
80. T.Kirita,, & M.Endo, (1995). Happy face advantage in recognizing facial expressions. Acta Psychologica, 89, 149–163. doi:10.1016/0001-6918(94)00021-8
81. C.G.Kohler,, T.Turner,, N.M.Stolar,, W.B.Bilker,, C.M.Brensinger,, R.E.Gur,, & R.C.Gur, (2004). Differences in facial expressions of four universal emotions. Psychiatry Research, 128, 235–244. doi:10.1016/j.psychres.2004.07.003
82. P.A.Kragel,, & K.S.LaBar, (2014). Advancing emotion theory with multivariate pattern classification. Emotion Review, 6, 160–174. doi:10.1177/1754073913512519
83. E.G.Krumhuber,, A.Kappas,, & A.S.R.Manstead, (2013). Effects of dynamic aspects of facial expressions: A review. Emotion Review, 5(1), 41–46. doi:10.1177/1754073912451349
84. J.Lahnakoski, M., E.Glerean,, J.Salmi,, I.Jääskeläinen, P., M.Sams,, R.Hari,, & L.Nummenmaa, (2012). Naturalistic fMRI mapping reveals superior temporal sulcus as the hub for the distributed brain network for social perception. Frontiers in Human Neuroscience, 6, 233. doi:10.3389/fnhum.2012.00233
85. M.Lähteenmäki,, J.Hyönä,, M.Koivisto,, & L.Nummenmaa, (2015). Affective processing requires awareness. Journal of Experimental Psychology: General, 144, 339–365.
86. J.E.LeDoux,, & E.A.Phelps, (2008). Emotional networks in the brain. In M.Lewis, J.M.Haviland-Jones, & L.F.Barrett (Eds.), Handbook of emotions (3rd ed., pp. 159–179). New York, NY: The Guilford Press.
87. J.Leppänen,, & J.K.Hietanen, (2004). Positive facial expressions are recognized faster than negative facial expressions, but why? Psychological Research, 69, 22–29.
88. J.M.Leppänen,, P.Kauppinen,, M.J.Peltola,, & J.K.Hietanen, (2007). Differential electrocortical responses to increasing intensities of fearful and happy emotional expressions. Brain Research, 1116, 103–109.
89. R.W.Levenson, (2011). Basic emotion questions. Emotion Review, 3, 379–386. doi:10.1177/1754073911410743
90. K.A.Lindquist,, & M.Gendron, (2013). What’s in a word? Language constructs emotion perception. Emotion Review, 5(1), 66–71. doi:10.1177/1754073912451351
91. O.V.Lipp,, S.M.Price,, & C.L.Tellegen, (2009). No effect of inversion on attentional and affective processing of facial expressions. Emotion, 9, 248–259. doi:10.1037/a0014715
92. D.Lundqvist,, A.Flykt,, & A.Öhman, (1998). The Karolinska Directed Emotional Faces – KDEF. CD-ROM from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet, Stockholm, Sweden. ISBN 91-630-7164-9.
93. W.Luo,, W.Feng,, W.He,, N.-Y.Wang,, & Y.-J.Luo, (2010). Three stages of facial expression processing: ERP study with rapid serial visual presentation. NeuroImage, 47, 1856–1867.
94. D.Matsumoto,, & H.C.Hwang, (2014). Judgments of subtle facial expressions of emotion. Emotion, 14, 349–357. doi:10.1037/a0035237
95. D.Matsumoto,, D.Keltner,, M.N.Shiota,, M.O’Sullivan,, & M.Frank, (2008). Facial expressions of emotion. In M.Lewis, J.M.Haviland-Jones, & L.F.Barrett (Eds.), Handbook of emotions (3rd ed., pp. 211–234). New York, NY: The Guilford Press.
96. D.Matsumoto,, A.Olide,, J.Schug,, B.Willingham,, & M.Callan, (2009). Cross-cultural judgments of Spontaneous facial expressions of emotion. Journal of Nonverbal Behavior, 33, 213–238. doi:10.1007/s10919-009-0071-4
97. T.McLellan,, L.Johnston,, J.Dalrymple-Alford,, & R.Porter, (2010). Sensitivity to genuine vs. posed emotion specified in facial displays. Cognition and Emotion, 24, 1277–1292. doi:10.1080/02699930903306181
98. M.Milders,, A.Sahraie,, & S.Logan, (2008). Minimum presentation time for masked facial expression discrimination. Cognition and Emotion, 22(1), 63–82. doi:10.1080/02699930701273849
99. M.T.Motley,, & C.T.Camden, (1988). Facial expression of emotion: A comparison of posed expressions versus spontaneous expressions in an interpersonal communication setting. Western Journal of Speech Communication, 52(1), 1–22. doi:10.1080/10570318809389622
100. P.J.Naab,, & J.A.Russell, (2007). Judgments of emotion from spontaneous facial expressions of New Guineans. Emotion, 7, 736–744. doi:10.1037/1528-3542.7.4.736
101. N.L.Nelson,, & J.A.Russell, (2013). Universality revisited. Emotion Review, 5(1), 8–15. doi:10.1177/1754073912457227
102. L.Nummenmaa,, & M.G.Calvo, (2015). Dissociation between recognition and detection advantage for facial expressions: A meta-analysis. Emotion, 15, 243–256. doi:10.1037/emo0000042
103. L.Nummenmaa,, E.Glerean,, M.Viinikainen,, I.P.Jääskeläinen,, R.Hari,, & M.Sams, (2012). Emotions promote social interaction by synchronizing brain activity across individuals. Proceedings of the National Academy of Sciences of the USA, 109, 9599–9604. doi:10.1073/pnas.1206095109
104. L.Nummenmaa,, J.Hyönä,, & M.G.Calvo, (2010). Semantic categorization precedes affective evaluation of visual scenes. Journal of Experimental Psychology: General, 139, 222–246. doi:10.1037/a0018858
105. R.Palermo,, & M.Coltheart, (2004). Photographs of facial expression: Accuracy, response times, and ratings of intensity. Behavior Research Methods, Instruments, and Computers, 36, 634–638. doi:10.3758/BF03206544
106. J.Panksepp,, & D.Watt, (2011). What is basic about basic emotions? Lasting lessons from affective neuroscience. Emotion Review, 3, 387–396. doi:10.1177/1754073911410741
107. B.Parkinson, (2013). Contextualizing facial activity. Emotion Review, 5(1), 97–103. doi:10.1177/1754073912457230
108. S.D.Pollak,, M.Messner,., D.J.Kistler,, & J.F.Cohn, (2009). Development of perceptual expertise in emotion recognition. Cognition, 110, 242–247. doi:10.1016/j.cognition.2008.10.010
109. J.Posner,, J.A.Russell,, & B.S.Peterson, (2005). The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and Psychopathology, 17, 715–734.
110. G.Recio,, A.Schacht,, & W.Sommer, (2013). Classification of dynamic facial expressions of emotion presented briefly. Cognition and Emotion, 27, 1486–1494. doi:10.1080/02699931.2013.794128
111. G.Recio,, A.Schacht,, & W.Sommer, (2014). Recognizing dynamic facial expressions of emotion: Specificity and intensity effects in event-related brain potentials. Biological Psychology, 96, 111–125. doi:10.1016/j.biopsycho.2013.12.003
112. G.Recio,, W.Sommer,, & A.Schacht, (2011). Electrophysiological correlates of perceiving and evaluating static and dynamic facial emotional expressions. Brain Research, 1376, 66–75. doi:10.1016/j.brainres.2010.12.041
113. J.Rellecke,, W.Sommer,, & A.Schacht, (2012). Does processing of emotional facial expressions depend on intention? Time-resolved evidence from event-related brain potentials. Biological Psychology, 90(1), 23–32. doi:10.1016/j.biopsycho.2012.02.002
114. J.A.Russell, (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin, 115(1), 102–141. doi:10.1037/0033-2909.115.1.102
115. J.A.Russell, (2003). Core affect and the psychological construction of emotion. Psychological Review, 110, 145–172. doi:10.1037/0033-295X.110.1.145
116. J.A.Russell,, & M.Bullock, (1985). Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults. Journal of Personality and Social Psychology, 48, 1290–1298. doi:10.1037/0022-3514.48.5.1290
117. H.Saarimäki,, A.Gostopoulos,, I.P.Jääskeläinen,, J.Lampinen,, P.Vuilleumier,, M.Sams,, & L.Nummenmaa, (in press). Discrete neural signatures of basic emotions. Cerebral Cortex. doi:10.1093/cercor/bhv086
118. C.P.Said,, C.D.Moore,, A.D.Engell,, A.Todorov,, & J.V.Haxby, (2010). Distributed representations of dynamic facial expressions in the superior temporal sulcus. Journal of Vision, 10(5), 11. doi:10.1167/10.5.11
119. F.Sassi,, G.Campoy,, A.Castillo,, A.Inuggi,, & L.J.Fuentes, (2014). Task difficulty and response complexity modulate affective priming by emotional facial expressions. The Quarterly Journal of Experimental Psychology, 67, 861–871. doi:10.1080/17470218.2013.836233
120. K.R.Scherer,, & H.Ellgring, (2007). Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? Emotion, 7(1), 113–130. doi:10.1037/1528-3542.7.1.113
121. H.Schupp,, A.Öhman,, M.Junghöfer,, A.I.Weike,, J.Stockburger,, & A.Hamm, (2004). The facilitated processing of threatening faces: An ERP analysis. Emotion, 4, 189–200. doi:10.1037/1528-3542.4.2.189
122. P.Shaw,, J.Bramham,, E.J.Lawrence,, R.Morris,, S.Baron-Cohen,, & A.S.David, (2005). Differential effects of lesions of the amygdala and prefrontal cortex on recognizing facial expressions of complex emotions. Journal of Cognitive Neuroscience, 17, 1410–1419. doi:10.1016/S0165-0173(02)00248-5
123. L.R.Skelly,, & J.Decety, (2012). Passive and motivated perception of emotional faces: Qualitative and quantitative changes in the face processing network. PLoS ONE, 7(6), e40371. doi:10.1371/journal.pone.0040371.s001
124. L.H.Somerville,, & P.J.Whalen, (2006). Prior experience as a stimulus category confound: An example using facial expressions of emotion. Social, Cognitive, and Affective Neuroscience, 1, 271–274.
125. J.Storbeck,, M.D.Robinson,, & M.E.McCourt, (2006). Semantic processing precedes affect retrieval: The neurological case for cognitive primacy in visual processing. Review of General Psychology, 10(1), 41–55. doi:10.1037/1089-2680.10.1.41
126. J.M.Susskind,, G.Littlewort,, M.S.Bartlett,, J.Movellan,, & A.K.Anderson, (2007). Human and computer recognition of facial expressions of emotion. Neuropsychologia, 45, 152–162. doi:10.1016/j.neuropsychologia.2006.05.001
127. J.Svärd,, S.Wiens,, & H.Fischer, (2012). Superior recognition performance for happy masked and unmasked faces in both younger and older adults. Frontiers in Psychology, 3, 520.
128. T.D.Sweeny,, S.Suzuki,, M.Grabowecky,, & K.A.Paller, (2013). Detecting and categorizing fleeting emotions in faces. Emotion, 13(1), 76–91. doi:10.1037/a0029193
129. J.W.Tanaka,, M.Kaiser,, S.Butler,, & R.Le Grand, (2012). Mixed emotions: Holistic and analytic perception of facial expressions. Cognition and Emotion, 26, 961–977. doi:10.1080/02699931.2011.630933
130. N.Tottenham,, A.Borscheid,, K.Ellertsen,, D.Marcus,, & C.A.Nelson, (2002). The NimStim face set. Retreived from http://www.macbrain.org/faces/index.htm
131. N.Tottenham,, J.W.Tanaka,, A.C.Leon,, T.McCarry,, M.Nurse,, T.A.Hare,, C.Nelson, (2009). The NimStim set of facial expressions: Judgments from untrained research participants. Psychiatry Research, 168, 242–249. doi:10.1016/j.psychres.2008.05.006
132. P.Vuilleumier, (2009). The role of the human amygdala in perception and attention. In P.J.Whalen & E.A.Phelps (Eds.), The human amygdala (pp. 220–249). New York, NY: Guilford Press.
133. K.Vytal,, & S.Hamann, (2010). Neuroimaging support for discrete neural correlates of basic emotions: A voxel-based meta-analysis. Journal of Cognitive Neuroscience, 22, 2864–2885. doi:10.1111/j.1467-9280.1992.tb00261.x
134. H.L.Wagner, (1990). The spontaneous facial expression of differential positive and negative emotions. Motivation and Emotion, 14(1), 27–43. doi:10.1007/BF00995547
135. H.L.Wagner,, C.J.MacDonald,, & A.S.Manstead, (1986). Communication of individual emotions by spontaneous facial expressions. Journal of Personality and Social Psychology, 50, 737–743. doi:10.1037/0022-3514.50.4.737
136. P.J.Whalen,, H.Raila,, R.Bennett,, A.Mattek,, A.Brown,, J.Taylor,, A.Palmer, (2013). Neuroscience and facial expressions of emotion: The role of amygdala-prefrontal interactions. Emotion Review, 5(1), 78–83. doi:10.1177/1754073912457231
137. L.M.Williams,, D.Palmer,, B.J.Liddell,, L.Song,, & E.Gordon, (2006). The ‘when’ and ‘where’ of perceiving signals of threat versus non-threat. NeuroImage, 31, 458–467. doi:10.1016/j.neuroimage.2005.12.009
138. M.L.Willis,, R.Palermo,, D.Burke,, C.M.Atkinson,, & G.McArthur, (2010). Switching associations between facial identity and emotional expression: A behavioural and ERP study. NeuroImage, 50, 329–339. doi:10.1016/j.neuroimage.2009.11.071
139. H.S.Yao,, L.Shi,, F.Han,, H.F.Gao,, & Y.Dan, (2007). Rapid learning in cortical coding of visual scenes. Nature Neuroscience, 10, 772–778. doi:10.1038/nn1895
140. M.S.M.Yik,, Z.Meng,, & J.A.Russell, (1998). Adults’ freely produced emotion labels for babies’ spontaneous facial expressions. Cognition and Emotion, 12, 723–730. doi:10.1080/026999398379529
141. A.W.Young,, D.Rowland,, A.J.Calder,, N.L.Etcoff,, A.Seth,, & D.I.Perrett, (1997). Facial expression megamix: Tests of dimensional and category accounts of emotion recognition. Cognition, 63, 271–313. doi:10.1016/S0010-0277(97)00003-6
142. R.B.Zajonc, (1980). Feeling and thinking: Preferences need no inferences. American Psychologist, 35, 151–175. doi:10.1037/0003-066X.35.2.151