Perceptual, categorical, and affective processing of ambiguous smiling facial expressions

Cognition

Volumn 125, Issue 3, 2012, Pages 373-393

  Calvo, Manuel G ^a   Fernández Martín, Andrés ^a   Nummenmaa, Lauri ^b,c  

^a UNIVERSIDAD DE LA LAGUNA   (Spain)

^b AALTO UNIVERSITY   (Finland)

^c TURKU PET CENTRE   (Finland)

Author keywords

Configural; Emotion; Facial expression; Feature; Smile; Time course

Indexed keywords

ARTICLE; EMOTION; FACIAL EXPRESSION; HUMAN; PERCEPTION; PRIORITY JOURNAL;

ADOLESCENT; ADULT; ATTENTION; EMOTIONS; FACIAL EXPRESSION; FEMALE; HAPPINESS; HUMANS; MALE; PATTERN RECOGNITION, VISUAL; REACTION TIME; SMILING; TIME FACTORS;

EID: 84867396413     PISSN: 00100277     EISSN: 18737838     Source Type: Journal    
DOI: 10.1016/j.cognition.2012.07.021     Document Type: Article

References (74)

1. Adolphs R. Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews 2002, 1:21-62.
2. Ambadar Z., Cohn J.F., Reed L.I. All smiles are not created equal: Morphology and timing of smiles perceived as amused, polite, and embarrassed/nervous. Journal of Nonverbal Behavior 2009, 33:17-34.
3. Bargh J.A. The automaticity of everyday life. Advances in social cognition: The automaticity of everyday life 1997, Vol. 10:1-61. Erlbaum, Mahwah, NJ.
4. Barrett L.F. Are emotions natural kinds?. Perspectives on Psychological Science 2006, 1:28-58.
5. Barrett L.F., Gendron M., Huang Y.-M. Do discrete emotions exist?. Philosophical Psychology 2009, 22:427-437.
6. Breitmeyer B.G., Ogmen H. Recent models and findings in visual backward masking: A comparison, review, and update. Perception and Psychophysics 2000, 62:1572-1595.
7. Calder A.J., Young A.W. Understanding facial identity and facial expression recognition. Nature Reviews Neuroscience 2005, 6:641-651.
8. Calder A.J., Rowland D., Young A.W., Nimmo-Smith I., Keane J., Moriaty J., et al. Caricaturing facial expression. Cognition 2000, 76:105-146.
9. Calder A.J., Young A.W., Keane J., Dean M. Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance 2000, 26:527-551.
10. Calvo M.G., Avero P., Nummenmaa L. Primacy of emotional vs. semantic scene recognition in peripheral vision. Cognition and Emotion 2011, 25:1358-1375.
11. Calvo M.G., Lundqvist D. Facial expressions of emotion (KDEF): Identification under different display-duration conditions. Behavior Research Methods 2008, 40:109-115.
12. Calvo M.G., Marrero H. Visual search of emotional faces: The role of affective content and featural distinctiveness. Cognition and Emotion 2009, 23:782-806.
13. Calvo M.G., Nummenmaa L. Processing of unattended emotional visual scenes. Journal of Experimental Psychology: General 2007, 136:347-369.
14. Calvo M.G., Nummenmaa L. Detection of emotional faces: Salient physical features guide effective visual search. Journal of Experimental Psychology: General 2008, 137:471-494.
15. Calvo M.G., Nummenmaa L. Eye-movement assessment of the time course in facial expression recognition: Neurophysiological implications. Cognitive, Affective and Behavioral Neuroscience 2009, 9:398-411.
16. Calvo M.G., Nummenmaa L. Time course discrimination between emotional facial expressions: The role of visual saliency. Vision Research 2011, 51:1751-1759.
17. Calvo M.G., Nummenmaa L., Avero P. Recognition advantage of happy faces in extrafoveal vision: Featural and affective processing. Visual Cognition 2010, 18:1274-1297.
18. Carroll J.M., Russell J.A. Facial expressions in Hollywood's protrayal of emotion. Journal of Personality and Social Psychology 1997, 72:164-176.
19. Carroll N.C., Young A.W. Priming of emotion recognition. The Quarterly Journal of Experimental Psychology 2005, 58A:1173-1197.
20. Cave K.R., Batty M.J. From searching for features to searching for threat: Drawing the boundary between preattentive and attentive vision. Visual Cognition 2006, 14:629-646.
21. Debruille J.B., Brodeur M.B., Hess U. Assessing the way people look to judge their intentions. Emotion 2011, 11:533-543.
22. Dimberg U., Thunberg M., Elmehed K. Unconscious facial reactions to emotional facial expressions. Psychological Science 2000, 11:86-89.
23. Eimer M., Holmes A. Event-related brain potential correlates of emotional face processing. Neuropsychologia 2007, 45:15-31.
24. Ekman P. Telling lies: Clues to deceit in the marketplace, politics, and marriage 2001, W.W. Norton & Co, New York.
25. Ekman P. Strong evidence for universals in facial expressions. Psychological Bulletin 1994, 115:268-287.
26. Ellison J.W., Massaro D.W. Featural evaluation, integration, and judgment of facial affect. Journal of Experimental Psychology: Human Perception and Performance 1997, 23:213-226.
27. Esteves F., Dimberg U., Ohman A. Automatically elicited fear-conditioned skin-conductance responses to masked facial expressions. Cognition and Emotion 1994, 8:393-413.
28. Farah M.J., Tanaka J.W., Drain H.M. What causes the face inversion effect?. Journal of Experimental Psychology: Human Perception and Performance 1995, 21:628-634.
29. Fazio R.H., Olson M.A. Implicit measures in social cognition research: Their meaning and use. Annual Review of Psychology 2003, 54:297-327.
30. Fiorentini C., Viviani P. Perceiving facial expressions. Visual Cognition 2009, 17:373-411.
31. Itti L., Koch C. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 2000, 40:1489-1506.
32. Johnston L., Miles L., Macrae C. Why are you smiling at me? Social functions of enjoyment and non-enjoyment smiles. British Journal of Social Psychology 2010, 49:107-127.
33. Juth P., Lundqvist D., Karlsson A., Öhman A. Looking for foes and friends: Perceptual and emotional factors when finding a face in the crowd. Emotion 2005, 5:379-395.
34. Kohler C.G., Turner T., Stolar N.M., Bilker W.B., Brensinger C.M., Gur R.E., et al. Differences in facial expressions of four universal emotions. Psychiatry Research 2004, 128:235-244.
35. Kontsevich L.L., Tyler C. What makes Mona Lisa smile?. Vision Research 2004, 44:1493-1498.
36. Krumhuber E.G., Manstead A.S.R. Can Duchenne smiles be feigned? New evidence on felt and false smiles. Emotion 2009, 9:807-820.
37. Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2008). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical report A-8. University of Florida, Gainesville, FL.
38. Leppänen J., Hietanen J.K. Positive facial expressions are recognized faster than negative facial expressions, but why?. Psychological Research 2004, 69:22-29.
39. Leppänen J., Hietanen J.K. Is there more in a happy face than just a big smile?. Visual Cognition 2007, 15:468-490.
40. Lieberman M.D., Eisenberger N.I., Crockett M.J., Tom S.M., Pfeifer J.H., Way B.M. Putting feelings into words: Affect labeling disrupts amygdala activity in response to affective stimuli. Psychological Science 2007, 18:421-428.
41. Lipp O., Price S.M., Tellegen C.L. No effect of inversion on attentional and affective processing of facial expressions. Emotion 2009, 9:248-259.
42. Loughead J., Gur R.C., Elliott M., Gur R.E. Neural circuitry for accurate identification of facial emotions. Brain Research 2008, 1194:37-44.
43. Lundqvist, D., Flykt, A., & öhman, A. (1998). The Karolinska directed emotional faces - KDEF. CD-ROM from Department of Clinical Neuroscience, Psychology Section, Karolinska Institutet, Stockholm, Sweden. ISBN 91-630-7164-9.
44. Luo W., Feng W., He W., Wang N.-Y., Luo Y.-J. Three stages of facial expression processing: ERP study with rapid serial visual presentation. NeuroImage 2010, 47:1856-1867.
45. Maurer D., Le Grand R., Mondloch C.J. The many faces of configural processing. Trends in Cognitive Sciences 2002, 6:255-260.
46. McLellan T., Johnston L., Dalrymple-Alford J., Porter R. Sensitivity to genuine vs. posed emotion specified in facial displays. Cognition and Emotion 2010, 24:1277-1292.
47. Mermillod M., Vermeulen N., Lundqvist D., Niedenthal P.M. Neural computation as a tool to differentiate perceptual from emotional processes: The case of the anger superiority effect. Cognition 2009, 110:346-357.
48. Milders M., Sahraie A., Logan S. Minimum presentation time for masked facial expression discrimination. Cognition and Emotion 2008, 22:63-82.
49. Miles L., Johnston L. Detecting happiness: Perceiver sensitivity to enjoyment and non-enjoyment smiles. Journal of Nonverbal Behavior 2007, 31:259-275.
50. Morris J.S., Öhman A., Dolan R.J. A subcortical pathway to the right amygdala mediating "unseen" fear. Proceedings of the National Academy of Sciences of the United States of America 1999, 96:1680-1685.
51. Murphy S.T., Zajonc R.B. Affect, cognition, and awareness: Affective priming with optimal and suboptimal stimulus exposures. Journal of Personality and Social Psychology 1993, 64:723-739.
52. Niedenthal P.M., Mermillod M., Maringer M., Hess U. The simulation of smiles (SIMS) model: Embodied simulation and the meaning of facial expression. Behavioral and Brain Sciences 2010, 33:417-433.
53. Nummenmaa L., Hyönä J., Calvo M.G. Semantic categorization precedes affective evaluation of visual scenes. Journal of Experimental Psychology: General 2010, 139:222-246.
54. Nummenmaa L., Peets K., Salmivalli C. Automatic activation of adolescents' peer-relational schemas: Evidence from priming with facial identity. Child Development 2008, 79:1659-1675.
55. Nummenmaa T. The recognition of pure and blended facial expressions of emotion from still photographs. Scandinavian Journal of Psychology 1988, 29:33-47.
56. Nusseck M., Cunningham D.W., Wallraven C., Bülthoff H.H. The contribution of different facial regions to the recognition of conversational expressions. Journal of Vision 2008, 8(8):1-23. (article no. 1).
57. Palermo R., Coltheart M. Photographs of facial expression: Accuracy, response times, and ratings of intensity. Behavior Research Methods 2004, 36:634-638.
58. Palermo R., Rhodes G. Are you always on my mind? A review of how face perception and attention interact. Neuropsychologia 2007, 45:75-92.
59. Paulmann S., Pell M.D. Facial expression decoding as a function of emotional meaning status: ERP evidence. NeuroReport 2009, 20:1603-1608.
60. Peace V., Miles L., Johnston L. It doesn't matter what you wear: The impact of posed and genuine expressions of happiness on product evaluation. Social Cognition 2006, 24:137-168.
61. Pessoa L., Japee S., Sturman D., Ungerleider L.G. Target visibility and visual awareness modulate amygdala responses to fearful faces. Cerebral Cortex 2006, 16:366-375.
62. Richler J.J., Mack M.L., Gauthier I., Palmieri T.J. Holistic processing of faces happens at a glance. Vision Research 2009, 49:2856-2861.
63. Russell J.A. Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin 1994, 115:102-141.
64. Schacht A., Sommer W. Emotions in word and face processing: Early and late cortical responses. Brain and Cognition 2009, 69:538-550.
65. Scherer K.R., Ellgring H. Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal?. Emotion 2007, 7:113-130.
66. Schyns P., Oliva A. Dr. Angry and Mr. Smile: When categorization flexibly modifies the perception of faces in rapid visual presentations. Cognition 1999, 69:243-265.
67. Smith M.L., Cottrell G., Gosselin F., Schyns P.G. Transmitting and decoding facial expressions of emotions. Psychological Science 2005, 16:184-189.
68. Storbeck J., Robinson M.D., McCourt M.E. Semantic processing precedes affect retrieval: The neurological case for cognitive primacy in visual processing. Review of General Psychology 2006, 10:41-55.
69. Surakka V., Hietanen J.K. Facial and emotional reactions to Duchenne and non-Duchenne smiles. International Journal of Psychophysiology 1998, 29:23-33.
70. Tanaka, J. W., Kaiser, M., Butler, S., & Le Grand, R. (in press). Mixed emotions: Holistic and analytic perception of facial expressions. Cognition and Emotion, http://dx.doi.org/10.1080/02699931.2011.630933.
71. Tottenham N., Tanaka J.W., Leon A.C., McCarry T., Nurse M., Hare T.A., et al. The NimStim set of facial expressions: Judgments from untrained research participants. Psychiatry Research 2009, 168:242-249.
72. VanRullen R. Four common conceptual fallacies in mapping the time course of recognition. Frontiers in Psychology 2011, 2(365):1-6.
73. Walther D., Koch C. Modelling attention to salient proto-objects. Neural Networks 2006, 19:1395-1407.
74. Zajonc R.B. Feeling and thinking: Closing the debate over the independence of affect. Feeling and thinking: The role of affect in social cognition 2000, 31-58. Cambridge University Press, Cambridge. J.P. Forgas (Ed.).