Holistic person processing: Faces With Bodies Tell the Whole Story

Journal of Personality and Social Psychology

Volumn 103, Issue 1, 2012, Pages 20-37

  Aviezer, Hillel ^a,b   Trope, Yaacov ^b   Todorov, Alexander ^a  

^a PRINCETON UNIVERSITY   (United States)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

Composite effect; Context effects; Emotion perception; Facial and body expressions; Holistic perception

Indexed keywords

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; ART; ARTICLE; DECISION MAKING; EMOTION; FACE; FACIAL EXPRESSION; FEMALE; HUMAN; MALE; MENTAL FUNCTION; MIDDLE AGED; PSYCHOLOGICAL ASPECT; RECOGNITION; STUDENT; VISION;

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; EMOTIONS; FACE; FACIAL EXPRESSION; FEMALE; HUMAN BODY; HUMANS; JUDGMENT; MALE; MENTAL PROCESSES; MIDDLE AGED; RECOGNITION (PSYCHOLOGY); STUDENTS; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84870212734     PISSN: 00223514     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0027411     Document Type: Article

References (86)

1. Abbas, Z.-A., & Duchaine, B. (2008). The role of holistic processing in judgments of facial attractiveness. Perception, 37(8), 1187-1196. doi: 10.1068/p5984
2. Adolphs, R. (2002). Neural systems for recognizing emotion. Current Opinion in Neurobiology, 12(2), 169-177. doi:10.1016/S0959-4388 (02)00301-X
3. Adolphs, R. (2003). Cognitive neuroscience of human social behaviour. Nature Reviews Neuroscience, 4(3), 165-178. doi:10.1038/nrn1056
4. Aviezer, H., Bentin, S., Dudarev, V., & Hassin, R. R. (2011). The automaticity of emotional face-context integration. Emotion, 11(6), 1406-1414. doi:10.1037/a0023578
5. Aviezer, H., Bentin, S., Hassin, R. R., Meschino, W. S., Kennedy, J., Grewal, S., . . . Moscovitch, M. (2009). Not on the face alone: Perception of contextualized face expressions in Huntington's disease. Brain, 132(6), 1633-1644. doi:10.1093/brain/awp067
6. Aviezer, H., Hassin, R. R., & Bentin, S. (2011). Impaired integration of emotional faces and affective body context in a rare case of developmental visual agnosia. Cortex. Advance online publication. doi:10.1016/ j.cortex.2011.03.005
7. Aviezer, H., Hassin, R. R., Bentin, S., & Trope, Y. (2008). Putting facial expressions back in context. In N. Ambady & J. J. Skowronski (Eds.), First impressions (pp. 255-286). New York, NY: Guilford Press.
8. Aviezer, H., Hassin, R. R., Ryan, J., Grady, C., Susskind, J., Anderson, A., . . . Bentin, S. (2008). Angry, disgusted, or afraid? Studies on the malleability of emotion perception. Psychological Science, 19(7), 724-732. doi:10.1111/j.1467-9280.2008.02148.x
9. Barrett, L. F., & Kensinger, E. A. (2010). Context is routinely encoded during emotion perception. Psychological Science, 21(4), 595-599. doi: 10.1177/0956797610363547
10. Barrett, L. F., Lindquist, K. A., & Gendron, M. (2007). Language as context for the perception of emotion. Trends in Cognitive Sciences, 11(8), 327-332. doi:10.1016/j.tics.2007.06.003
11. Baudouin, J.-Y., & Humphreys, G. W. (2006). Configural information in gender categorisation. Perception, 35(4), 531-540. doi:10.1068/p3403
12. Buck, R. (1994). Social and emotional functions in facial expression and communication: The readout hypothesis. Biological Psychology, 38(2-3), 95-115. doi:10.1016/0301-0511(94)90032-9
13. Calder, A. J., & Young, A. W. (2005). Understanding the recognition of facial identity and facial expression. Nature Reviews Neuroscience, 6(8), 641-651. doi:10.1038/nrn1724
14. Calder, A. J., Young, A. W., Keane, J., & Dean, M. (2000). Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance, 26(2), 527-551. doi: 10.1037/0096-1523.26.2.527
15. Carroll, J. M., & Russell, J. A. (1996). Do facial expressions signal specific emotions? Judging emotion from the face in context. Journal of Personality and Social Psychology, 70(2), 205-218. doi:10.1037/0022-3514.70.2.205
16. Darwin, C. (1872). The expression of the emotions in man and animals. London, England: Murray. doi:10.1037/10001-000
17. de Gelder, B. (2006). Towards the neurobiology of emotional body language. Nature Reviews Neuroscience, 7(3), 242-249. doi:10.1038/ nrn1872
18. de Gelder, B., Meeren, H. K. M., Righart, R., Van den Stock, J., van de Riet, W. A. C., & Tamietto, M. (2006). Beyond the face: Exploring rapid influences of context on face processing. In S. Martinez-Conde, S. L. Macknik, L. M. Martinez, J.-M. Alonso, & P.U. Tse (Eds.), Progress in Brain Research: Vol. 155, Pt. B. Visual perception: Part 2: Fundamentals of awareness, multi-sensory integration and high-order perception (pp. 37-48). New York, NY: Elsevier. doi:10.1016/S0079-6123(06)55003-4
19. Duncan, J. (1993). Similarity between concurrent visual discriminations: Dimensions and objects. Perception & Psychophysics, 54(4), 425-430. doi:10.3758/BF03211764
20. Ekman, P. (1992). Facial expressions of emotion: New findings, new questions. Psychological Science, 3(1), 34-38. doi:10.1111/j.1467-9280.1992.tb00253.x
21. Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48(4), 384-392. doi:10.1037/0003-066X.48.4.384
22. Ekman, P. (2003). Darwin, deception, and facial expression. Annals of the New York Academy of Sciences, 1000, 205-221. doi:10.1196/ annals.1280.010
23. Ekman, P., & Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press.
24. Ekman, P., Friesen, W., & Ellsworth, P. (1982). What are the relative contributions of facial behavior and contextual information to the judgment of emotion. In P. Ekman (Ed.), Emotion in the human face (pp. 111-127). New York, NY: Cambridge University Press.
25. Ekman, P., & O'Sullivan, M. (1988). The role of context in interpreting facial expression: Comment on Russell and Fehr (1987). Journal of Experimental Psychology: General, 117(1), 86-88. doi:10.1037/0096-3445.117.1.86
26. Elfenbein, H. A., & Ambady, N. (2002). On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin, 128(2), 203-235. doi:10.1037/0033-2909.128.2.203
27. Ellison, J. W., & Massaro, D. W. (1997). Featural evaluation, integration, and judgment of facial affect. Journal of Experimental Psychology: Human Perception and Performance, 23(1), 213-226. doi:10.1037/ 0096-1523.23.1.213
28. Etcoff, N. L., & Magee, J. J. (1992). Categorical perception of facial expressions. Cognition, 44(3), 227-240. doi:10.1016/0010-0277 (92)90002-Y
29. Farah, M. J., Wilson, K. D., Drain, H. M., & Tanaka, J. R. (1995). The inverted face inversion effect in prosopagnosia: Evidence for mandatory, face-specific perceptual mechanisms. Vision Research, 35(14), 2089-2093. doi:10.1016/0042-6989(94)00273-O
30. Gao, Z., Flevaris, A. V., Robertson, L. C., & Bentin, S. (2011). Priming global and local processing of composite faces: Revisiting the processing-bias effect on face perception. Attention, Perception, & Psychophysics, 73(5), 1477-1486. doi:10.3758/s13414-011-0109-7
31. Hassin, R., & Trope, Y. (2000). Facing faces: Studies on the cognitive aspects of physiognomy. Journal of Personality and Social Psychology, 78(5), 837-852. doi:10.1037/0022-3514.78.5.837
32. Hawk, S. T., van der Schalk, J., & Fischer, A. H. (2008, July). Moving faces, looking places: The Amsterdam Dynamic Facial Expressions Set (ADFES). Paper presented at the 12th European Conference on Facial Expressions, Geneva, Switzerland.
33. Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4(6), 223-233. doi:10.1016/S1364-6613(00)01482-0
34. Hole, G. J. (1994). Configurational factors in the perception of unfamiliar faces. Perception, 23, 65-74. doi:10.1068/p230065
35. Johnson, K. L., Gill, S., Reichman, V., & Tassinary, L. G. (2007). Swagger, sway, and sexuality: Judging sexual orientation from body motion and morphology. Journal of Personality and Social Psychology, 93(3), 321-334. doi:10.1037/0022-3514.93.3.321
36. Konar, Y., Bennett, P. J., & Sekuler, A. B. (2010). Holistic processing is not correlated with face-identification accuracy. Psychological Science, 21(1), 38-43. doi:10.1177/0956797609356508
37. Langner, O., Dotsch, R., Bijlstra, G., Wigboldus, D. H. J., Hawk, S. T., & van Knippenberg, A. (2010). Presentation and validation of the Radboud Faces Database. Cognition & Emotion, 24(8), 1377-1388. doi:10.1080/ 02699930903485076
38. Le Grand, R., Mondloch, C. J., Maurer, D., & Brent, H. P. (2004). Impairment in holistic face processing following early visual deprivation. Psychological Science, 15(11), 762-768. doi:10.1111/j.0956-7976.2004.00753.x
39. Matsumoto, D., & Hwang, H. S. (2010). Judging faces in context. Social and Personality Psychology Compass, 4(6), 393-402. doi:10.1111/ j.1751-9004.2010.00271.x
40. Maurer, D., Le Grand, R., & Mondloch, C. J. (2002). The many faces of configural processing. Trends in Cognitive Sciences, 6(6), 255-260. doi:10.1016/S1364-6613(02)01903-4
41. McArthur, L. Z., & Baron, R. M. (1983). Toward an ecological theory of social perception. Psychological Review, 90(3), 215-238. doi:10.1037/ 0033-295x.90.3.215
42. Meeren, H. K. M., van Heijnsbergen, C. C. R. J., & de Gelder, B. (2005). Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences of the United States of America, 102(45), 16518-16523. doi:10.1073/ pnas.0507650102
43. Michel, C., Rossion, B., Han, J., Chung, C.-S., & Caldara, R. (2006). Holistic processing is finely tuned for faces of one's own race. Psychological Science, 17(7), 608-615. doi:10.1111/j.1467-9280.2006 .01752.x
44. Minnebusch, D. A., & Daum, I. (2009). Neuropsychological mechanismsof visual face and body perception. Neuroscience and Biobehavioral Reviews, 33(7), 1133-1144. doi:10.1016/j.neubiorev.2009.05.008
45. Mondloch, C. J. (2012). Sad or fearful? The influence of body posture on adults' and children's perception of facial displays of emotion. Journal of Experimental Child Psychology, 111(2), 180-196. doi:10.1016/ j.jecp.2011.08.003
46. Nakamura, M., Buck, R., & Kenny, D. A. (1990). Relative contributions of expressive behavior and contextual information to the judgment of the emotional state of another. Journal of Personality and Social Psychology, 59(5), 1032-1039. doi:10.1037/0022-3514.59.5.1032
47. Nosofsky, R. M. (1991). Stimulus bias, asymmetric similarity, and classification. Cognitive Psychology, 23(1), 94-140 doi:10.1016/0010-0285(91)90004-8
48. Öhman, A. (2000). Fear and anxiety: Evolutionary, cognitive, and clinical perspectives. In M. Lewis & J. M. Haviland-Jones (Eds.), Handbook of emotions (2nd ed., pp. 573-593). New York, NY: Guilford Press.
49. O'Toole, A. J., Phillips, P. J., Weimer, S., Roark, D. A., Ayyad, J., Barwick, R., & Dunlop, J. (2011). Recognizing people from dynamic and static faces and bodies: Dissecting identity with a fusion approach. Vision Research, 51(1), 74-83. doi:10.1016/j.visres.2010.09.035
50. Peelen, M. V., & Downing, P. E. (2005). Is the extrastriate body area involved in motor actions? Nature Neuroscience, 8(2), 125-126. doi: 10.1038/nn0205-125a
51. Peelen, M. V., & Downing, P. E. (2007). The neural basis of visual body perception. Nature Reviews Neuroscience, 8(8), 636-648. doi:10.1038/ nrn2195
52. Peleg, G., Katzir, G., Peleg, O., Kamara, M., Brodsky, L., Hel-Or, H., . . . Nevo, E. (2006). Hereditary family signature of facial expression. Proceedings of the National Academy of Sciences of the United States of America, 103(43), 15921-15926. doi:10.1073/pnas.0607551103
53. Reed, C. L., Stone, V. E., Bozova, S., & Tanaka, J. (2003). The bodyinversion effect. Psychological Science, 14(4), 302-308. doi:10.1111/ 1467-9280.14431
54. Richard, A. M., Lee, H., & Vecera, S. P. (2008). Attentional spreading in object-based attention. Journal of Experimental Psychology: Human Perception and Performance, 34(4), 842-853. doi:10.1037/0096-1523.34.4.842
55. Richler, J. J., Cheung, O. S., & Gauthier, I. (2011). Holistic processing predicts face recognition. Psychological Science, 22(4), 464-471. doi: 10.1177/0956797611401753
56. Richler, J. J., Cheung, O. S., Wong, A. C. N., & Gauthier, I. (2009). Does response interference contribute to face composite effects? Psychonomic Bulletin & Review, 16(2), 258-263. doi:10.3758/PBR.16.2.258
57. Richler, J. J., Gauthier, I., Wenger, M. J., & Palmeri, T. J. (2008). Holistic processing of faces: Perceptual and decisional components. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34(2), 328-342. doi:10.1037/0278-7393.34.2.328
58. Richler, J. J., Mack, M. L., Gauthier, I., & Palmeri, T. J. (2009). Holistic processing of faces happens at a glance. Vision Research, 49(23), 2856-2861. doi:10.1016/j.visres.2009.08.025
59. Righart, R., & de Gelder, B. (2008). Recognition of facial expressions is influenced by emotional scene gist. Cognitive, Affective, & Behavioral Neuroscience, 8(3), 264. doi:10.3758/CABN.8.3.264
60. Rule, N. O., Ambady, N., & Hallett, K. C. (2009). Female sexual orientation is perceived accurately, rapidly, and automatically from the face and its features. Journal of Experimental Social Psychology, 45(6), 1245-1251. doi:10.1016/j.jesp.2009.07.010
61. Russell, J. A. (1997). Reading emotions from and into faces: Resurrecting a dimensional contextual perspective. In J. A. Russell & J. M. Fernández-Dols (Eds.), The psychology of facial expressions (pp. 295-320). Cambridge, England: Cambridge University Press. doi:10.1017/ CBO9780511659911.015
62. Smith, M. L., Cottrell, G. W., Gosselin, F., & Schyns, P. G. (2005).Transmitting and decoding facial expressions. Psychological Science, 16(3), 184-189. doi:10.1111/j.0956-7976.2005.00801.x
63. Stevenage, S. V., Nixon, M. S., & Vince, K. (1999). Visual analysis of gait as a cue to identity. Applied Cognitive Psychology, 13(6), 513-526. doi: 10.1002/(SICI)1099-0720(199912)13:6<513::AID-ACP616>3.0.CO;2-8
64. Susskind, J. M., Littlewort, G., Bartlett, M. S., Movellan, J., & Anderson, A. K. (2007). Human and computer recognition of facial expressions of emotion. Neuropsychologia, 45(1), 152-162. doi:10.1016/j.neuropsychologia.2006 .05.001
65. Tanaka, J. W., & Farah, M. J. (1993). Parts and wholes in face recognition. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 46A(2), 225-245. doi:10.1080/14640749308401045
66. Tanaka, J. W., Kiefer, M., & Bukach, C. M. (2004). A holistic account of the own-race effect in face recognition: Evidence from a cross-cultural study. Cognition, 93(1), B1-B9. doi:10.1016/j.cognition.2003.09.011
67. Thornhill, R., & Gangestad, S. W. (1999). Facial attractiveness. Trends in Cognitive Sciences, 3(12), 452-460. doi:10.1016/S1364-6613 (99)01403-5
68. Todorov, A., & Duchaine, B. (2008). Reading trustworthiness in faces without recognizing faces. Cognitive Neuropsychology, 25(3), 395-410. doi:10.1080/02643290802044996
69. Todorov, A., Loehr, V., & Oosterhof, N. N. (2010). The obligatory nature of holistic processing of faces in social judgments. Perception, 39(4), 514-532. doi:10.1068/p6501
70. Todorov, A., Pakrashi, M., & Oosterhof, N. N. (2009). Evaluating faces on trustworthiness after minimal time exposure. Social Cognition, 27(6), 813-833. doi:10.1521/soco.2009.27.6.813
71. Tracy, J. L., & Robins, R. W. (2008). The automaticity of emotion recognition. Emotion, 8(1), 81-95. doi:10.1037/1528-3542.8.1.81
72. Trope, Y. (1986). Identification and inferential processes in dispositional attribution. Psychological Review, 93(3), 239-257. doi:10.1037/0033-295X.93.3.239
73. Turati, C., Di Giorgio, E., Bardi, L., & Simion, F. (2010). Holistic face processing in newborns, 3-month-old infants, and adults: Evidence from the composite face effect. Child Development, 81(6), 1894-1905. doi: 10.1111/j.1467-8624.2010.01520.x
74. Tversky, A., & Gati, I. (1978). Studies of similarity. In R. Rosch & B. B. Lloyd (Eds.), Cognition and categorization (pp. 79-98). Hillsdale, NJ: Erlbaum.
75. Van den Stock, J., Righart, R., & de Gelder, B. (2007). Body expressions influence recognition of emotions in the face and voice. Emotion, 7(3), 487-494. doi:10.1037/1528-3542.7.3.487
76. van de Riet, W. A. C., Grèzes, J., & de Gelder, B. (2009). Specific and common brain regions involved in the perception of faces and bodies and the representation of their emotional expressions. Social Neuroscience, 4(2), 101-120. doi:10.1080/17470910701865367
77. Wallbott, H. G. (1998). Bodily expression of emotion. European Journal of Social Psychology, 28(6), 879-896. doi:10.1002/(SICI)1099-0992(1998110)28:6<879::AID-EJSP901>3.0.CO;2-W
78. Waller, B. M., Cray, J. J., Jr., & Burrows, A. M. (2008). Selection for universal facial emotion. Emotion, 8(3), 435-439. doi:10.1037/1528-3542.8.3.435
79. Whalen, P. J., Kagan, J., Cook, R. G., Davis, F. C., Kim, H., Polis, S., . . . Johnstone, T. (2004). Human amygdala responsivity to masked fearful eye whites. Science, 306(5704), 2061. doi:10.1126/science.1103617
80. Willis, J., & Todorov, A. (2006). First impressions: Making up your mind after a 100-ms exposure to a face. Psychological Science, 17(7), 592-598.
81. Young, A. W., Hellawell, D., & Hay, D. C. (1987). Configurational information in face perception. Perception, 16(6), 747-759. doi: 10.1068/p160747
82. Young, A. W., Rowland, D., Calder, A. J., Etcoff, N. L., Seth, A., & Perrett, D. I. (1997). Facial expression megamix: Tests of dimensional and category accounts of emotion recognition. Cognition, 63(3), 271-313. doi:10.1016/S0010-0277(97)00003-6
83. Yovel, G., Pelc, T., & Lubetzky, I. (2010). It's all in your head: Why is the body inversion effect abolished for headless bodies? Journal of Experimental Psychology: Human Perception and Performance, 36(3), 759-767. doi:10.1037/a0017451
84. Zebrowitz, L. A., Hall, J. A., Murphy, N. A., & Rhodes, G. (2002). Looking smart and looking good: Facial cues to intelligence and their origins. Personality and Social Psychology Bulletin, 28(2), 238-249. doi:10.1177/0146167202282009
85. Zebrowitz, L. A., & Montepare, J. M. (2008). Social psychological face perception: Why appearance matters. Social and Personality Psychology Compass, 2(3), 1497-1517. doi:10.1111/j.1751-9004.2008.00109.x
86. Zhu, Q., Song, Y., Hu, S., Li, X., Tian, M., Zhen, Z., . . . Liu, J. (2010). Heritability of the specific cognitive ability of face perception. Current Biology, 20(2), 137-142. doi:10.1016/j.cub.2009.11.067