Brain systems for assessing the affective value of faces

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 366, Issue 1571, 2011, Pages 1660-1670

  Said, Christopher P ^a   Haxby, James V ^b   Todorov, Alexander ^c  

^a NEW YORK UNIVERSITY   (United States)

^b Dartmouth College   (United States)

^c PRINCETON UNIVERSITY   (United States)

Author keywords

Cognitive neuroscience; Face; Social cognition

Indexed keywords

BRAIN; NEUROLOGY; PARSIMONY ANALYSIS; PERCEPTION; RECOGNITION;

BEHAVIOR; BRAIN; COGNITION; EMOTION; FACE; FACIAL EXPRESSION; HUMAN; IMAGE PROCESSING; PATTERN RECOGNITION; PERCEPTION; PHYSIOLOGY; PSYCHOLOGICAL ASPECT; RECOGNITION; REVIEW; TEMPORAL LOBE; TRUST; VISION;

BEHAVIOR; BRAIN; COGNITION; EMOTIONS; FACE; FACIAL EXPRESSION; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; PATTERN RECOGNITION, VISUAL; RECOGNITION (PSYCHOLOGY); SOCIAL PERCEPTION; TEMPORAL LOBE; TRUST; VISUAL PERCEPTION;

EID: 79955776221     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2010.0351     Document Type: Review

References (74)

1. Todorov, A. 2008 Evaluating faces on trustworthiness: an extension of systems for recognition of emotions signal- ing approach/avoidance behaviors. Year Cogn. Neurosci. 1124,208-224.
2. Said, C. P., Dotsch, R. & Todorov, A. 2010 The amyg- dala and FFA track both social and non-social face dimensions. Neuropsychologia 3596-3605. (doi:10.1016/ j.neuropsychologia.2010.08.009)
3. Olivola, C. Y. & Todorov, A. 2010 Fooled by first impressions? Reexamining the diagnostic value of appearance-based inferences. J. Exp. Social Psychol. 46, 315-324. (doi:10.1016/j.jesp.2009.12.002)
4. Willis, J. & Todorov, A. 2006 First impressions: making up your mind after a 100-ms exposure to a face. Psychol. Sci.17,592-598.(doi:10.1111/j.1467-9280.2006.01750.x)
5. Zebrowitz, L. A. & Montepare, J. M. 2008 Social psychological face perception: why appearance matters. Soc. Pers. Psychol. Compass 2,1497-1517. (doi:10. 1111/j.1751-9004.2008.00109.x)
6. Ballew II, C. C. & Todorov, A. 2007 Predicting political elections from rapid and unreflective face judgments. Proc. Natl Acad. Sci. USA 104, 17 948-17953. (doi:10. 1073/pnas.0705435104)
7. Mazur, A., Mazur, J. & Keating, C. 1984 Military rank attainment of a West Point class: effects of cadets physical features.Am.J.Sociol.90,125-150.(doi:10.1086/228050)
8. Todorov, A., Mandisodza, A. N., Goren, A. & Hall, C. C. 2005 Inferences of competence from faces predict election outcomes. Science 308,1623-1626. (doi:10. 1126/science.1110589)
9. Zebrowitz, L. A. 1997 Reading faces: window to the soul? Boulder, CO: Westview Press.
10. Montepare, J. M. & Dobish, H. 2003 The contribution of emotion perceptions and their overgeneralizations to trait impressions. J. Nonverbal Behav. 27, 237-254. (doi:10.1023/A:1027332800296)
11. Zebrowitz, L. A. 2004 The origins of first impressions. J. Cult. Evol. Psychol., 2, 93-108. (doi:10.1556/JCEP.2. 2004.1-2.6)
12. Knutson, B. 1996 Facial expressions of emotion influ- ence interpersonal trait inferences. J. Nonverbal Behav. 20,165-182. (doi:10.1007/BF02281954)
13. Oosterhof, N. N. & Todorov, A. 2008 The functional basis of face evaluation. Proc. Natl Acad. Sci. USA 105, 11087-11 092. (doi:10.1073/pnas.0805664105)
14. Said, C. P., Sebe, N. & Todorov, A. 2009 Structural resemblance to emotional expressions predicts evaluation of emotionally neutral faces. Emotion 9, 260-264. (doi:10.1037/a0014681)
15. Zebrowitz, L. A., Kikuchi, M. & Fellous, J. M. 2010 Facial resemblance to emotions: group differences, impression effects, and race stereotypes. J. Pers. Soc. Psy- chol. 98, 175-189. (doi:10.1037/a0017990)
16. Engell, A. D., Todorov, A. & Haxby, J. V. 2010 Common neural mechanisms for the evaluation of facial trust- worthiness and emotional expressions as revealed by behavioral adaptation. Perception 39, 931-941. (doi:10. 1068/p6633)
17. Haxby, J. V., Hoffman, E. A. & Gobbini, M. I. 2000 The distributed human neural system for face perception. Trends Cogn. Sci. 4,223-233. (doi:10.1016/S1364- 6613(00)01482-0)
18. Engell, A. D. & Haxby, J. V. 2007 Facial expression and gaze-direction in human superior temporal sulcus. Neuropsychologia 45, 3234-3241. (doi:10.1016/j.neuro- psychologia.2007.06.022)
19. Winston, J. S., Henson, R. N. A., Fine-Goulden, M. R. & Dolan, R. J. 2004 fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. J. Neurophysiol. 92, 1830-1839. (doi:10.1152/ jn.00155.2004)
20. Said, C. P., Moore, C. D., Engell, A. D., Todorov, A. & Haxby, J. V. 2010 Distributed representations of dynamic facial expressions in the superior temporal sulcus. J. Vis., 10. (doi:10.1167/10.5.11)
21. Hasselmo, M. E., Rolls, E. T. & Baylis, G. C. 1989 The role of expression and identity in the face-selective responses of neurons in the temporal visual-cortex of the monkey. Behav. Brain Res. 32, 203-218. (doi:10. 1016/S0166-4328(89)80054-3)
22. Perrett, D. I., Hietanen, J. K., Oram, M. W. & Benson, P. J. 1992 Organization and functions of cells responsive to faces in the temporal cortex. Phil. Trans. R. Soc. Lond. B 335,23-30. (doi:10.1098/rstb.1992.0003)
23. Bentin, S., Degutis, J. M., D'Esposito, M. & Robertson, L. C. 2007 Too many trees to see the forest: perform- ance, event-related potential, and functional magnetic resonance imaging manifestations of integrative congeni- tal prosopagnosia. J. Cogn. Neurosci. 19,132-146. (doi:10.1162/jocn.2007.19.1.132)
24. Duchaine, B. C., Parker, H. & Nakayama, K. 2003 Normal recognition of emotion in a prosopagnosic. Perception 32, 827-838. (doi:10.1068/p5067)
25. Calder, A. J. & Young, A. W. 2005 Understanding the recognition of facial identity and facial expression. Nat. Rev. Neurosci. 6, 641-651. (doi:10.1038/nrn1724)
26. Tsuchiya, N., Kawasaki, H., Oya, H., Howard III, M. A. & Adolphs, R. 2008 Decoding face information in time, frequency and space from direct intracranial recordings of the human brain. PLoS ONE 3, e3892. (doi:10.1371/ journal.pone.0003892)
27. Giese, M. A. & Poggio, T. 2003 Neural mechanisms for the recognition of biological movements. Nat. Rev. Neurosci. 4, 179-192. (doi:10.1038/nrn1057)
28. Hein, G. & Knight, R. T. 2008 Superior temporal sulcus-it's my area: or is it? J. Cogn. Neurosci. 20, 2125-2136. (doi:10.1162/jocn.2008.20148)
29. Carr, L., Iacoboni, M., Dubeau, M. C., Mazziotta, J. C. & Lenzi, G. L. 2003 Neural mechanisms of empathy in humans: a relay from neural systems for imitation to limbic areas. Proc. Natl Acad. Sci. USA 100, 5497- 5502. (doi:10.1073/pnas.0935845100)
30. Kitada, R., Johnsrude, I. S., Kochiyama, T. & Lederman, S. J. 2010 Brain networks involved in haptic and visual identification of facial expressions of emotion: an fMRI study. Neuroimage 49, 1677-1689. (doi:10.1016/j.neuro- image.2009.09.014)
31. Montgomery, K. J. & Haxby, J. V. 2008 Mirror neuron system differentially activated by facial expressions and social hand gestures: a functional magnetic resonance imaging study. J. Cogn. Neurosci. 20, 1866-1877. (doi:10.1162/jocn.2008.20127)
32. Sprengelmeyer, R., Rausch, M., Eysel, U. T. & Przuntek, H. 1998 Neural structures associated with recognition of facial expressions of basic emotions. Proc. R. Soc. Lond. B 265,1927-1931. (doi:10.1098/rspb.1998.0522)
33. Pitcher, D., Garrido, L., Walsh, V. & Duchaine, B. C. 2008 Transcranial magnetic stimulation disrupts the per- ception and embodiment of facial expressions. J. Neurosci. 28, 8929-8933. (doi:10.1523/JNEUROSCI.1450-08. 2008)
34. Martin, A. 2007 The representation of object concepts in the brain. Ann. Rev. Psychol. 58, 25-45. (doi:10.1146/ annurev.psych.57.102904.190143)
35. Ferrari, P. F., Gallese, V., Rizzolatti, G. & Fogassi, L. 2003 Mirror neurons responding to the observation of ingestive and communicative mouth actions in the monkey ventral premotor cortex. Eur. J. Neurosci. 17, 1703-1714. (doi:10.1046/j.1460-9568.2003.02601.x)
36. Montgomery, K. J., Isenberg, N. & Haxby, J. V. 2007 Communicative hand gestures and object-directed hand movements activated the mirror neuron system. Soc. Cogn. Affect Neurosci. 2, 114-122. (doi:10.1093/scan/ nsm004)
37. Montgomery, K. J., Seeherman, K. R. & Haxby, J. V. 2009 The well-tempered social brain. Psychol. Sci. 20, 1211-1213. (doi:10.1111/j.1467-9280.2009.02428.x)
38. Nakamura, K. et al. 1999 Activation of the right inferior frontal cortex during assessment of facial emotion. J. Neurophysiol. 82, 1610-1614.
39. Rizzolatti, G. & Craighero, L. 2004 The mirror-neuron system. Ann. Rev. Neurosci. 27, 169-192. (doi:10.1146/ annurev.neuro.27.070203.144230)
40. Dinstein, I., Thomas, C., Behrmann, M. & Heeger, D. J. 2008 A mirror up to nature. Curr. Biol. 18, R13-R18. (doi:10.1016/j.cub.2007.11.004)
41. Johnson-Frey, S. H., Maloof, F. R., Newman-Norlund, R., Farrer, C., Inati, S. & Grafton, S. T. 2003 Actions or hand-object interactions? Human inferior frontal cortex and action observation. Neuron 39, 1053-1058. (doi:10.1016/S0896-6273(03)00524-5)
42. Buck, R. 1984 The communication of emotion. New York, NY: Guilford.
43. Dimberg, U. 1982 Facial reactions to facial expressions. Psychophysiology 19, 643-647. (doi:10.1111/j.1469-8986. 1982.tb02516.x)
44. Dimberg, U., Thunberg, M. & Elmehed, K. 2000 Unconscious facial reactions to emotional facial expressions. Psychol. Sci. 11, 86-89. (doi:10.1111/1467- 9280.00221)
45. Grill-Spector, K. & Malach, R. 2001 fMR-adaptation: a tool for studying the functional properties of human cortical neurons. Acta Psychol. (Amst.) 107, 293-321. (doi:10.1016/S0001-6918(01)00019-1)
46. Krekelberg, B., Boynton, G. M. & van Wezel, R. J. A. 2006 Adaptation: from single cells to BOLD signals. Trends Neurosci. 29, 250-256. (doi:10.1016/j.tins.2006. 02.008)
47. Cloutier, J., Heatherton, T. F., Whalen, P. J. & Kelley, W. M. 2008 Are attractive people rewarding? Sex differences in the neural substrates of facial attractiveness. J. Cogn. Neurosci. 20,941-951. (doi:10.1162/jocn.2008.20062)
48. Kranz, F. & Ishai, A. 2006 Face perception is modulated by sexual preference. Curr. Biol. 16,63-68. (doi:10. 1016/j.cub.2005.10.070)
49. O'Doherty, J., Winston, J., Critchley, H., Perrett, D., Burt, D. M. & Dolan, R. J. 2003 Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia 41,147-155. (doi:10.1016/S0028- 3932(02)00145-8)
50. Winston, J. S., O'Doherty, J., Kilner, J. M., Perrett, D. I. & Dolan, R. J. 2007 Brain systems for assessing facial attrac- tiveness. Neuropsychologia 45, 195-206. (doi:10.1016/j. neuropsychologia.2006.05.009)
51. O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J. & Andrews, C. 2001 Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4, 95-102. (doi:10.1038/82959)
52. O'Doherty, J. P., Deichmann, R., Critchley, H. D. & Dolan, R. J. 2002 Neural responses during anticipation of a primary taste reward. Neuron 33, 815-826. (doi:10.1016/S0896-6273(02)00603-7)
53. Aharon, I., Etcoff, N., Ariely, D., Chabris, C. F., O'Connor, E. & Breiter, H. C. 2001 Beautiful faces have variable reward value: fMRI and behavioral evi- dence. Neuron 32, 537-551. (doi:10.1016/S0896- 6273(01)00491-3)
54. Breiter, H. C. et al. 1997 Acute effects of cocaine on human brain activity and emotion. Neuron 19, 591-611. (doi:10.1016/S0896-6273(00)80374-8)
55. Schultz, W. 2000 Multiple reward signals in the brain. Nat. Rev. Neurosci. 1, 199-207. (doi:10.1038/35044563)
56. Kampe, K. K. W., Frith, C. D., Dolan, R. J. & Frith, U. 2001 Reward value of attractiveness and gaze: making eye contact enhances the appeal of a pleasing face, irre- spective of gender. Nature 413, 589-589. (doi:10.1038/ 35098149)
57. Critchley, H. D. 2004 The human cortex responds to an interoceptive challenge. Proc. Natl Acad. Sci. USA 101, 6333-6334. (doi:10.1073/pnas.0401510101)
58. Teves, D., Videen, T. O., Cryer, P. E. & Powers, W. J. 2004 Activation of human medial prefrontal cortex during autonomic responses to hypoglycemia. Proc. Natl Acad. Sci. USA 101, 6217-6221. (doi:10.1073/ pnas.0307048101)
59. Adolphs, R., Tranel, D. & Damasio, A. R. 1998 The human amygdala in social judgment. Nature 393, 470- 474. (doi:10.1038/30982) Phil. Trans. R. Soc. B (2011)
60. Kirsch, P. et al. 2005 Oxytocin modulates neural circuitry for social cognition and fear in humans. J. Neurosci. 25, 11489-11 493. (doi:10.1523/JNEUROSCI.3984-05. 2005)
61. Theodoridou, A., Rowe, A. C., Penton-Voak, I. S. & Rogers, P. J. 2009 Oxytocin and social perception: oxytocin increases perceived facial trustworthiness and attractiveness. Horm. Behav. 56, 128-132. (doi:10. 1016/j.yhbeh.2009.03.019)
62. Todorov, A. & Duchaine, B. 2008 Reading trustworthiness in faces without recognizing faces. Cogn. Neuropsychol. 25, 395-410. (doi:10.1080/02643290802044996)
63. Engell, A. D., Haxby, J. V. & Todorov, A. 2007 Implicit trustworthiness decisions: automatic coding of face prop- erties in the human amygdala. J. Cogn. Neurosci. 19, 1508-1519. (doi:10.1162/jocn.2007.19.9.1508)
64. Winston, J. S., Strange, B. A., O'Doherty, J. & Dolan, R. J. 2002 Automatic and intentional brain responses during evaluation of trustworthiness of faces. Nat. Neuro- sci. 5, 277-283. (doi:10.1038/nn816)
65. Todorov, A., Baron, S. G. & Oosterhof, N. N. 2008 Evalu- ating face trustworthiness: a model based approach. Social Cogn. Affect. Neurosci. 3, 119-127. (doi:10.1093/scan/ nsn009)
66. Todorov, A. & Engell, A. D. 2008 The role of the amyg- dala in implicit evaluation of emotionally neutral faces. Social Cogn. Affect. Neurosci. 3, 303-312. (doi:10.1093/ scan/nsn033)
67. Said, C. P., Baron, S. G. & Todorov, A. 2009 Nonlinear amygdala response to face trustworthiness: contributions of high and low spatial frequency information. J. Cogn. Neurosci. 21, 519-528. (doi:10.1162/jocn.2009.21041)
68. Todorov, A., Said, C. P., Oosterhof, N. N. & Engell, A. D. In press. Neural systems for face evalution. J. Cogn. Neurosci.
69. Valentine, T. 1991 A unified account of the effects of dis- tinctiveness, inversion, and race in face recognition. Q. J. Exp. Psychol. A 43, 161-204.
70. Leopold, D. A., Bondar, I. V. & Giese, M. A. 2006 Norm-based face encoding by single neurons in the monkey inferotemporal cortex. Nature 442, 572-575. (doi:10.1038/nature04951)
71. Loffler, G., Yourganov, G., Wilkinson, F. & Wilson, H. R. 2005 fMRI evidence for the neural representation of faces. Nat. Neurosci. 8, 1386-1390. (doi:10.1038/ nn1538)
72. Dzhelyova, M. P., Ellison, A. & Atkinson, A. P. In press. Event-related repetitive TMS reveals distinct, critical roles for right OFA and bilateral posterior STS in judging the sex and trustworthiness of faces. J. Cogn. Neurosci.
73. Breiter, H. C., Etcoff, N. L., Whalen, P. J., Kennedy, W. A., Rauch, S. L., Buckner, R. L., Strauss, M., Hyman, S. & Rosen, B. 1996 Response and habituation of the human amygdala during visual processing of facial expression. Neuron17,875-887.(doi:10.1016/S0896-6273(00) 80219-6)
74. Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L. & Pietrini, P. 2001 Distributed and over- lapping representations of faces and objects in ventral temporal cortex. Science 293, 2425-2430. (doi:10. 1126/science.1063736)