Hierarchical encoding of social cues in primate inferior temporal cortex

Cerebral Cortex

Volumn 25, Issue 9, 2015, Pages 3036-3045

  Morin, Elyse L ^a   Hadj Bouziane, Fadila ^a   Stokes, Mark ^b   Ungerleider, Leslie G ^a   Bell, Andrew H ^a  

^a NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Face processing; Facial expression; Gaze direction; Identity; Monkey

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; FACIAL EXPRESSION; FEAR; FEMALE; GAZE; HAPLORHINI; INFERIOR TEMPORAL CORTEX; MALE; NERVE CELL; NERVE TRACT; NONHUMAN; PRIORITY JOURNAL; SOCIAL INTERACTION; TASK PERFORMANCE; THREAT; VISUAL STIMULATION; ANALYSIS OF VARIANCE; ANIMAL; ASSOCIATION; BRAIN MAPPING; CYTOLOGY; EMOTION; NUCLEAR MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; RHESUS MONKEY; SOCIAL BEHAVIOR; TEMPORAL LOBE;

ANALYSIS OF VARIANCE; ANIMALS; BRAIN MAPPING; CUES; EMOTIONS; FACIAL EXPRESSION; MACACA MULATTA; MAGNETIC RESONANCE IMAGING; MALE; NEURAL PATHWAYS; NEURONS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; SOCIAL BEHAVIOR; TEMPORAL LOBE;

EID: 84982898765     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhu099     Document Type: Article

References (56)

1. Adams RB, Franklin RG. 2009. Influence of emotional expression on the processing of gaze direction. Motiv Emot. 33:106-112.
2. Allison T, Puce A, McCarthy G. 2000. Social perception from visual cues: role of the STS region. Trends Cogn Sci. 4:267-278.
3. Andrews TJ, Ewbank MP. 2004. Distinct representations for facial identity and changeable aspects of faces in the human temporal lobe. NeuroImage. 23:905-913.
4. Baseler HA, Harris RJ, Young AW, Andrews TJ. 2014. Neural responses to expression and gaze in the posterior superior temporal sulcus interact with facial identity. Cereb Cortex. 24:737-744.
5. Baylis G, Rolls E, Leonard C. 1985. Selectivity between faces in the responses of a population of neurons in the cortex in the superior temporal sulcus of the monkey. Brain Res. 342:91-102.
6. Bell AH, Hadj-Bouziane F, Frihauf JB, Tootell RBH, Ungerleider LG. 2008. Object representations in the temporal cortex of monkeys and humans as revealed by functional magnetic resonance imaging. J Neurophysiol. 101:688-700.
7. Bell AH, Malecek NJ, Morin EL, Hadj-Bouziane F, Tootell RBH, Ungerleider LG. 2011. Relationship between functional magnetic resonance imaging-identified regions and neuronal category selectivity. J Neurosci. 31:12229-12240.
8. Bruce C, Desimone R, Gross C. 1981. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol. 46:369-384.
9. Bruce V, Young A. 1986. Understanding face recognition. Br J Psychol. 77(Pt 3):305-327.
10. Calder AJ 2011. Does facial identity and facial expression recognition involve separate visual routes? In: Calder AJ, Rhodes G, Johnson M, Haxby JV editors. Oxford Handbook of Face Perception. 1st ed. Oxford: Oxford University Press, pp. 427-448.
11. Calder AJ, Young AW. 2005. Understanding the recognition of facial identity and facial expression. Nat Rev Neurosci. 6:641-651.
12. Cohen Kadosh K, Henson RNA, Cohen Kadosh R, Johnson MH, Dick F. 2010. Task-dependent activation of face-sensitive cortex: an fMRI adaptation study. J Cogn Neurosci. 22:903-917.
13. Darwin C. 1872. The expression of the emotions in man and animals. London: John Murray.
14. Desimone R, Albright TD, Gross CG, Bruce C. 1984. Stimulus-selective properties of inferior temporal neurons in the macaque. J Neurosci. 4:2051-2062.
15. De Souza WC, Eifuku S, Tamura R, Nishijo H, Ono T. 2005. Differential characteristics of face neuron responses within the anterior superior temporal sulcus of macaques. J Neurophysiol. 94: 1252-1266.
16. Eifuku S, De Souza WC, Nakata R, Ono T, Tamura R. 2011. Neural representations of personally familiar and unfamiliar faces in the anterior inferior temporal cortex of monkeys. PLoS One. 6:e18913.
17. Eifuku S, De Souza WC, Tamura R, Nishijo H, Ono T. 2004. Neuronal correlates of face identification in the monkey anterior temporal cortical areas. J Neurophysiol. 91:358-371.
18. Ekman P, Sorenson ER, Friesen WV. 1969. Pan-cultural elements in facial displays of emotion. Science. 164:86-88.
19. Engell AD, Haxby JV. 2007. Facial expression and gaze-direction in human superior temporal sulcus. Neuropsychologia. 45:3234-3241.
20. Ewbank MP, Jennings C, Calder AJ. 2009. Why are you angry with me? Facial expressions of threat influence perception of gaze direction. J Vis. 9:16.
21. Freiwald WA, Tsao DY 2010. Functional compartmentalization and viewpoint generalization within the macaque face-processing system. Science. 330:845-851.
22. Freiwald WA, Tsao DY, Livingstone MS. 2009. A face feature space in the macaque temporal lobe. Nat Neurosci. 12:1187-1196.
23. Furl N, Hadj-Bouziane F, Liu N, Averbeck BB, Ungerleider LG. 2012. Dynamic and static facial expressions decoded from motion-sensitive areas in the macaque monkey. J Neurosci. 32:15952-15962.
24. Ganel T, Valyear KF, Goshen-Gottstein Y, Goodale MA. 2005. The involvement of the "fusiform face area" in processing facial expression. Neuropsychologia. 43:1645-1654.
25. Ghazanfar AA, Chandrasekaran C, Morrill RJ. 2010. Dynamic, rhythmic facial expressions and the superior temporal sulcus of macaque monkeys: implications for the evolution of audiovisual speech. Eur J Neurosci. 31:1807-1817.
26. Gothard K, Erickson C. 2004. How do rhesus monkeys (Macaca mulatta) scan faces in a visual paired comparison task? Anim Cogn. 7:25-36.
27. Gothard KM, Battaglia FP, Erickson CA, Spitler KM, Amaral DG. 2006. Neural responses to facial expression and face identity in the monkey amygdala. J Neurophysiol. 97:1671-1683.
28. Graham R, LaBar KS. 2012. Neurocognitive mechanisms of gazeexpression interactions in face processing and social attention. Neuropsychologia. 50:553-566.
29. Gross CG, Bender DB, Rocha-Miranda CE. 1969. Visual receptive fields of neurons in inferotemporal cortex of the monkey. Science. 166:1303-1306.
30. Hadj-Bouziane F, Bell AH, Knusten TA, Ungerleider LG, Tootell RBH 2008. Perception of emotional expressions is independent of face selectivity in monkey inferior temporal cortex. Proc Natl Acad Sci USA. 105:5591-5596.
31. Hadj-Bouziane F, Liu N, Bell AH, Gothard KM, Luh W-M, Tootell RBH, Murray EA, Ungerleider LG. 2012. Amygdala lesions disrupt modulation of functional MRI activity evoked by facial expression in the monkey inferior temporal cortex. Proc Natl Acad Sci USA. 109: E3640-E3648.
32. Harris RJ, Young AW, Andrews TJ. 2012. Morphing between expressions dissociates continuous from categorical representations of facial expression in the human brain. Proc Natl Acad Sci USA. 109:21164-21169.
33. Hasselmo ME, Rolls ET, Baylis GC. 1989. The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behav Brain Res. 32:203-218.
34. Haxby J, Hoffman E, Gobbini M. 2000. The distributed human neural system for face perception. Trends Cogn Sci. 4:223-233.
35. Hoffman EA, Haxby JV. 2000. Distinct representations of eye gaze and identity in the distributed human neural system for face perception. Nat Neurosci. 3:80-84.
36. Hoffman KL, Gothard KM, Schmid MC, Logothetis NK. 2007. Facialexpression and gaze-selective responses in the monkey amygdala. Curr Biol. 17:766-772.
37. Ku S-P, Tolias AS, Logothetis NK, Goense J. 2011. fMRI of the faceprocessing network in the ventral temporal lobe of awake and anesthetized macaques. Neuron. 70:352-362.
38. Leopold DA, Bondar IV, Giese MA. 2006. Norm-based face encoding by single neurons in the monkey inferotemporal cortex. Nature. 442:572-575.
39. Lobmaier JS, Tiddeman BP, Perrett DI. 2008. Emotional expression modulates perceived gaze direction. Emotion. 8:573-577.
40. Milders M, Hietanen JK, Leppänen JM, Braun M. 2011. Detection of emotional faces is modulated by the direction of eye gaze. Emotion. 11:1456-1461.
41. Moeller S, Nallasamy N, Tsao DY, Freiwald WA. 2009. Functional connectivity of the macaque brain across stimulus and arousal states. J Neurosci. 29:5897-5909.
42. Ohayon S, Freiwald WA, Tsao DY. 2012. What makes a cell face selective? The importance of contrast. Neuron. 74:567-581.
43. Perrett D, Rolls E, Caan W. 1982. Visual neurones responsive to faces in the monkey temporal cortex. Exp Brain Res. 47:329-342.
44. Perrett D, Smith P, Potter D, Mistlin A, Head A, Milner A, Jeeves M. 1985. Visual cells in the temporal cortex sensitive to face view and gaze direction. Philos Trans R Soc Lond B Biol Sci. 223:293-317.
45. Perrett DI, Smith PA, Potter DD, Mistlin AJ, Head AS, Milner AD, Jeeves MA. 1984. Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. Hum Neurobiol. 3:197-208.
46. Pinsk MA, Arcaro M, Weiner KS, Kalkus JF, Inati SJ, Gross CG, Kastner S. 2008. Neural representations of faces and body parts in macaque and human cortex: a comparative fMRI study. J Neurophysiol. 101:2581-2600.
47. Pourtois G, Spinelli L, Seeck M, Vuilleumier P. 2010. Modulation of face processing by emotional expression and gaze direction during intracranial recordings in right fusiform cortex. J Cogn Neurosci. 22:2086-2107.
48. Rolls ET 2000. Functions of the primate temporal lobe cortical visual areas in invariant visual object and face recognition. Neuron. 27:205-218.
49. Senju A, Hasegawa T. 2005. Direct gaze captures visuospatial attention. Vis Cogn. 12:127-144.
50. Sugase Y, Yamane S, Ueno S, Kawano K. 1999. Global and fine information coded by single neurons in the temporal visual cortex. Nature. 400:869-873.
51. Tsao D, Moeller S, Freiwald W. 2008. Comparing face patch systems in macaques and humans. Proc Natl Acad Sci USA. 105:19514.
52. Tsao DY, Freiwald WA, Tootell RBH, Livingstone MS. 2006. A cortical region consisting entirely of face-selective cells. Science. 311:670-674.
53. Tsao DY, Livingstone MS. 2008. Mechanisms of face perception. Annu Rev Neurosci. 31:411-437.
54. Yamane S, Kaji S, Kawano K. 1988. What facial features activate face neurons in the inferotemporal cortex of the monkey? Exp Brain Res. 73:209-214.
55. Young MP, Yamane S. 1992. Sparse population coding of faces in the inferotemporal cortex. Science. 256:1327-1331.
56. Yovel G, Freiwald WA. 2013. Face recognition systems in monkey and human: are they the same thing? F1000Prime Rep. 5: 10.