Face categorization in visual scenes may start in a higher order area of the right fusiform gyrus: Evidence from dynamic visual stimulation in neuroimaging

Journal of Neurophysiology

Volumn 106, Issue 5, 2011, Pages 2720-2736

  Jiang, Fang ^a   Dricot, Laurence ^a   Weber, Jochen ^b   Righi, Giulia ^c   Tarr, Michael J ^d   Goebel, Rainer ^e   Rossion, Bruno ^a  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^b Och Spine at New York Presbyterian Hospitals   (United States)

^c BOSTON CHILDREN S HOSPITAL   (United States)

^d CARNEGIE MELLON UNIVERSITY   (United States)

^e MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Face perception; Functional magnetic resonance imaging

Indexed keywords

ADULT; ARTICLE; BRAIN CORTEX; FACE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM GYRUS; HUMAN; HUMAN EXPERIMENT; MALE; NEUROIMAGING; NORMAL HUMAN; OCCIPITAL CORTEX; PRIORITY JOURNAL; SUBCORTEX; VISION; VISUAL STIMULATION;

BRAIN MAPPING; FACE; FEMALE; FORM PERCEPTION; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME; TEMPORAL LOBE; VISUAL CORTEX; VISUAL PATHWAYS; YOUNG ADULT;

EID: 80755143831     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00672.2010     Document Type: Article

References (129)

1. Appelbaum LG, Wade AR, Vildavski VY, Pettet MW, Norcia AM. Cue-invariant networks for figure and background processing in human visual cortex. J Neurosci 26: 11695-11708, 2006.
2. Bar M. A cortical mechanism for triggering top-down facilitation in visual object recognition. J Cogn Neurosci 15: 600-609, 2003.
3. Bentin S, Allison T, Puce A, Perez E, McCarthy G. Electrophysiological studies of face perception in humans. J Cogn Neurosci 8: 551-565, 1996.
4. Biederman I. Recognition-by-components: a theory of human image understanding. Psychol Rev 94: 115-147, 1987.
5. Boussaoud DR, Desimone R, Ungerleider LG. Visual topography of area TEO in the macaque. J Comp Neurol 306: 554-575, 1991.
6. Bullier J, Hupe JM, James AC, Girard P. The role of feedback connections in shaping the responses of visual cortical neurons. Prog Brain Res 134: 193-204, 2001.
7. Burton AM. Learning new faces in an interactive activation and competition model. Vis Cogn 1: 313-348, 1994.
8. Carlson T, Grol MJ, Verstraten FA. Dynamics of visual recognition revealed by fMRI. Neuroimage 32: 892-905, 2006.
9. Crouzet SM, Kirchner H, Thorpe SJ. Fast saccades toward faces: face detection in just 100 ms. J Vis 10: 1-17, 2010.
10. Deichmann R, Gottfried JA, Hutton C, Turner R. Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19: 430-441, 2003.
11. Desimone R, Albright TD, Gross CG, Bruce C. Stimulus-selective properties of inferior temporal neurons in the macaque. J Neurosci 4: 2051-2062, 1984.
12. Dolan RJ, Fink GR, Rolls E, Booth M, Holmes A, Frackowiak RS, Friston KJ. How the brain learns to see objects and faces in an impoverished context. Nature 389: 596-599, 1997.
13. Downing PE, Jiang Y, Shuman M, Kanwisher N. A cortical area selective for visual processing of the human body. Science 293: 2470-2473, 2001.
14. Eger E, Henson RN, Driver J, Dolan RJ. Mechanisms of top-down facilitation in perception of visual objects studied by fMRI. Cereb Cortex 17: 2123-2133, 2007.
15. Egner T, Monti JM, Summerfield C. Expectation and surprise determine neural population responses in the ventral visual stream. J Neurosci 30: 16601-16608, 2010.
16. Epstein R, Kanwisher N. A cortical representation of the local visual environment. Nature 392: 598-601, 1998.
17. Esterman M, Yantis S. perceptual expectations evokes category-selective cortical activity. Cereb Cortex 20: 1245-1253, 2010.
18. Fairhall SL, Ishai A. Effective connectivity within the distributed cortical network for face perception. Cereb Cortex 17: 2400-2406, 2007.
19. Fei-Fei L, Iyer A, Koch C, Perona P. What do we perceive in a glance of a real-world scene? J Vis 7: 10, 2007.
20. Felleman DJ, Van Essen DC. Distributed hierarchical processing in the primate cerebral cortex. Cereb Cortex 1: 1-47, 1991.
21. Flavell JH, Draguns J. A microgenetic approach to perception and thought. Psychol Bull 54: 197-217, 1957.
22. Formisano E, Goebel R. Tracking cognitive processes with functional MRI mental chronometry. Curr Opin Neurobiol 13: 174-181, 2003.
23. Fox CJ, Iaria G, Barton J. Defining the face-processing network: optimization of the functional localizer in fMRI. Hum Brain Mapp 30: 1637-1651, 2009.
24. Friston KJ, Harrison L, Penny W. Dynamic causal modelling. Neuroimage 19: 1273-1302, 2003.
25. Galuske RA, Schmidt KE, Goebel R, Lomber SG, Payne BR. The role of feedback in shaping neural representations in cat visual cortex. Proc Natl Acad Sci USA 99: 17083-17088, 2002.
26. Gauthier I, Tarr MJ, Moylan J, Skudlarski P, Gore JC, Anderson AW. The fusiform "face area" is part of a network that processes faces at the individual level. J Cogn Neurosci 12: 495-504, 2000.
27. Gobbini I, Haxby JV. Neural systems for recognition of familiar faces. Neuropsychologia 45: 32-41, 2007.
28. Goffaux V, Peters J, Haubrechts J, Schiltz C, Jansma B, Goebel R. From coarse to fine? Spatial and Temporal dynamics of cortical face processing. Cereb Cortex 21: 467-476, 2011.
29. Grill-Spector K, Knouf N, Kanwisher N. The fusiform face area subserves face perception, not generic within-category identification. Nat Neurosci 7: 555-562, 2004.
30. Grill-Spector K, Kushnir T, Edelman S, Avidan G, Itzchak Y, Malach R. Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron 24: 187-203, 1999.
31. Grill-Spector K, Malach R. fMR-adaptation: a tool for studying the functional properties of human cortical neurons. Acta Psychol (Amst) 107: 293-321, 2001.
32. Halgren E, Dale AM, Sereno MI, Tootell RB, Marinkovic K, Rosen BR. Location of human face-selective cortex with respect to retinotopic areas. Hum Brain Mapp 7: 29-37, 1999.
33. Halgren E, Raij T, Marinkovic K, Jousmäki V, Hari R. Cognitive response profile of the human fusiform face area as determined by MEG. Cereb Cortex 10: 69-81, 2000.
34. Harmon LD. The recognition of faces. Sci Am 229: 70-83, 1973.
35. Haxby JV, Hoffman EA, Gobbini MI. The distributed human neural system for face perception. Trends Cogn Sci 4: 223-233, 2000.
36. Hécaen H, Angelergues R. Agnosia for faces (prosopagnosia). Arch Neurol 7: 92-100, 1962.
37. Hemond CC, Kanwisher NG, Op de Beeck HP. A preference for contralateral stimuli in human object- and face-selective cortex. PLoS One 2: e574, 2007.
38. Hillger LA, Koenig O. Separable mechanisms in face processing: evidence from hemispheric specialization. J Cogn Neurosci 3: 42-58, 1991.
39. Hochstein S, Ahissar M. View from the top: hierarchies and reverse hierarchies in the visual system. Neuron 36: 791-804, 2002.
40. Hodzic A, Kaas A, Muckli L, Stirn A, Singer W. Distinct cortical networks for the detection and identification of human body. Neuroimage 45: 1264-1271, 2009.
41. Hubel DH, Wiesel TN. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J Physiol 160: 106-154, 1962.
42. Hupé JM, James AC, Payne BR, Lomber SG, Girard P, Bullier J. Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons. Nature 394: 784-787, 1998.
43. Ishai A. Let's face it: it's a cortical network. Neuroimage 40: 415-419, 2008.
44. Jacques C, d'Arripe O, Rossion B. The time course of the face inversion effect during individual face discrimination. J Vis 7: 1-9, 2007.
45. Jacques C, Rossion B. The initial representation of individual faces in the right occipito-temporal cortex is holistic: electrophysiological evidence from the composite face illusion. J Vis 9: 1-16, 2009.
46. James TW, Humphrey GK, Gati JS, Menon RS, Goodale MA. The effect of visual object priming on brain activation before and after recognition. Curr Biol 10: 1017-1024, 2000.
47. Jiang F, Dricot L, Blanz V, Goebel R, Rossion B. Neural correlates of shape and surface reflectance information in individual faces. Neuroscience 163: 1078-1091, 2009.
48. Jiang X, Rosen E, Zeffiro T, Vanmeter J, Blanz V, Riesenhuber M. Evaluation of a shape-based model of human face discrimination using FMRI and behavioral techniques. Neuron 50: 159-172, 2006.
49. Kanwisher N, McDermott J, Chun MM. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 17: 4302-4311, 1997.
50. Kleinschmidt A, Buchel C, Hutton C, Friston KJ, Frackowiak RS. The neural structures expressing perceptual hysteresis in visual letter recognition. Neuron 34: 659-666, 2002.
51. Kriegeskorte N, Formisano E, Sorger B, Goebel R. Individual faces elicit distinct response patterns in human anterior temporal cortex. Proc Natl Acad Sci USA 104: 20600-20605, 2007.
52. Lamme VAF, Roelfsema PR. The distinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci 23: 571-579, 2000.
53. Le Grand R, Mondloch CJ, Maurer D, Brent HP. Expert face processing requires visual input to the right hemisphere during infancy. Nat Neurosci 6: 1108-1112, 2003.
54. Lerner Y, Hendler T, Ben-Nashat D, Harel M, Malach R. A hierarchical axis of object processing stages in the human visual cortex. Cereb Cortex 11: 287-297, 2001.
55. Letourneau SM, Mitchell TV. Behavioral and ERP measures of holistic face processing in a composite task. Brain Cogn 67: 234-245, 2008.
56. Leventhal AG, Wang YC, Schmolesky MT, Zhou Y. Neural correlates of boundary perception. Vis Neurosci 15: 1107-1118, 1998.
57. Levy I, Hasson U, Avidan G, Hendler T, Malach R. Center-periphery organization of human object areas. Nat Neurosci 4: 533-539, 2001.
58. Lewis MB, Edmonds AJ. Face detection: mapping human performance. Perception 32: 903-920, 2003.
59. Lobmaier JS, Klaver P, Loenneker T, Martin E, Mast FW. Featural and configural face processing strategies: evidence from a functional magnetic resonance imaging study. Neuroreport 19: 287-291, 2008.
60. Malach R, Reppas JB, Benson RR, Kwong KK, Jiang H, Kennedy WA, Ledden PJ, Brady TJ, Rosen BR, Tootell RB. Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc Natl Acad Sci USA 92: 8135-8139, 1995.
61. Marr D. Vision. San Francisco, CA: Freeman, 1982.
62. McKeeff TJ, Tong F. The timing of perceptual decisions for ambiguous face stimuli in the human ventral visual cortex. Cereb Cortex 17: 669-678, 2007.
63. Menon RS, Kim SG. Spatial and temporal limits in cognitive neuroimaging with fMRI. Trends Cogn Sci 3: 207-216, 1999.
64. Moeller S, Freiwald WA, Tsao DY. Patches with links: a unified system for processing faces in the macaque temporal lobe. Science 320: 1355-1359, 2008.
65. Mooney CM. Age in the development of closure ability in children. Can J Psychol 11: 219-226, 1957.
66. Moore C, Cavanagh P. Recovery of 3D volume from 2-tone images of novel objects. Cognition 67: 45-71, 1998.
67. Mumford D. On the computational architecture of the neocortex. II. The role of cortico-cortical loops. Biol Cybern 66: 241-251, 1992.
68. Nestor A, Leeds DD, Vettel JM, Tarr MJ. Neurally-derived representations for face detection. Poster presented at the Fifth International Workshop on Statistical Analysis of Neuronal Data, Pittsburgh, PA, 2010.
69. Nestor A, Vettel JM, Tarr MJ. Task-specific codes for face recognition: how they shape the neural representation of features for detection and individuation. PLoS One 3: e3978, 2008.
70. Parkin AJ, Williamson P. Cerebral lateralization at different stages of facial processing. Cortex 23: 99-110, 1987.
71. Peelen MV, Downing PE. Selectivity for the human body in the fusiform gyrus. J Neurophysiol 93: 603-608, 2005.
72. Peelen MV, Fei-Fei L, Kastner S. Neural mechanisms of rapid natural scene categorization in human visual cortex. Nature 460: 94-97, 2009.
73. Peelen MV, Wiggett AJ, Downing PE. Patterns of fMRI activity dissociate overlapping functional brain areas that respond to biological motion. Neuron 49: 815-822, 2006.
74. Philiastides MG, Sajda P. EEG-informed fMRI reveals spatiotemporal characteristics of perceptual decision making. J Neurosci 27: 13082-13091, 2007.
75. Pinsk MA, Arcaro M, Weiner KS, Kalkus JF, Inati SJ, Gross CG, Kastner S. Neural representations of faces and body parts in macaque and human cortex: a comparative fMRI study. J Neurophysiol 101: 2581-2600, 2009.
76. Pitcher D, Duchaine B, Walsh V, Kanwish K. TMS evidence for feedforward and feedback mechanisms of face and body perception. Poster pre-sented at the 10th Annual Meeting of Vision Science Society, Naples, FL, 2010.
77. Pitcher D, Garrido L, Walsh V, Duchaine BC. Transcranial magnetic stimulation disrupts the perception and embodiment of facial expressions. J Neurosci 28: 8929-8933, 2008.
78. Pitcher D, Walsh V, Yovel G, Duchaine B. TMS evidence for the involvement of the right occipital face area in early face processing. Curr Biol 17: 1568-1573, 2007.
79. Puce A, Allison T, Bentin S, Gore JC, McCarthy G. Temporal cortex activation in humans viewing eye and mouth movements. J Neurosci 18: 2188-2199, 1998.
80. Puce A, Allison T, Gore JC, McCarthy G. Face-sensitive regions in human extrastriate cortex by functional MRI. J Neurophysiol 74: 1192-1199, 1995.
81. Puri AM, Wojciulik E, Ranganath C. Category expectation modulates baseline and stimulus-evoked activity in human inferotemporal cortex. Brain Res 1301: 89-99, 2009.
82. Rajimehr R, Young JC, Tootell RBH. An anterior temporal face patch in human cortex, predicted by macaque maps. Proc Natl Acad Sci USA 106: 1995-2000, 2009.
83. Reinders AA, Cläscher J, de Jong JR, Willemsen AT, den Boer JA, Büchel C. Detecting fearful and neutral faces: BOLD latency differences in amygdala-hippocampal junction. Neuroimage 33: 805-814, 2006.
84. Reinders AA, den Boer JA, Büchel C. The robustness of perception. Eur J Neurosci 22: 524-530, 2005.
85. Righart R, Andersson F, Schwartz S, Mayer E, Vuilleumier P. Top-down activation of fusiform cortex without seeing faces in prosopagnosia. Cereb Cortex 20: 1878-1890, 2010.
86. Riesenhuber M, Poggio T. Hierarchical models of object recognition in cortex. Nat Neurosci 2: 1019-1025, 1999.
87. Rolls ET, Tovee MJ. Sparseness of the neuronal representation of stimuli in the primate temporal visual-cortex. J Neurophysiol 73: 713-726, 1995.
88. Rossion B. Constraining the cortical face network by neuroimaging studies of acquired prosopagnosia. Neuroimage 40: 423-426, 2008.
89. Rossion B, Caharel S. ERP evidence for the speed of face categorization in the human brain: disentangling the contribution of low-level visual cues from face perception. Vision Res 51: 1297-1311, 2011.
90. Rossion B, Caldara R, Seghier M, Schuller AM, Lazeyras F, Mayer E. A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. Brain 126: 2381-2395, 2003.
91. Rossion B, Dricot L, Goebel R, Busigny T. Holistic face categorization in higher order visual areas of the normal and prosopagnosic brain: toward a non-hierarchical view of face perception. Front Hum Neurosci 4: 225, 2011.
92. Rossion B, Jacques C. Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170. Neuroimage 39: 1959-1979, 2008.
93. Rossion B, Jacques C. The N170: understanding the time-course of face perception in the human brain. In: The Oxford Handbook of ERP Components, edited by Kappenman ES, Luck SJ. New York: Oxford University Press, 2011.
94. Rousselet GA, Mace MJ, Fabre-Thorpe M. Is it an animal? Is it a human face? Fast processing in upright and inverted natural scenes. J Vis 3: 440-455, 2003.
95. Sadeh B, Podlipsky I, Zhdanov A, Yovel G. Event-related potential and functional MRI measures of face-selectivity are highly correlated: a simultaneous ERP-fMRI investigation. Hum Brain Mapp, 2010.
96. Sadr J, Sinha P. Object recognition and random image structure evolution. Cogn Sci 28: 259-287, 2004.
97. Sayres R, Wiener K, Dumoulin S, Wandell B, Grill-Spector K. Population receptive field measurements in human ventral category-selective cortex. J Vis 9: 734, 2009.
98. Schiltz C, Rossion B. Faces are represented holistically in the human occipitotemporal cortex. Neuroimage 32: 1385-1394, 2006.
99. Schiltz C, Sorger B, Caldara R, Ahmed F, Mayer E, Goebel R, Rossion B. Impaired face discrimination in acquired prosopagnosia is associated with abnormal response to individual faces in the right middle fusiform gyrus. Cereb Cortex 16: 574-586, 2006.
100. Schwaninger A, Lobmaier J, Collishaw SM. Component and configural information in face recognition. Comput Sci 2525: 643-650, 2002.
101. Schwarzlose RF, Baker CI, Kanwisher N. Separate face and body selectivity on the fusiform gyrus. J Neurosci 25: 11055-11059, 2005.
102. Schwarzlose RF, Swisher JD, Dang S, Kanwisher N. The distribution of category and location information across object-selective regions in human visual cortex. Proc Natl Acad Sci USA 105: 4447-4452, 2008.
103. Sergent J. An investigation into component and configural processes underlying face perception. Br J Psychol 17: 43-63, 1984.
104. Sergent J. Microgenesis of face perception. In: Aspects of Face Processing, edited by Ellis H, Jeeves MA, Newcombe F, Young AW. Dordrecht, The Netherlands: Nijhoff, 1986.
105. Sergent J. Face perception and the right hemisphere. In: Thought Without Language, edited by Weiskrantz L. Oxford: Oxford University Press, 1988, p. 108-131.
106. Sergent J, Ohta S, MacDonald B. Functional neuroanatomy of face and object processing. A positron emission tomography study. Brain 115: 15-36, 1992.
107. Sripati AP, Olson CR. Representing the forest before the trees: a global advantage effect in monkey inferotemporal cortex. J Neurosci 29:7788-7796, 2009.
108. Steeves JK, Culham JC, Duchaine BC, Pratesi CC, Valyear KF, Schindler I, Humphrey GK, Milner AD, Goodale MA. The fusiform face area is not sufficient for face recognition: evidence from a patient with dense prosopagnosia and no occipital face area. Neuropsychologia 44: 594-609, 2006.
109. Sugase Y, Yamane S, Ueno S, Kawano K. Global and fine information coded by single neurons in the temporal visual cortex. Nature 400: 869-873, 1999.
110. Summerfield C, Egner T, Mangels J, Hirsch J. Mistaking a house for a face: neural correlates of misperception in healthy humans. Cereb Cortex 16: 500-508, 2006.
111. Talairach G, Tournoux P. Co-Planar Stereotaxic Atlas of the Human Brain. New York: Thieme, 1988.
112. Tanaka JW, Farah MJ. Parts and wholes in face recognition. Q J Exp Psychol A 46: 225-245, 1993.
113. Tsao DY, Freiwald WA, Tootell RB, Livingstone MS. A cortical region consisting entirely of face-selective cells. Science 311: 670-674, 2006.
114. Tsao DY, Moeller S, Freiwald WA. Comparing face patch systems in macaques and humans. Proc Natl Acad Sci USA 105: 19514-19519, 2008.
115. Tsunoda K, Yamane Y, Nishizaki M, Tanifuji M. Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns. Nat Neurosci 4: 832-838, 2001.
116. Ullman S. Object recognition and segmentation by a fragment-based hierarchy. Trends Cogn Sci 11: 58-64, 2007.
117. Van Essen DC, Maunsell JH. Hierarchical organization and functional streams in the visual cortex. Trends Neurosci 6: 370-375, 1983.
118. VanRullen R. On second glance: still no high-level pop-out effect for faces. Vision Res 46: 3017-3027, 2006.
119. VanRullen R, Thorpe SJ. Is it a bird? Is it a plane? Ultra-rapid visual categorisation of natural and artifactual objects. Perception 30: 655-668, 2001.
120. Wandell BA, Dumoulin SO, Brewer AA. Visual field maps in human cortex. Neuron 56: 366-383, 2007.
121. Watt RJ. Scanning from coarse to fine spatial scales in the human visual system after the onset of a stimulus. J Opt Soc Am A 4: 2006-2021, 1987.
122. Weiner KS, Grill-Spector K. Sparsely-distributed organization of face and limb activations in human ventral temporal cortex. Neuroimage 52: 1559-1573, 2010.
123. Wiggett AJ, Downing PE. The face network: overextended? Neuroimage 40: 420-422, 2008.
124. Wolfe JM, Võ ML, Evans KK, Greene MR. Visual search in scenes involves selective and nonselective pathways. Trends Cogn Sci 15: 77-84, 2011.
125. Yin RK. Looking at upside-down faces. J Exp Psychol 81: 141-145, 1969.
126. Yue X, Cassidy BS, Devaney KJ, Holt DJ, Tootell RB. Lower-level stimulus features strongly influence responses in the fusiform face area. Cereb Cortex 21: 35-47, 2011.
127. Zangenehpour S, Chaudhuri A. Patchy organization and asymmetric distribution of the neural correlates of face processing in monkey inferotemporal cortex. Curr Biol 15: 993-1005, 2005.
128. Zhan CA, Baker CL Jr. Boundary cue invariance in cortical orientation maps. Cereb Cortex 16: 896-906, 2006.
129. Zhang H, Liu J, Huber DE, Rieth CA, Tian J, Lee K. Detecting faces in pure noise images: a functional MRI study on top-down perception. Neuroreport 19: 229-233, 2008.