Role of temporal processing stages by inferior temporal neurons in facial recognition

Frontiers in Psychology

Volumn 2, Issue JUN, 2011, Pages

  Sugase Miyamoto, Yasuko ^a   Matsumoto, Narihisa ^a   Kawano, Kenji ^b  

^a NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

^b KYOTO UNIVERSITY   (Japan)

Author keywords

Categorization; Facial identity; Inferior temporal cortex; Temporal dynamics

Indexed keywords

EID: 84867045887     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2011.00141     Document Type: Article

References (92)

1. Afraz, S. R., Kiani, R., and Esteky, H. (2006). Microstimulation of inferotemporal cortex influences face categorization. Nature 442, 692-695.
2. Amaral, D. G., and Price, J. L. (1984). Amygdalo-cortical projections in the monkey (Macaca fascicularis). J. Comp. Neurol. 230, 465-496.
3. Amaral, D. G., Price, J. L., Pitkanen, A., and Carmichael, S. T. (1992). Anatomical Organization of the Primate Amygdaloid Complex. New York: Wiley-Liss, Inc.
4. Anaki, D., and Bentin, S. (2009). Familiarity effects on categorization levels of faces and objects. Cognition 111, 144-149.
5. Anaki, D., Boyd, J., and Moscovitch, M. (2007). Temporal integration in face perception: evidence of configural processing of temporally separated face parts. J. Exp. Psychol. Hum. Percept. Perform. 33, 1-19.
6. Baylis, G. C., Rolls, E. T., and Leonard, C. M. (1987). Functional subdivisions of the temporal lobe neocortex. J. Neurosci. 7, 330-342.
7. Bell, A. H., Hadj-Bouziane, F., Frihauf, J. B., Tootell, R. B., and Ungerleider, L. G. (2009). Object representations in the temporal cortex of monkeys Sugase-Miyamoto et al. Temporal processing stages of face neurons and humans as revealed by functional magnetic resonance imaging. J. Neurophysiol. 101, 688-700.
8. Bondar, I. V., Leopold, D. A., Richmond, B. J., Victor, J. D., and Logothetis, N. K. (2009). Long-term stability of visual pattern selective responses of monkey temporal lobe neurons. PLoS ONE 4, e8222. doi: 10.1371/journal. pone.0008222
9. Borra, E., Ichinohe, N., Sato, T., Tanifuji, M., and Rockland, K. S. (2010). Cortical connections to area TE in monkey: hybrid modular and distributed organization. Cereb. Cortex 20, 257-270.
10. Brincat, S. L., and Connor, C. E. (2004). Underlying principles of visual shape selectivity in posterior inferotemporal cortex. Nat. Neurosci. 7, 880-886.
11. Brincat, S. L., and Connor, C. E. (2006). Dynamic shape synthesis in posterior inferotemporal cortex. Neuron 49, 17-24.
12. Bruce, C., Desimone, R., and Gross, C. G. (1981). Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J. Neurophysiol. 46, 369-384.
13. Cheung, O. S., Richler, J. J., Phillips, W. S., and Gauthier, I. (2011). Does temporal integration of face parts reflect holistic processing? Psychon. Bull. Rev. 18, 476-483.
14. Crouzet, S. M., Kirchner, H., and Thorpe, S. J. (2010). Fast saccades toward faces: face detection in just 100 ms. J. Vis. 10, 16.1-17.
15. Desimone, R., Albright, T. D., Gross, C. G., and Bruce, C. (1984). Stimulusselective properties of inferior temporal neurons in the macaque. J. Neurosci. 4, 2051-2062.
16. Edwards, R., Xiao, D., Keysers, C., Foldiak, P., and Perrett, D. (2003). Color sensitivity of cells responsive to complex stimuli in the temporal cortex. J. Neurophysiol. 90, 1245-1256.
17. Eifuku, S., De Souza, W. C., Tamura, R., Nishijo, H., and Ono, T. (2004). Neuronal correlates of face identification in the monkey anterior temporal cortical areas. J. Neurophysiol. 91, 358-371.
18. Eimer, M. (2000). Event-related brain potentials distinguish processing stages involved in face perception and recognition. Clin. Neurophysiol. 111, 694-705.
19. Engell, A. D., and McCarthy, G. (2010). Selective attention modulates facespecific induced gamma oscillations recorded from ventral occipitotemporal cortex. J. Neurosci. 30, 8780-8786.
20. Fabre-Thorpe, M., Richard, G., and Thorpe, S. J. (1998). Rapid categorization of natural images by rhesus monkeys. Neuroreport 9, 303-308.
21. Fisch, L., Privman, E., Ramot, M., Harel, M., Nir, Y., Kipervasser, S., Andelman, F., Neufeld, M. Y., Kramer, U., Fried, I., and Malach, R. (2009). Neural "ignition": enhanced activation linked to perceptual awareness in human ventral stream visual cortex. Neuron 64, 562-574.
22. Freiwald, W. A., and Tsao, D. Y. (2010). Functional compartmentalization and viewpoint generalization within the macaque face-processing system. Science 330, 845-851.
23. Freiwald, W. A., Tsao, D. Y., and Livingstone, M. S. (2009). A face feature space in the macaque temporal lobe. Nat. Neurosci. 12, 1187-1196.
24. Goffaux, V., Peters, J., Haubrechts, J., Schiltz, C., Jansma, B., and Goebel, R. (2010). From coarse to fine? Spatial and temporal dynamics of cortical face processing. Cereb. Cortex 21, 467-476.
25. Gothard, K. M., Battaglia, F. P., Erickson, C. A., Spitler, K. M., and Amaral, D. G. (2007). Neural responses to facial expression and face identity in the monkey amygdala. J. Neurophysiol. 97, 1671-1683.
26. Grill-Spector, K., and Kanwisher, N. (2005). Visual recognition: as soon as you know it is there, you know what it is. Psychol. Sci. 16, 152-160.
27. Gross, C. G., Rocha-Miranda, C. E., and Bender, D. B. (1972). Visual properties of neurons in inferotemporal cortex of the macaque. J. Neurophysiol. 35, 96-111.
28. Harris, A. M., and Aguirre, G. K. (2008). The effects of parts, wholes, and familiarity on face-selective responses in MEG. J. Vis. 8, 1-12.
29. Hasselmo, M. E., Rolls, E. T., and Baylis, G. C. (1989). The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behav. Brain Res. 32, 203-218.
30. Hegde, J., and Van Essen, D. C. (2004). Temporal dynamics of shape analysis in macaque visual area V2. J. Neurophysiol. 92, 3030-3042.
31. Hegde, J., and Van Essen, D. C. (2006). Temporal dynamics of 2D and 3D shape representation in macaque visual area V4. Vis. Neurosci. 23, 749-763.
32. Hirabayashi, T., and Miyashita, Y. (2005). Dynamically modulated spike correlation in monkey inferior temporal cortex depending on the feature configuration within a whole object. J. Neurosci. 25, 10299-10307.
33. Honey, C., Kirchner, H., and VanRullen, R. (2008). Faces in the cloud: Fourier power spectrum biases ultrarapid face detection. J. Vis. 8, 1-13.
34. Horel, J. A. (1993). Retrieval of a face discrimination during suppression of monkey temporal cortex with cold. Neuropsychologia 31, 1067-1077.
35. Hung, C. P., Kreiman, G., Poggio, T., and DiCarlo, J. J. (2005). Fast readout of object identity from macaque inferior temporal cortex. Science 310, 863-866.
36. Kiani, R., Esteky, H., and Tanaka, K. (2005). Differences in onset latency of macaque inferotemporal neural responses to primate and non-primate faces. J. Neurophysiol. 94, 1587-1596.
37. Kloth, N., Dobel, C., Schweinberger, S. R., Zwitserlood, P., Bolte, J., and Junghofer, M. (2006). Effects of personal familiarity on early neuromagnetic correlates of face perception. Eur. J. Neurosci. 24, 3317-3321.
38. Kobatake, E., and Tanaka, K. (1994). Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. J. Neurophysiol. 71, 856-867.
39. Kuraoka, K., and Nakamura, K. (2006). Impacts of facial identity and type of emotion on responses of amygdala neurons. Neuroreport 17, 9-12.
40. Kveraga, K., Boshyan, J., and Bar, M. (2007). Magnocellular projections as the trigger of top-down facilitation in recognition. J. Neurosci. 27, 13232-13240.
41. Leonard, C. M., Rolls, E. T., Wilson, F. A., and Baylis, G. C. (1985). Neurons in the amygdala of the monkey with responses selective for faces. Behav. Brain Res. 15, 159-176.
42. Lewis, M. B., and Edmonds, A. J. (2003). Face detection: mapping human performance. Perception 32, 903-920.
43. Liu, J., Harris, A., and Kanwisher, N. (2002). Stages of processing in face perception: an MEG study. Nat. Neurosci. 5, 910-916.
44. Matsumoto, N., Okada, M., Sugase-Miyamoto, Y., and Yamane, S. (2005a). Neuronal mechanisms encoding global-to-fine information in inferiortemporal cortex. J. Comput. Neurosci. 18, 85-103.
45. Matsumoto, N., Okada, M., Sugase- Miyamoto, Y., Yamane, S., and Kawano, K. (2005b). Population dynamics of face-responsive neurons in the inferior temporal cortex. Cereb. Cortex 15, 1103-1112.
46. Meeren, H. K., Hadjikhani, N., Ahlfors, S. P., Hamalainen, M. S., and de Gelder, B. (2008). Early category-specific cortical activation revealed by visual stimulus inversion. PLoS ONE 3, e3503. doi: 10.1371/journal.pone.0003503
47. Mishkin, M., Ungerleider, L. G., and Macko, K. A. (1983). Object vision and spatial vision: two cortical pathways. Trends Neurosci. 6, 414-417.
48. Moeller, S., Freiwald, W. A., and Tsao, D. Y. (2008). Patches with links: a unified system for processing faces in the macaque temporal lobe. Science 320, 1355-1359.
49. Mormann, F., Kornblith, S., Quiroga, R. Q., Kraskov, A., Cerf, M., Fried, I., and Koch, C. (2008). Latency and selectivity of single neurons indicate hierarchical processing in the human medial temporal lobe. J. Neurosci. 28, 8865-8872.
50. Nakamura, K., Matsumoto, K., Mikami, A., and Kubota, K. (1994). Visual response properties of single neurons in the temporal pole of behaving monkeys. J. Neurophysiol. 71, 1206-1221.
51. Nakamura, K., Mikami, A., and Kubota, K. (1992). Activity of single neurons in the monkey amygdala during performance of a visual discrimination task. J. Neurophysiol. 67, 1447-1463.
52. Navon, D. (1977). Forest before trees: the precedence of global features in visual perception. Cogn. Psychol. 9, 353-383.
53. Optican, L. M., and Richmond, B. J. (1987). Temporal encoding of twodimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. J. Neurophysiol. 57, 162-178.
54. Or, C. C., and Wilson, H. R. (2010). Face recognition: are viewpoint and identity processed after face detection? Vision Res. 50, 1581-1589.
55. Perrett, D. I., Smith, P. A., Potter, D. D., Mistlin, A. J., Head, A. S., Milner, A. D., and Jeeves, M. A. (1985). Visual cells in the temporal cortex sensitive to face view and gaze direction. Proc. R. Soc. Lond. B Biol. Sci. 223, 293-317.
56. Pinsk, M. A., Arcaro, M., Weiner, K. S., Kalkus, J. F., Inati, S. J., Gross, C. G., and Kastner, S. (2009). Neural representations of faces and body parts in macaque and human cortex: a comparative FMRI study. J. Neurophysiol. 101, 2581-2600.
57. Puce, A., Allison, T., and McCarthy, G. (1999). Electrophysiological studies of human face perception. III: effects of top-down processing on face-specific potentials. Cereb. Cortex 9, 445-458.
58. Quiroga, R. Q., Reddy, L., Kreiman, G., Koch, C., and Fried, I. (2005). Invariant visual representation by single neurons in the human brain. Nature 435, 1102-1107.
59. Richmond, B. J., and Optican, L. M. (1987). Temporal encoding of twodimensional patterns by single units in primate inferior temporal cortex. II. Quantification of response waveform. J. Neurophysiol. 57, 147-161.
60. Richmond, B. J., Optican, L. M., Podell, M., and Spitzer, H. (1987). Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. I. Response characteristics. J. Neurophysiol. 57, 132-146.
61. Riesenhuber, M., and Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nat. Neurosci. 2, 1019-1025.
62. Rousselet, G. A., Fabre-Thorpe, M., and Thorpe, S. J. (2002). Parallel processing in high-level categorization of natural images. Nat. Neurosci. 5, 629-630.
63. Rousselet, G. A., Husk, J. S., Bennett, P. J., and Sekuler, A. B. (2008). Time course and robustness of ERP object and face differences. J. Vis. 8, 1-18.
64. Sadeh, B., Podlipsky, I., Zhdanov, A., and Yovel, G. (2010). Event-related potential and functional MRI measures of face-selectivity are highly correlated: a simultaneous ERP-fMRI investigation. Hum. Brain Mapp. 31, 1490-1501.
65. Saleem, K. S., Suzuki, W., Tanaka, K., and Hashikawa, T. (2000). Connections between anterior inferotemporal cortex and superior temporal sulcus regions in the macaque monkey. J. Neurosci. 20, 5083-5101.
66. Serre, T., Oliva, A., and Poggio, T. (2007). A feedforward architecture accounts for rapid categorization. Proc. Natl. Acad. Sci. U.S.A. 104, 6424-6429.
67. Sheinberg, D. L., and Logothetis, N. K. (1997). The role of temporal cortical areas in perceptual organization. Proc. Natl. Acad. Sci. U.S.A. 94, 3408-3413.
68. Sheinberg, D. L., and Logothetis, N. K. (2001). Noticing familiar objects in real world scenes: the role of temporal cortical neurons in natural vision. J. Neurosci. 21, 1340-1350.
69. Sigala, N., and Logothetis, N. K. (2002). Visual categorization shapes feature selectivity in the primate temporal cortex. Nature 415, 318-320.
70. Singer, J. M., and Sheinberg, D. L. (2006). Holistic processing unites face parts across time. Vision Res. 46, 1838-1847.
71. Sripati, A. P., and Olson, C. R. (2009). Representing the forest before the trees: a global advantage effect in monkey inferotemporal cortex. J. Neurosci. 29, 7788-7796.
72. Sripati, A. P., and Olson, C. R. (2010a). Global image dissimilarity in macaque inferotemporal cortex predicts human visual search efficiency. J. Neurosci. 30, 1258-1269.
73. Sripati, A. P., and Olson, C. R. (2010b). Responses to compound objects in monkey inferotemporal cortex: the whole is equal to the sum of the discrete parts. J. Neurosci. 30, 7948-7960.
74. Sugase, Y., Yamane, S., Ueno, S., and Kawano, K. (1999). Global and fine information coded by single neurons in the temporal visual cortex. Nature 400, 869-873.
75. Tamura, H., and Tanaka, K. (2001). Visual response properties of cells in the ventral and dorsal parts of the macaque inferotemporal cortex. Cereb. Cortex 11, 384-399.
76. Tanaka, H., and Fujita, I. (2000). Global and local processing of visual patterns in macaque monkeys. Neuroreport 11, 2881-2884.
77. Tanaka, H., Onoe, H., Tsukada, H., and Fujita, I. (2001). Attentional modulation of neural activity in the macaque inferior temporal cortex during global and local processing. Neurosci. Res. 39, 469-472.
78. Tanaka, J. W. (2001). The entry point of face recognition: evidence for face expertise. J. Exp. Psychol. Gen. 130, 534-543.
79. Tanaka, J. W., and Farah, M. J. (1993). Parts and wholes in face recognition. Q. J. Exp. Psychol. A 46, 225-245.
80. Tanaka, K. (1996). Inferotemporal cortex and object vision. Annu. Rev. Neurosci. 19, 109-139.
81. Thorpe, S., Fize, D., and Marlot, C. (1996). Speed of processing in the human visual system. Nature 381, 520-522.
82. Tovee, M. J., Rolls, E. T., Treves, A., and Bellis, R. P. (1993). Information encoding and the responses of single neurons in the primate temporal visual cortex. J. Neurophysiol. 70, 640-654.
83. Tsao, D. Y., Freiwald, W. A., Knutsen, T. A., Mandeville, J. B., and Tootell, R. B. (2003). Faces and objects in macaque cerebral cortex. Nat. Neurosci. 6, 989-995.
84. Tsao, D. Y., Freiwald, W. A., Tootell, R. B., and Livingstone, M. S. (2006). A cortical region consisting entirely of faceselective cells. Science 311, 670-674.
85. Tsao, D. Y., Moeller, S., and Freiwald, W. A. (2008). Comparing face patch systems in macaques and humans. Proc. Natl. Acad. Sci. U.S.A. 105, 19514-19519.
86. Tsunoda, K., Yamane, Y., Nishizaki, M., and Tanifuji, M. (2001). Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns. Nat. Neurosci. 4, 832-838.
87. VanRullen, R., and Thorpe, S. J. (2001). The time course of visual processing: from early perception to decisionmaking. J. Cogn. Neurosci. 13, 454-461.
88. Wang, Y., Fujita, I., and Murayama, Y. (2000). Neuronal mechanisms of selectivity for object features revealed by blocking inhibition in inferotemporal cortex. Nat. Neurosci. 3, 807-813.
89. Yamane, S., Kaji, S., and Kawano, K. (1988). What facial features activate face neurons in the inferotemporal cortex of the monkey? Exp. Brain Res. 73, 209-214.
90. Yamane, Y., Carlson, E. T., Bowman, K. C., Wang, Z., and Connor, C. E. (2008). A neural code for three-dimensional object shape in macaque inferotemporal cortex. Nat. Neurosci. 11, 1352-1360.
91. Yamane, Y., Tsunoda, K., Matsumoto, M., Phillips, A. N., and Tanifuji, M. (2006). Representation of the spatial relationship among object parts by neurons in macaque inferotemporal cortex. J. Neurophysiol. 96, 3147-3156.
92. Young, M. P., and Yamane, S. (1992). Sparse population coding of faces in the inferotemporal cortex. Science 256, 1327-1331.