A specialized face-processing model inspired by the organization of monkey face patches explains several face-specific phenomena observed in humans

Scientific Reports

Volumn 6, Issue , 2016, Pages

  Farzmahdi, Amirhossein ^a   Rajaei, Karim ^a   Ghodrati, Masoud ^b   Ebrahimpour, Reza ^a,c   Khaligh Razavi, Seyed Mahdi ^d  

^a INSTITUTE FOR RESEARCH IN FUNDAMENTAL SCIENCES IPM   (Iran)

^b MONASH UNIVERSITY   (Australia)

^c SHAHID RAJAEE TEACHER TRAINING UNIVERSITY   (Iran)

^d MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; DISEASE MODEL; HAPLORHINI; HUMAN VERSUS ANIMAL COMPARISON; MODEL; NERVE POTENTIAL; NEUROSCIENCE; NONHUMAN; PSYCHOLOGICAL MODEL; VISUAL INFORMATION; ANIMAL; BRAIN CORTEX; COMPARATIVE STUDY; FACIAL RECOGNITION; HUMAN; PHOTOSTIMULATION; PHYSIOLOGY; THEORETICAL MODEL;

ANIMALS; CEREBRAL CORTEX; FACIAL RECOGNITION; HAPLORHINI; HUMANS; MODELS, THEORETICAL; PHOTIC STIMULATION;

EID: 84964614549     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep25025     Document Type: Article

References (105)

1. Perrett, D. I., Hietanen, J. K., Oram, M. W., Benson, P. J. & Rolls, E. T. Organization and functions of cells responsive to faces in the temporal cortex [and discussion]. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 335, 23-30 (1992).
2. Tsao, D. Y., Freiwald, W. A., Knutsen, T. A., Mandeville, J. B. & Tootell, R. B. Faces and objects in macaque cerebral cortex. Nat. Neurosci. 6, 989-995 (2003).
3. Moeller, S., Freiwald, W. A. & Tsao, D. Y. Patches with links: a unified system for processing faces in the macaque temporal lobe. Science 320, 1355-1359 (2008).
4. Freiwald, W. A. & Tsao, D. Y. Functional compartmentalization and viewpoint generalization within the macaque face-processing system. Science 330, 845-851 (2010).
5. Kanwisher, N., McDermott, J. & Chun, M. M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302-4311 (1997).
6. Grill-Spector, K., Knouf, N. & Kanwisher, N. The fusiform face area subserves face perception, not generic within-category identification. Nat. Neurosci. 7, 555-562 (2004).
7. Tsao, D. Y., Freiwald, W. A., Tootell, R. B. & Livingstone, M. S. A cortical region consisting entirely of face-selective cells. Science 311, 670-674 (2006).
8. Tsao, D. Y. & Livingstone, M. S. Mechanisms of face perception. Annu. Rev. Neurosci. 31, 411 (2008).
9. McMahon, D. B., Jones, A. P., Bondar, I. V. & Leopold, D. A. Face-selective neurons maintain consistent visual responses across months. Proc. Natl. Acad. Sci. 111, 8251-8256 (2014).
10. Parr, L. A., Hecht, E., Barks, S. K., Preuss, T. M. & Votaw, J. R. Face processing in the chimpanzee brain. Curr. Biol. 19, 50-53 (2009).
11. Parr, L. A. The evolution of face processing in primates. Philos. Trans. R. Soc. B Biol. Sci. 366, 1764-1777 (2011).
12. Dilks, D. D. et al. Awake fMRI reveals a specialized region in dog temporal cortex for face processing. PeerJ 3, e1115 (2015).
13. Pitteri, E., Mongillo, P., Carnier, P., Marinelli, L. & Huber, L. Part-based and configural processing of owner's face in dogs. PloS One 9, e108176 (2014).
14. Kendrick, K. M. & Baldwin, B. A. Cells in temporal cortex of conscious sheep can respond preferentially to the sight of faces. Science 236, 448-450 (1987).
15. Kendrick, K. M., da Costa, A. P., Leigh, A. E., Hinton, M. R. & Peirce, J. W. Sheep don't forget a face. Nature 414, 165-166 (2001).
16. Laguesse, R. & Rossion, B. Face perception is whole or none: disentangling the role of spatial contiguity and interfeature distances in the composite face illusion. Perception 42, 1013-1026 (2013).
17. Rossion, B. The composite face illusion: A whole window into our understanding of holistic face perception. Vis. Cogn. 21, 139-253 (2013).
18. Rossion, B. & Boremanse, A. Nonlinear relationship between holistic processing of individual faces and picture-plane rotation: Evidence from the face composite illusion. J. Vis. 8, 3 (2008).
19. Riesenhuber, M., Jarudi, I., Gilad, S. & Sinha, P. Face processing in humans is compatible with a simple shape-based model of vision. Proc. R. Soc. Lond. B Biol. Sci. 271, S448-S450 (2004).
20. Farah, M. J., Tanaka, J. W. & Drain, H. M. What causes the face inversion effect? J. Exp. Psychol. Hum. Percept. Perform. 21, 628 (1995).
21. Freire, A., Lee, K. & Symons, L. A. The face-inversion effect as a deficit in the encoding of configural information: Direct evidence. Perception 29, 159-170 (2000).
22. Lindsay, D. S., Jack, P. C. & Christian, M. A. Other-race face perception. J. Appl. Psychol. 76, 587 (1991).
23. Michel, C., Caldara, R. & Rossion, B. Same-race faces are perceived more holistically than other-race faces. Vis. Cogn. 14, 55-73 (2006).
24. Mondloch, C. J. et al. Processes underlying the cross-race effect: An investigation of holistic, featural, and relational processing of own-race versus other-race faces. Perception 39, 1065-1085 (2010).
25. Issa, E. B. & DiCarlo, J. J. Precedence of the eye region in neural processing of faces. J. Neurosci. 32, 16666-16682 (2012).
26. Richler, J. J., Palmeri, T. J. & Gauthier, I. Meanings, mechanisms, and measures of holistic processing. Front. Psychol. 3, 553 (2012).
27. Jiang, X. et al. Evaluation of a shape-based model of human face discrimination using fMRI and behavioral techniques. Neuron 50, 159-172 (2006).
28. Yin, R. K. Looking at upside-down faces. J. Exp. Psychol. 81, 141 (1969).
29. Dahl, C. D., Chen, C.-C. & Rasch, M. J. Own-race and own-species advantages in face perception: a computational view. Sci. Rep. 4, 6654 (2014).
30. Blanz, V., Tarr, M. J., Bülthoff, H. H. & Vetter, T. What object attributes determine canonical views? Percept.-Lond. 28, 575-600 (1999).
31. Liu, C. H. & Chaudhuri, A. Reassessing the 3/4 view effect in face recognition. Cognition 83, 31-48 (2002).
32. O'toole, A. J., Edelman, S. & Bülthoff, H. H. Stimulus-specific effects in face recognition over changes in viewpoint. Vision Res. 38, 2351-2363 (1998).
33. Poggio, T. & Serre, T. Models of visual cortex. Scholarpedia 8, 3516 (2013).
34. Poggio, T. & Ullman, S. Vision: are models of object recognition catching up with the brain? Ann. N. Y. Acad. Sci. 1305, 72-82 (2013).
35. Serre, T. In Encyclopedia of Computational Neuroscience, Vol. 1 (eds Jaeger, D. & Jung, R.) 1309-1318 (Springer, 2014).
36. Khaligh-Razavi, S.-M. What you need to know about the state-of-the-art computational models of object-vision: A tour through the models. ArXiv Prepr. 1407, 2776 (2014).
37. Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M. & Poggio, T. Robust object recognition with cortex-like mechanisms. Pattern Anal. Mach. Intell. IEEE Trans. On 29, 411-426 (2007).
38. Rajaei, K., Khaligh-Razavi, S.-M., Ghodrati, M., Ebrahimpour, R. & Abadi, M. E. S. A. A Stable Biologically Motivated Learning Mechanism for Visual Feature Extraction to Handle Facial Categorization. PloS One 7, e38478 (2012).
39. Ghodrati, M., Khaligh-Razavi, S.-M., Ebrahimpour, R., Rajaei, K. & Pooyan, M. How can selection of biologically inspired features improve the performance of a robust object recognition model? PloS One 7, e32357 (2012).
40. Ghodrati, M., Rajaei, K. & Ebrahimpour, R. The importance of visual features in generic vs. specialized object recognition: a computational study. Front. Comput. Neurosci. 8, 78 (2014).
41. Khaligh-Razavi, S. M. & Kriegeskorte, N. Object-vision models that better explain IT also categorize better, but all models fail at both. In 2013 Cosyne Abstract, (Cosyne, Salt Lake City, USA, 2013).
42. Kheradpisheh, S. R., Ghodrati, M., Ganjtabesh, M. & Masquelier, T. Deep Networks Resemble Human Feed-forward Vision in Invariant Object Recognition. ArXiv Prepr. 1508, 03929 (2015).
43. Güçlü, U. & van Gerven, M. A. Deep neural networks reveal a gradient in the complexity of neural representations across the ventral stream. J. Neurosci. 35, 10005-10014 (2015).
44. Khaligh-Razavi, S.-M. & Kriegeskorte, N. Deep supervised, but not unsupervised, models may explain IT cortical representation. PLoS Comput. Biol. 10, e1003915 (2014).
45. Yamins, D. L. et al. Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proc. Natl. Acad. Sci. 111, 8619-8624 (2014).
46. Leibo, J. Z., Mutch, J. & Poggio, T. Why the brain separates face recognition from object recognition. In 24th Advances in Neural Information Processing Systems 711-719 (NIPS, 2011).
47. Tan, C. & Poggio, T. Faces as a "Model Category" for Visual Object Recognition. In MIT-CSAIL-TR-2013-004, CBCL-311 (2013).
48. Kriegeskorte, N. et al. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 60, 1126-1141 (2008).
49. Hubel, D. H. & Wiesel, T. N. Shape and arrangement of columns in cat's striate cortex. J. Physiol. 165, 559-568 (1963).
50. Hubel, D. H. & Wiesel, T. N. Uniformity of monkey striate cortex: a parallel relationship between field size, scatter, and magnification factor. J. Comp. Neurol. 158, 295-305 (1974).
51. LeVay, S., Hubel, D. H. & Wiesel, T. N. The pattern of ocular dominance columns in macaque visual cortex revealed by a reduced silver stain. J. Comp. Neurol. 159, 559-575 (1975).
52. Merzenich, M. M. & Sameshima, K. Cortical plasticity and memory. Curr. Opin. Neurobiol. 3, 187-196 (1993).
53. Gilbert, C. D. Plasticity in visual perception and physiology. Curr. Opin. Neurobiol. 6, 269-274 (1996).
54. Kourtzi, Z. & DiCarlo, J. J. Learning and neural plasticity in visual object recognition. Curr. Opin. Neurobiol. 16, 152-158 (2006).
55. Gilbert, C. D. & Li, W. Adult visual cortical plasticity. Neuron 75, 250-264 (2012).
56. Isik, L., Leibo, J. Z. & Poggio, T. Learning and disrupting invariance in visual recognition with a temporal association rule. Front. Comput. Neurosci. 6, 37 (2012).
57. Grossberg, S. Adaptive Resonance Theory: How a brain learns to consciously attend, learn, and recognize a changing world. Neural Netw. 37, 1-47 (2013).
58. Nili, H. et al. A toolbox for representational similarity analysis. Plos Comput. Biol. 10, e1003553 (2014).
59. Cox, D. D. Do we understand high-level vision? Curr. Opin. Neurobiol. 25, 187-193 (2014).
60. Chen, J.-C. & Lien, J.-J. J. A view-based statistical system for multi-view face detection and pose estimation. Image Vis. Comput. 27, 1252-1271 (2009).
61. Righi, G., Peissig, J. J. & Tarr, M. J. Recognizing disguised faces. Vis. Cogn. 20, 143-169 (2012).
62. McGugin, R. W., Tanaka, J. W., Lebrecht, S., Tarr, M. J. & Gauthier, I. Race-specific perceptual discrimination improvement following short individuation training with faces. Cogn. Sci. 35, 330-347 (2011).
63. Kruskal, J. B. & Wish, M. Multidimensional scaling. Vol. 11, Ch. 7, 93 (Sage, 1978).
64. Shepard, R. N. Multidimensional scaling, tree-fitting, and clustering. Science 210, 390-398 (1980).
65. Logothetis, N. K. & Pauls, J. Psychophysical and physiological evidence for viewer-centered object representations in the primate. Cereb. Cortex 5, 270-288 (1995).
66. Crouzet, S. M. & Serre, T. What are the visual features underlying rapid object recognition? Front. Psychol. 2, 326 (2011).
67. Pinto, N. Forward engineering object recognition: a scalable approach. PhD thesis, Massachusetts Institute of Technology Cambridge (2010).
68. Pinto, N., Barhomi, Y., Cox, D. D. & DiCarlo, J. J. Comparing state-of-the-art visual features on invariant object recognition tasks. In Proceedings of the 2011 IEEE Workshop on Applications of Computer Vision (WACV), 463-470 (IEEE Computer Society, 2011).
69. Riesenhuber, M. & Poggio, T. Hierarchical models of object recognition in cortex. Nat. Neurosci. 2, 1019-1025 (1999).
70. Kanwisher, N., Tong, F. & Nakayama, K. The effect of face inversion on the human fusiform face area. Cognition 68, B1-B11 (1998).
71. Rossion, B. Picture-plane inversion leads to qualitative changes of face perception. Acta Psychol. (Amst.) 128, 274-289 (2008).
72. Rossion, B. et al. Spatio-temporal localization of the face inversion effect: an event-related potentials study. Biol. Psychol. 50, 173-189 (1999).
73. Yovel, G. & Kanwisher, N. The neural basis of the behavioral face-inversion effect. Curr. Biol. 15, 2256-2262 (2005).
74. Valentine, T. & Bruce, V. Mental rotation of faces. Mem. Cognit. 16, 556-566 (1988).
75. Jolicoeur, P. The time to name disoriented natural objects. Mem. Cognit. 13, 289-303 (1985).
76. Golby, A. J., Gabrieli, J. D., Chiao, J. Y. & Eberhardt, J. L. Differential responses in the fusiform region to same-race and other-race faces. Nat. Neurosci. 4, 845-850 (2001).
77. Rossion, B. & Michel, C. Oxford Handbook of Face Perception. Vol. 1 (eds Calder, A. J., Rhodes, G., Johnson, M. H. & Haxby, J. V.) Ch. 12, 215-244 (Oxford Univ. Press, 2011).
78. Haxby, J. V. et al. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293, 2425-2430 (2001).
79. Ishai, A., Ungerleider, L. G. & Haxby, J. V. Distributed neural systems for the generation of visual images. Neuron 28, 979-990 (2000).
80. Schwarzlose, R. F., Swisher, J. D., Dang, S. & Kanwisher, N. The distribution of category and location information across objectselective regions in human visual cortex. Proc. Natl. Acad. Sci. 105, 4447-4452 (2008).
81. Spiridon, M. & Kanwisher, N. How distributed is visual category information in human occipito-temporal cortex? An fMRI study. Neuron 35, 1157-1165 (2002).
82. Aguirre, G. K., Zarahn, E. & D'Esposito, M. The inferential impact of global signal covariates in functional neuroimaging analyses. Neuroimage 8, 302-306 (1998).
83. Epstein, R. & Kanwisher, N. A cortical representation of the local visual environment. Nature 392, 598-601 (1998).
84. Hasson, U., Harel, M., Levy, I. & Malach, R. Large-scale mirror-symmetry organization of human occipito-temporal object areas. Neuron 37, 1027-1041 (2003).
85. Maguire, E., Frith, C., Burgess, N., Donnett, J. & O'Keefe, J. Knowing where things are: Parahippocampal involvement in encoding object locations in virtual large-scale space. Cogn. Neurosci. J. Of 10, 61-76 (1998).
86. Downing, P. E., Jiang, Y., Shuman, M. & Kanwisher, N. A cortical area selective for visual processing of the human body. Science 293, 2470-2473 (2001).
87. Pinsk, M. A., DeSimone, K., Moore, T., Gross, C. G. & Kastner, S. Representations of faces and body parts in macaque temporal cortex: a functional MRI study. Proc. Natl. Acad. Sci. USA 102, 6996-7001 (2005).
88. Tromans, J. M., Harris, M. & Stringer, S. M. A computational model of the development of separate representations of facial identity and expression in the primate visual system. PloS One 6, e25616 (2011).
89. Kreiman, G., Koch, C. & Fried, I. Category-specific visual responses of single neurons in the human medial temporal lobe. Nat. Neurosci. 3, 946-953 (2000).
90. Quiroga, R. Q., Reddy, L., Kreiman, G., Koch, C. & Fried, I. Invariant visual representation by single neurons in the human brain. Nature 435, 1102-1107 (2005).
91. Bowers, J. S. On the biological plausibility of grandmother cells: implications for neural network theories in psychology and neuroscience. Psychol. Rev. 116, 220 (2009).
92. Rolls, E. T. The representation of information about faces in the temporal and frontal lobes. Neuropsychologia 45, 124-143 (2007).
93. Carey, S. & Diamond, R. From piecemeal to configurational representation of faces. Science 195, 312-314 (1977).
94. Farah, M. J., Wilson, K. D., Drain, M. & Tanaka, J. N. What is 'special' about face perception? Psychol. Rev. 105, 482 (1998).
95. Peterson, M. A. & Rhodes, G. Perception of Faces, Objects, and Scenes: Analytic and Holistic Processes. Adv. Vis. Cogn. 1, 412 (2003).
96. Schwarzer, G. Development of face categorization: the role of conceptual knowledge. Sprache Kognit. 16, 14-30 (1997).
97. Tanaka, J. W. & Farah, M. J. Parts and wholes in face recognition. Q. J. Exp. Psychol. 46, 225-245 (1993).
98. Retter, T. L. & Rossion, B. Global shape information increases but color information decreases the composite face effect. Perception 44, 511-528 (2015).
99. Rossion, B. & Retter, T. Holistic face perception: Mind the gap! Vis. Cogn. 23, 379-398 (2015).
100. Bruce, H. L. V. Local and relational aspects of face distinctiveness. Q. J. Exp. Psychol. Sect. A 51, 449-473 (1998).
101. Maurer, D., Grand, R. L. & Mondloch, C. J. The many faces of configural processing. Trends Cogn. Sci. 6, 255-260 (2002).
102. Thompson, P. Margaret Thatcher: a new illusion. Perception 9, 483-484 (1980).
103. Wallis, G. Toward a unified model of face and object recognition in the human visual system. Front. Psychol. 4, 497 (2013).
104. Favelle, S. K. & Palmisano, S. The face inversion effect following pitch and yaw rotations: investigating the boundaries of holistic processing. Front. Psychol. 3, 563 (2012).
105. McKone, E. Configural processing and face viewpoint. J. Exp. Psychol. Hum. Percept. Perform. 34, 310 (2008).