Internal representations for face detection: An application of noise-based image classification to BOLD responses

Human Brain Mapping

Volumn 34, Issue 11, 2013, Pages 3101-3115

  Nestor, Adrian ^a   Vettel, Jean M ^b   Tarr, Michael J ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b U S ARMY RESEARCH LABORATORY   (United States)

Author keywords

Face recognition; FMRI; Reverse correlation

Indexed keywords

ADULT; ARTICLE; BOLD SIGNAL; BRAIN REGION; CONTROLLED STUDY; FACE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGE PROCESSING; LUMINANCE; NERVE POTENTIAL; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; PERCEPTION; PRIORITY JOURNAL; RECOGNITION; VISION; VISUAL CORTEX; WHITE NOISE; ALGORITHM; BLOOD; BRAIN MAPPING; CLASSIFICATION; ECHO PLANAR IMAGING; MALE; NUCLEAR MAGNETIC RESONANCE IMAGING; PERCEPTIVE DISCRIMINATION; PHOTOSTIMULATION; PHYSIOLOGY; PROCEDURES; PSYCHOMOTOR PERFORMANCE; YOUNG ADULT;

OXYGEN;

ALGORITHMS; BRAIN MAPPING; DISCRIMINATION (PSYCHOLOGY); ECHO-PLANAR IMAGING; FACE; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; OXYGEN; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; SOCIAL PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84886253429     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.22128     Document Type: Article

References (89)

1. Abbey CK, Eckstein MP (2002): Classification image analysis: Estimation and statistical inference for two-alternative forced-choice experiments. J Vis 2:66-78.
2. Ahumada AJ (2002): Classification image weights and internal noise level estimation. J Vis 2:121-131.
3. Avidan G, Hasson U, Malach R, Behrmann M (2005): Detailed exploration of face-related processing in congenital prosopagnosia. 2. Functional neuroimaging findings. J Cogn Neurosci 17:1150-1167.
4. Barlow HB (1961): Possible principles underlying the transformation of sensory messages. In: Rosenblith W, editor.Sensory Communication. Cambridge, MA:MIT Press. pp217-234.
5. Bar M, Kassam KS, Ghuman AS, Boshyan J, Schmid AM, Schmidt AM, Dale AM, Hämäläinen MS, Marinkovic K, Schacter DL, Rosen BR, Halgren E (2006): Top-down facilitation of visual recognition. Proc Natl Acad Sci USA 103:449-454.
6. Bartlett MS (2007): Information maximization in face processing. Neurocomputing 70:2204-2217.
7. Beard BL, Ahumada AJ (1998): A technique to extract the relevant features for visual task. In: Rogowitz BE, Pappas TN, editors. Human Vision and Electronic Imaging III (SPIE Proceedings, Vol.3299). Bellingham, WA:International Society for Optical Engineering. pp79-85.
8. Bennett CM, Miller MB (2010): How reliable are the results from functional magnetic resonance imaging?Ann NY Acad Sci 1191:133-155.
9. Bindemann M, Burton AM (2009): The role of color in human face detection. Cogn Sci 33:1144-1156.
10. Brainard DH (1997): The psychophysics toolbox. Spat Vis 10:433-436.
11. Caldara R, Seghier ML (2009): The Fusiform Face Area responds automatically to statistical regularities optimal for face categorization. Hum Brain Mapp 30:1615-1625.
12. Chauvin A, Worsley KJ, Schyns PG, Arguin M, Gosselin F (2005): Accurate statistical tests for smooth classification images. J Vis 5:659-667.
13. Costen NP, Parker DM, Craw I (1996): Effects of high-pass and low-pass spatial filtering on face identification. Percept Psychophys 58:602-612.
14. Cox RW (1996): AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 29:162-173.
15. Davidenko N, Remus DA, Grill-Spector K: Face-likeness and image variability drive responses in human face-selective ventral regions. Hum Brain Mapp (in press).
16. deCharms RC (2008): Applications of real-time fMRI. Nat Rev Neurosci 9:720-729.
17. Dupuis-Roy N, Fortin I, Fiset D, Gosselin F (2009): Uncovering gender discrimination cues in a realistic setting. J Vis 9:10.1-10.8.
18. Farroni T, Johnson MH, Menon E, Zulian L, Faraguna D, Csibra G (2005): Newborns' preference for face-relevant stimuli: Effects of contrast polarity. Proc Natl Acad Sci USA 102:17245-17250.
19. Fox CJ, Moon SY, Iaria G, Barton JJ (2009): The correlates of subjective perception of identity and expression in the face network: An fMRI adaptation study. Neuroimage 44:569-580.
20. Freiwald WA, Tsao DY, Livingstone MS (2009): A face feature space in the macaque temporal lobe. Nat Neurosci 12:1187-1196.
21. Friston KJ, Jezzard P, Turner R (1994): Analysis of functional MRI time-series. Hum Brain Mapp 1:153-171.
22. Gauthier I, Tarr MJ, Moylan J, Skudlarski P, Gore JC, Anderson AW (2000): The fusiform "face area" is part of a network that processes faces at the individual level. J Cogn Neurosci 12:495-504.
23. Gilad S, Meng M, Sinha P (2009): Role of ordinal contrast relationships in face encoding. Proc Natl Acad Sci USA 106:5353-5358.
24. Gobbini MI, Haxby JV (2007): Neural systems for recognition of familiar faces. Neuropsychologia 45:32-41.
25. Gold JM, Murray RF, Bennett PJ, Sekuler AB (2000): Deriving behavioural receptive fields for visually completed contours. Curr Biol 10:663-666.
26. Gosselin F, Schyns PG (2001): Bubbles: A technique to reveal the use of information in recognition tasks. Vision Res 41:2261-2271.
27. Gosselin F, Schyns PG (2003): Superstitious perceptions reveal properties of internal representations. Psychol Sci 14:505-509.
28. Grill-Spector K, Knouf N, Kanwisher N (2004): The fusiform face area subserves face perception, not generic within-category identification. Nat Neurosci 7:555-562.
29. Halit H, de Haan M, Schyns PG, Johnson MH (2006): Is high-spatial frequency information used in the early stages of face detection?Brain Res 1117:154-161.
30. Hansen BC, Thompson B, Hess RF, Ellemberg D (2010): Extracting the internal representation of faces from human brain activity: An analogue to reverse correlation. Neuroimage 51:373-390.
31. Harel A, Ullman S, Epshtein B, Bentin S (2007): Mutual information of image fragments predicts categorization in humans: Electrophysiological and behavioral evidence. Vision Res 47:2010-2020.
32. Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, Pietrini P (2001): Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293:2425-2430.
33. Haxby JV, Hoffman EA, Gobbini MI (2000): The distributed human neural system for face perception. Trends Cogn Sci 4:223-233.
34. Horner AJ, Andrews TJ (2009): Linearity of the fMRI response in category-selective regions of human visual cortex. Hum Brain Mapp 30:2628-2640.
35. Ishai A, Schmidt CF, Boesiger P (2005): Face perception is mediated by a distributed cortical network. Brain Res Bull 67:87-93.
36. Jiang Y, He S (2006): Cortical responses to invisible faces: dissociating subsystems for facial-information processing. Curr Biol 16:2023-2029.
37. Johnson MH (2005): Subcortical face processing. Nat Rev Neurosci 6:766-774.
38. Johnson MH, Morton J (1991): Biology and Cognitive Development: The Case of Face Recognition. Oxford:Blackwell.
39. Kanwisher N, McDermott J, Chun MM (1997): The fusiform face area: A module in human extrastriate cortex specialized for face perception. J Neurosci 17:4302-4311.
40. Kanwisher N, Yovel G (2006): The fusiform face area: A cortical region specialized for the perception of faces. Philos Trans R Soc Lond B Biol Sci 361:2109-2128.
41. Keil MS (2008): Does face image statistics predict a preferred spatial frequency for human face processing?Proc Biol Sci 275:2095-2100.
42. Kriegeskorte N (2011): Pattern-information analysis: From stimulus decoding to computational-model testing. Neuroimage 56:411-421.
43. Kriegeskorte N, Formisano E, Sorger B, Goebel R (2007): Individual faces elicit distinct response patterns in human anterior temporal cortex. Proc Natl Acad Sci USA 104:20600-20605.
44. Kriegeskorte N, Lindquist MA, Nichols TE, Poldrack RA, Vul E (2010): Everything you never wanted to know about circular analysis, but were afraid to ask. J Cereb Blood Flow Metab 30:1551-1557.
45. LaConte SM, Peltier SJ, Hu XP (2007): Real-time fMRI using brain-state classification. Hum Brain Mapp 28:1033-1044.
46. Lewi J, Butera R, Paninski L (2009): Sequential optimal design of neurophysiology experiments. Neural Comput 21:619-687.
47. Li J, Liu J, Liang J, Zhang H, Zhao J, Huber DE, Rieth CA, Lee K, Tian J, Shi G (2009): A distributed neural system for top-down face processing. Neurosci Lett 451:6-10.
48. Liu J, Harris A, Kanwisher N (2002): Stages of processing in face perception: An MEG study. Nat Neurosci 5:910-916.
49. Loffler G, Yourganov G, Wilkinson F, Wilson HR (2005): fMRI evidence for the neural representation of faces. Nat Neurosci 8:1386-1390.
50. Miyawaki Y, Uchida H, Yamashita O, Sato MA, Morito Y, Tanabe HC, Sadato N, Kamitani Y (2008): Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron 60:915-929.
51. Murray RF, Bennett PJ, Sekuler AB (2002): Optimal methods for calculating classification images: Weighted sums. J Vis 2:79-104.
52. Naselaris T, Prenger RJ, Kay KN, Oliver M, Gallant JL (2009): Bayesian reconstruction of natural images from human brain activity. Neuron 63:902-915.
53. Näsänen R (1999): Spatial frequency bandwidth used in the recognition of facial images. Vision Res 39:3824-3833.
54. Neri P (2004): Estimation of nonlinear psychophysical kernels. J Vis 4:82-91.
55. Neri P, Levi DM (2006): Receptive versus perceptive fields from the reverse-correlation viewpoint. Vision Res 46:2465-2474.
56. Nestor A, Plaut DC, Behrmann M (2011): Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis. Proc Natl Acad Sci USA 108:9998-10003.
57. Nestor A, Tarr MJ (2008): Gender recognition of human faces using color. Psychol Sci 19:1242-1246.
58. Nestor A, Vettel JM, Tarr MJ (2008): Task-specific codes for face recognition: How they shape the neural representation of features for detection and individuation. PLoS One 3:e3978.
59. Olshausen BA, Field DJ (1996): Natural image statistics and efficient coding. Network 7:333-339.
60. Or CC, Wilson HR (2010): Face recognition: Are viewpoint and identity processed after face detection?Vision Res 50:1581-1589.
61. Peli E, Lee E, Trempe CL, Buzney S (1994): Image enhancement for the visually impaired: The effects of enhancement on face recognition. J Opt Soc Am A Opt Image Sci Vis 11:1929-1939.
62. Pelli DG (1997): The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spat Vis 10:437-442.
63. Pourtois G, Schwartz S, Seghier ML, Lazeyras F, Vuilleumier P (2005): View-independent coding of face identity in frontal and temporal cortices is modulated by familiarity: An event-related fMRI study. Neuroimage 24:1214-1224.
64. Puce A, Allison T, Asgari M, Gore JC, McCarthy G (1996): Differential sensitivity of human visual cortex to faces, letterstrings, and textures: A functional magnetic resonance imaging study. J Neurosci 16:5205-5215.
65. Riesenhuber M, Poggio T (1999): Hierarchical models of object recognition in cortex. Nat Neurosci 2:1019-1025.
66. Rieth CA, Lee K, Lui J, Tian J, Huber DE (2011): Faces in the mist: Illusory face and letter detection. i-Perception 2:458-476.
67. Righart R, Andersson F, Schwartz S, Mayer E, Vuilleumier P (2010): Top-down activation of fusiform cortex without seeing faces in prosopagnosia. Cereb Cortex 20:1878-1890.
68. Ringach D, Shapley R (2004): Reverse correlation in neurophysiology. Cogn Sci 28:147-166.
69. Rossion B, Caldara R, Seghier M, Schuller AM, Lazeyras F, Mayer E (2003): A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. Brain 126:2381-2395.
70. Schwarzlose RF, Swisher JD, Dang S, Kanwisher N (2008): The distribution of category and location information across object-selective regions in human visual cortex. Proc Natl Acad Sci USA 105:4447-4452.
71. Sinha P (2002): Qualitative representations for recognition. In: Goos G, Hartmanis J, van Leeuwen J, editors.Lecture Notes in Computer Science. Heidelberg:Springer-Verlag. pp249-262.
72. Smith FW, Muckli L, Brennan D, Pernet C, Smith ML, Belin P, Gosselin F, Hadley DM, Cavanagh J, Schyns PG (2008): Classification images reveal the information sensitivity of brain voxels in fMRI. Neuroimage 40:1643-1654.
73. Smith ML, Fries P, Gosselin F, Goebel R, Schyns PG (2009): Inverse mapping the neuronal substrates of face categorizations. Cereb Cortex 19:2428-2438.
74. Smith ML, Gosselin F, Schyns PG (2007): From a face to its category via a few information processing states in the brain. Neuroimage 37:974-984.
75. Smith ML, Gosselin F, Schyns PG (2012): Measuring internal representations from behavioral and brain data. Curr Biol 22:191-196.
76. Solomon JA (2002): Noise reveals visual mechanisms of detection and discrimination. J Vis 2:105-120.
77. Summerfield C, Egner T, Mangels J, Hirsch J (2006): Mistaking a house for a face: Neural correlates of misperception in healthy humans. Cereb Cortex 16:500-508.
78. 't Hart BM, Abresch TG, Einhäuser W (2011): Faces in places: Humans and machines make similar face detection errors. PLoS One 6:e25373.
79. Tong F, Nakayama K, Moscovitch M, Weinrib O, Kanwisher N (2000): Response properties of the human fusiform face area. Cogn Neuropsychol 17:257-280.
80. Tsao DY, Livingstone MS (2008): Mechanisms of face perception. Annu Rev Neurosci 31:411-437.
81. Tsao DY, Moeller S, Freiwald WA (2008): Comparing face patch systems in macaques and humans. Proc Natl Acad Sci USA 105:19513-19518
82. Ullman S, Vidal-Naquet M, Sali E (2002): Visual features of intermediate complexity and their use in classification. Nat Neurosci 5:682-687.
83. Viola P, Jones MJ (2004): Robust real-time face detection. Int J Comput Vision 57:137-154.
84. Watson AB, Pelli DG (1983): QUEST-A Bayesian adaptive psychometric method. Percept Psychophys 33:113-120.
85. Wild HA, Busey TA (2004): Seeing faces in the noise: Stochastic activity in perceptual regions of the brain may influence the perception of ambiguous stimuli. Psychon Bull Rev 11:475-481.
86. Winston JS, Henson RN, Fine-Goulden MR, Dolan RJ (2004)fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. J Neurophysiol 92:1830-1839.
87. Xu X, Yue X, Lescroart MD, Biederman I, Kim JG (2009): Adaptation in the fusiform face area (FFA): Image or person?Vision Res 49:2800-2807.
88. Yue X, Cassidy BS, Devaney KJ, Holt DJ, Tootell RB (2011): Lower-level stimulus features strongly influence responses in the fusiform face area. Cereb Cortex 21:35-47.
89. Zhang H, Liu J, Huber DE, Rieth CA, Tian J, Lee K (2008): Detecting faces in pure noise images: A functional MRI study on top-down perception. Neuroreport 19:229-233.