Natural Scene Statistics Account for the Representation of Scene Categories in Human Visual Cortex

Neuron

Volumn 79, Issue 5, 2013, Pages 1025-1034

  Stansbury, DustinE ^a   Naselaris, Thomas ^b   Gallant, JackL ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ALGORITHM; ARTICLE; BOLD SIGNAL; BRAIN FUNCTION; CONTROLLED STUDY; EVOKED RESPONSE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEARNING; PREDICTION; PRIORITY JOURNAL; STATISTICAL ANALYSIS; VISUAL CORTEX; VISUAL STIMULATION;

FUNCTIONAL NEUROIMAGING; HUMANS; LEARNING; MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 84884196207     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2013.06.034     Document Type: Article

References (44)

1. Biederman I. Perceiving real-world scenes. Science 1972, 177:77-80.
2. Biederman I. On the semantics of a glance at a scene. Perceptual Organization 1981, 213-263. Lawrence Erlbaum, Hillsdale. M. Kubovy, J.R. Pomerantz (Eds.).
3. Biederman I., Glass A.L., Stacy E.W. Searching for objects in real-world scences. J.Exp. Psychol. 1973, 97:22-27.
4. Biederman I., Mezzanotte R.J., Rabinowitz J.C. Scene perception: detecting and judging objects undergoing relational violations. Cognit. Psychol. 1982, 14:143-177.
5. Blei D.M., Ng A.Y., Jordan M.I. Latent dirichletallocation. J.Mach. Learn. Res. 2003, 3:993-1022.
6. Buxton R.B. Introduction to Functional Magnetic Resonance Imaging Book Pack: Principles and Techniques 2002, Cambridge University Press, Cambridge.
7. Davenport J.L., Potter M.C. Scene consistency in object and background perception. Psychol. Sci. 2004, 15:559-564.
8. Downing P.E., Jiang Y., Shuman M., Kanwisher N. A cortical area selective for visual processing of the human body. Science 2001, 293:2470-2473.
9. Epstein R.A., Kanwisher N. A cortical representation of the local visual environment. Nature 1998, 392:598-601.
10. Fei-Fei, L., and Perona, P. (2005). A Bayesian hierarchical model for learning natural scene categories. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005, 2, 524-531.
11. Friedman J.H., Hastie T., Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J.Stat. Softw. 2010, 33:1-22.
12. Friston K.J., Holmes A., Poline J.-B., Price C.J., Frith C.D. Detecting activations in PET and fMRI: levels of inference and power. Neuroimage 1996, 4:223-235.
13. Gauthier I., Tarr M.J., Moylan J., Skudlarski P., Gore J.C., Anderson A.W. The fusiform "face area" is part of a network that processes faces at the individual level. J.Cogn. Neurosci. 2000, 12:495-504.
14. Green C.B., Hummel J.E. Familiar interacting object pairs are perceptually grouped. J.Exp. Psychol. Hum. Percept. Perform. 2006, 32:1107-1119.
15. Grill-Spector K. The neural basis of object perception. Curr. Opin. Neurobiol. 2003, 13:159-166.
16. Hansen K.A., Kay K.N., Gallant J.L. Topographic organization in and near human visual area V4. J.Neurosci. 2007, 27:11896-11911.
17. Hasson U., Harel M., Levy I., Malach R. Large-scale mirror-symmetry organization of human occipito-temporal object areas. Neuron 2003, 37:1027-1041.
18. Hastie T., Tibshirani R., Friedman J.H. Model assessment and selection. The Elements of Statistical Learning: Data mining, Inference, and Prediction 2008, 219-260. Springer, New York. Second Edition.
19. Huth A.G., Nishimoto S., Vu A.T., Gallant J.L. A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron 2012, 76:1210-1224.
20. Joubert O.R., Rousselet G.A., Fize D., Fabre-Thorpe M. Processing scene context: fast categorization and object interference. Vision Res. 2007, 47:3286-3297.
21. Kanwisher N., McDermott J., Chun M.M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J.Neurosci. 1997, 17:4302-4311.
22. Kay K.N., David S.V., Prenger R.J., Hansen K.A., Gallant J.L. Modeling low-frequency fluctuation and hemodynamic response timecourse in event-related fMRI. Hum. Brain Mapp. 2008, 29:142-156.
23. Kay K.N., Naselaris T., Prenger R.J., Gallant J.L. Identifying natural images from human brain activity. Nature 2008, 452:352-355.
24. Kim J., Biederman I. Where do objects become scenes?. Cereb. Cortex 2011, 21:1738-1746.
25. MacEvoy S.P., Epstein R.A. Constructing scenes from objects in human occipitotemporal cortex. Nat. Neurosci. 2011, 14:1323-1329.
26. Maguire E.A. The retrosplenial contribution to human navigation: a review of lesion and neuroimaging findings. Scand. J. Psychol. 2001, 42:225-238.
27. Malach R., Reppas J.B., Benson R.R., Kwong K.K., Jiang H., Kennedy W.A., Ledden P.J., Brady T.J., Rosen B.R., Tootell R.B. Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc. Natl. Acad. Sci. USA 1995, 92:8135-8139.
28. Mitchell T.M., Shinkareva S.V., Carlson A., Chang K.-M., Malave V.L., Mason R.A., Just M.A. Predicting human brain activity associated with the meanings of nouns. Science 2008, 320:1191-1195.
29. Nakamura K., Kawashima R., Sato N., Nakamura A., Sugiura M., Kato T., Hatano K., Ito K., Fukuda H., Schormann T., Zilles K. Functional delineation of the human occipito-temporal areas related to face and scene processing. A PET study. Brain 2000, 123:1903-1912.
30. Naselaris T., Prenger R.J., Kay K.N., Oliver M., Gallant J.L. Bayesian reconstruction of natural images from human brain activity. Neuron 2009, 63:902-915.
31. Naselaris T., Stansbury D.E., Gallant J.L. Cortical representation of animate and inanimate objects in complex natural scenes. J.Physiol. Paris 2012, 106:239-249.
32. Nishimoto S., Vu A.T., Naselaris T., Benjamini Y., Yu B., Gallant J.L. Reconstructing visual experiences from brain activity evoked by natural movies. Curr. Biol. 2011, 21:1641-1646.
33. Norman K.A., Polyn S.M., Detre G.J., Haxby J.V. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 2006, 10:424-430.
34. Oliva A., Torralba A. Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 2001, 42:145-175.
35. Olshausen B.A., Field D.J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 1996, 381:607-609.
36. Palmer S.E. The effects of contextual scenes on the identification of objects. Mem. Cognit. 1975, 3:519-526.
37. Peelen M.V., Fei-Fei L., Kastner S. Neural mechanisms of rapid natural scene categorization in human visual cortex. Nature 2009, 460:94-97.
38. Potter M.C. Meaning in visual search. Science 1975, 187:965-966.
39. Smith E.C., Lewicki M.S. Efficient auditory coding. Nature 2006, 439:978-982.
40. Spiridon M., Fischl B., Kanwisher N. Location and spatial profile of category-specific regions in human extrastriate cortex. Hum. Brain Mapp. 2006, 27:77-89.
41. Thirion B., Duchesnay E., Hubbard E., Dubois J., Poline J.-B., Lebihan D., Dehaene S. Inverse retinotopy: inferring the visual content of images from brain activation patterns. Neuroimage 2006, 33:1104-1116.
42. Torralba A., Oliva A. Statistics of natural image categories. Network 2003, 14:391-412.
43. Walther D.B., Caddigan E., Fei-Fei L., Beck D.M. Natural scene categories revealed in distributed patterns of activity in the human brain. J.Neurosci. 2009, 29:10573-10581.
44. Yao, B., Yang, X., and Zhu, S.C. (2007). Introduction to a large-scale general purpose ground truth database: methodology, annotation tool and benchmarks. A.L. Yuille, S.-C. Zhu, D. Cremers, and Y. Wang., eds. Proceedings of the 6th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition, 169-183.