Explicit information for category-orthogonal object properties increases along the ventral stream

Nature Neuroscience

Volumn 19, Issue 4, 2016, Pages 613-622

  Hong, Ha ^a,b   Yamins, Daniel L K ^a,b   Majaj, Najib J ^a,b,c   Dicarlo, James J ^a,b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; ARTIFICIAL NEURAL NETWORK; CATEGORY ORTHOGONAL OBJECT PROPERTY; CONTROLLED STUDY; HUMAN; MALE; NERVE POTENTIAL; NONHUMAN; NORMAL DISTRIBUTION; OBJECT MANIPULATION; PHYSICAL PARAMETERS; PRIORITY JOURNAL; RECEPTIVE FIELD; SENSORY SYSTEM ELECTROPHYSIOLOGY; VISION; VISUAL CORTEX; BIOLOGICAL MODEL; BRAIN MAPPING; FEMALE; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; PROCEDURES; PSYCHOMOTOR PERFORMANCE; RECOGNITION; VISUAL SYSTEM;

BRAIN MAPPING; FEMALE; HUMANS; MALE; MODELS, NEUROLOGICAL; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; RECOGNITION (PSYCHOLOGY); VISUAL CORTEX; VISUAL PATHWAYS;

EID: 84959087247     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.4247     Document Type: Article

References (61)

1. DiCarlo, J.J., Zoccolan, D., & Rust, N.C. How does the brain solve visual object recognition?. Neuron 73, 415-434 (2012
2. DiCarlo, J.J., & Cox, D.D. Untangling invariant object recognition. Trends Cogn. Sci. 11, 333-341 (2007
3. Felleman, D.J., & Van Essen, D.C. Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1, 1-47 (1991
4. Tanaka, K. Inferotemporal cortex and object vision. Annu. Rev. Neurosci. 19, 109-139 (1996
5. Logothetis, N.K., & Sheinberg, D.L. Visual object recognition. Annu. Rev. Neurosci. 19, 577-621 (1996
6. Vogels, R., & Orban, G.A. Activity of inferior temporal neurons during orientation discrimination with successively presented gratings. J. Neurophysiol. 71, 1428-1451 (1994
7. Carandini M., et al. Do we know what the early visual system does?. J. Neurosci. 25, 10577-10597 (2005
8. Majaj, N.J., Hong, H., Solomon, E.A., & DiCarlo, J.J. Simple learned weighted sums of inferior temporal neuronal firing rates accurately predict human core object recognition performance. J. Neurosci. 35, 13402-13418 (2015
9. Hung, C.P., Kreiman, G., Poggio, T., & DiCarlo, J.J. Fast readout of object identity from macaque inferior temporal cortex. Science 310, 863-866 (2005
10. Rust, N.C., & Dicarlo, J.J. Selectivity and tolerance (?invariance?) both increase as visual information propagates from cortical area V4 to IT. J. Neurosci. 30, 12978-12995 (2010
11. Movshon, J.A., Thompson, I.D., & Tolhurst, D.J. Spatial summation in the receptive fields of simple cells in the cat?s striate cortex. J. Physiol. (Lond.) 283, 53-77 (1978
12. Gochin, P.M. The representation of shape in the temporal lobe. Behav. Brain Res. 76, 99-116 (1996
13. Ito, M., Tamura, H., Fujita, I., & Tanaka, K. Size and position invariance of neuronal responses in monkey inferotemporal cortex. J. Neurophysiol. 73, 218-226 (1995
14. Goodale, M.A., & Milner, A.D. Separate visual pathways for perception and action. Trends Neurosci. 15, 20-25 (1992
15. Ungerleider, L.G., & Haxby, J.V. ?What? and ?where? in the human brain. Curr. Opin. Neurobiol. 4, 157-165 (1994
16. Bosking, W.H., Crowley, J.C., & Fitzpatrick, D. Spatial coding of position and orientation in primary visual cortex. Nat. Neurosci. 5, 874-882 (2002
17. Zhou, H., Friedman, H.S., & von der Heydt, R. Coding of border ownership in monkey visual cortex. J. Neurosci. 20, 6594-6611 (2000
18. Li, N., Cox, D.D., Zoccolan, D., & DiCarlo, J.J. What response properties do individual neurons need to underlie position and clutter ?invariant? object recognition?. J. Neurophysiol. 102, 360-376 (2009
19. DiCarlo, J.J., & Maunsell, J.H. Anterior inferotemporal neurons of monkeys engaged in object recognition can be highly sensitive to object retinal position. J. Neurophysiol. 89, 3264-3278 (2003
20. Logothetis, N.K., Pauls, J., & Poggio, T. Shape representation in the inferior temporal cortex of monkeys. Curr. Biol. 5, 552-563 (1995
21. MacEvoy, S.P., & Yang, Z. Joint neuronal tuning for object form and position in the human lateral occipital complex. Neuroimage 63, 1901-1908 (2012
22. Nishio, A., Shimokawa, T., Goda, N., & Komatsu, H. Perceptual gloss parameters are encoded by population responses in the monkey inferior temporal cortex. J. Neurosci. 34, 11143-11151 (2014
23. Sayres, R., & Grill-Spector, K. Relating retinotopic and object-selective responses in human lateral occipital cortex. J. Neurophysiol. 100, 249-267 (2008
24. Sereno, A.B., Sereno, M.E., & Lehky, S.R. Recovering stimulus locations using populations of eye-position modulated neurons in dorsal and ventral visual streams of non-human primates. Front. Integr. Neurosci. 8, 28 (2014
25. Edelman, S., & Intrator, N. Towards structural systematicity in distributed, statically bound visual representations. Cogn. Sci. 27, 73-109 (2003
26. Snippe, H.P., & Koenderink, J.J. Discrimination thresholds for channel-coded systems. Biol. Cybern. 66, 543-551 (1992
27. Hinton, G., McClelland, J., & Rumelhart, D. Distributed representations. in Parallel Distributed Processing, Vol 1 (eds. Rumelhart, D., & McClelland, J.) 77-109 (MIT Press, 1986
28. Eurich, C.W., & Schwegler, H. Coarse coding: calculation of the resolution achieved by a population of large receptive field neurons. Biol. Cybern. 76, 357-363 (1997
29. Treisman, A. The binding problem. Curr. Opin. Neurobiol. 6, 171-178 (1996
30. Yamins D.L., et al. Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proc. Natl. Acad. Sci. USA 111, 8619-8624 (2014
31. Khaligh-Razavi, S.M., & Kriegeskorte, N. Deep supervised, but not unsupervised, models may explain it cortical representation. PLoS Comput. Biol. 10, e1003915 (2014
32. Pinto, N., Cox, D.D., & DiCarlo, J.J. Why is real-world visual object recognition hard?. PLoS Comput. Biol. 4, e27 (2008
33. Rajalingham, R., Schmidt, K., & DiCarlo, J.J. Comparison of object recognition behavior in human and monkey. J. Neurosci. 35, 12127-12136 (2015
34. Tsao, D.Y., & Livingstone, M.S. Mechanisms of face perception. Annu. Rev. Neurosci. 31, 411-437 (2008
35. LeCun, Y., & Bengio, Y. Convolutional networks for images, speech, and time series. in The Handbook of Brain Theory and Neural Networks (ed. Arbib, M.A.) 255-258 (MIT Press, 1995
36. Deng J., et al. ImageNet: a large-scale hierarchical image database. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 248-255 (2009
37. Chen, Y., Geisler, W.S., & Seidemann, E. Optimal decoding of correlated neural population responses in the primate visual cortex. Nat. Neurosci. 9, 1412-1420 (2006
38. Mishkin, M., Ungerleider, L.G., & Macko, K.A. Object vision and spatial vision: two cortical pathways. Trends Neurosci. 6, 414-417 (1983
39. Zoccolan, D., Kouh, M., Poggio, T., & DiCarlo, J.J. Trade-off between object selectivity and tolerance in monkey inferotemporal cortex. J. Neurosci. 27, 12292-12307 (2007
40. Serre T., et al. A quantitative theory of immediate visual recognition. Prog. Brain Res. 165, 33-56 (2007
41. Nienborg, H., & Cumming, B.G. Decision-related activity in sensory neurons may depend on the columnar architecture of cerebral cortex. J. Neurosci. 34, 3579-3585 (2014
42. Chikkerur, S., Serre, T., Tan, C., & Poggio, T. What and where: a Bayesian inference theory of attention. Vision Res. 50, 2233-2247 (2010
43. Milner, P.M. A model for visual shape recognition. Psychol. Rev. 81, 521-535 (1974
44. Yildirim I., Kulkarni, T.D., Freiwald, W.A., & Tenenbaum, J.B. Efficient analysis-by-synthesis in vision: a computational framework, behavioral tests, and modeling neuronal representations. Proc. Annu. Conf. Cogn. Sci. Soc. 471 2015
45. Kersten, D., Mamassian, P., & Yuille, A. Object perception as Bayesian inference. Annu. Rev. Psychol. 55, 271-304 (2004
46. Tanaka, K. Columns for complex visual object features in the inferotemporal cortex: clustering of cells with similar but slightly different stimulus selectivities. Cereb. Cortex 13, 90-99 (2003
47. Brown, L.E., Halpert, B.A., & Goodale, M.A. Peripheral vision for perception and action. Exp. Brain Res. 165, 97-106 (2005
48. Sereno, A.B., & Lehky, S.R. Population coding of visual space: comparison of spatial representations in dorsal and ventral pathways. Front. Comput. Neurosci. 4, 159 (2011
49. Rishel, C.A., Huang, G., & Freedman, D.J. Independent category and spatial encoding in parietal cortex. Neuron 77, 969-979 (2013
50. Swaminathan, S.K., & Freedman, D.J. Preferential encoding of visual categories in parietal cortex compared with prefrontal cortex. Nat. Neurosci. 15, 315-320 (2012
51. Rosch, E., Mervis, C.B., Gray, W.D., & Johnson, D.M. Basic objects in natural categories. Cognit. Psychol. 8, 382-439 (1976
52. DiCarlo J.J., & Maunsell, J.H.R. Inferotemporal representations underlying object recognition in the free viewing monkey. Soc. Neurosci. Abstr. 498.2 2000
53. Frey, B.J., & Dueck, D. Clustering by passing messages between data points. Science 315, 972-976 (2007
54. Quiroga, R.Q., Nadasdy, Z., & Ben-Shaul, Y. Unsupervised spike detection and sorting with wavelets and superparamagnetic clustering. Neural Comput. 16, 1661-1687 (2004
55. Pedregosa F., et al. Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825-2830 (2011
56. Rust, N.C., Mante, V., Simoncelli, E.P., & Movshon, J.A. How MT cells analyze the motion of visual patterns. Nat. Neurosci. 9, 1421-1431 (2006
57. Jones E., et al SciPy: open source scientific tools for Python (2001-) http://www.scipy.org/ (15 July 2015
58. Efron, B., & Tibshirani, R.J. An Introduction to the Bootstrap (CRC Press, 1994
59. Kanwisher, N., McDermott, J., & Chun, M.M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302-4311 (1997
60. Krizhevsky A., Sutskever, I., & Hinton, G. ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25 1106-1114 2012
61. Bergstra J., Yamins, D., & Cox, D. Making a science of model search: hyperparameter optimization in hundreds of dimensions for vision architectures. Proc. Int. Conf. Mach. Learn. 115-123 2013