Hierarchical modular optimization of convolutional networks achieves representations similar to Macaque IT and human ventral stream

Advances in Neural Information Processing Systems

Volumn , Issue , 2013, Pages

  Yamins, Daniel ^a   Hong, Ha ^a   Cadieu, Charles ^a   Dicarlo, James J ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

OPTIMIZATION;

CONSTRUCT MODELS; CONVOLUTIONAL NETWORKS; DISSIMILARITY MATRIX; MODULAR OPTIMIZATIONS; OBJECT RECOGNITION PROBLEM; OPTIMIZATION PROCEDURES; PROCESSING STAGE; VISUAL OBJECT RECOGNITION;

OBJECT RECOGNITION;

EID: 84898929708     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. J. Bergstra, D. Yamins, and D.D. Cox. Making a Science of Model Search, 2012.
2. C. Cadieu, H. Hong, D. Yamins, N. Pinto, N. Majaj, and J.J. DiCarlo. The neural representation benchmark and its evaluation on brain and machine. In International Conference on Learning Representations, May 2013.
3. C. Cadieu, M. Kouh, A. Pasupathy, C. E. Connor, M. Riesenhuber, and T. Poggio. A model of v4 shape selectivity and invariance. J Neurophysiol, 98(3):1733-50, 2007.
4. M. Carandini, J. B. Demb, V. Mante, D. J. Tolhurst, Y. Dan, B. A. Olshausen, J. L. Gallant, and N. C. Rust. Do we know what the early visual system does? J Neurosci, 25(46):10577-97, 2005.
5. M. Churchland and K. Shenoy. Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. Journal of Neurophysiology, 97(6):4235-4257, 2007.
6. C. E. Connor, S. L. Brincat, and A. Pasupathy. Transformation of shape information in the ventral pathway. Curr Opin Neurobiol, 17(2):140-7, 2007.
7. S. V. David, B. Y. Hayden, and J. L. Gallant. Spectral receptive field properties explain shape selectivity in area v4. J Neurophysiol, 96(6):3492-505, 2006.
8. R. Desimone, T. D. Albright, C. G. Gross, and C. Bruce. Stimulus-selective properties of inferior temporal neurons in the macaque. J Neurosci, 4(8):2051-62, 1984.
9. J. J. DiCarlo, D. Zoccolan, and N. C. Rust. How does the brain solve visual object recognition? Neuron, 73(3):415-34, 2012.
10. P.E. Downing, Y. Jiang, M. Shuman, and N. Kanwisher. A cortical area selective for visual processing of the human body. Science, 293:2470-2473, 2001.
11. D.J. Felleman and D.C. Van Essen. Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex, 1:1-47, 1991.
12. J. Freeman and E. Simoncelli. Metamers of the ventral stream. Nature Neuroscience, 14(9):1195-1201, 2011.
13. K. Grill-Spector, Z. Kourtzi, and N. Kanwisher. The lateral occipital complex and its role in object recognition. Vision research, 41(10-11):1409-1422, 2001.
14. C. P. Hung, G. Kreiman, T. Poggio, and J. J. DiCarlo. Fast readout of object identity from macaque inferior temporal cortex. Science, 310(5749):863-6, 2005.
15. N. Kanwisher, J. McDermott, and M. M. Chun. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci, 17(11):4302-11, 1997.
16. R. Kiani, H. Esteky, K. Mirpour, and K. Tanaka. Object category structure in response patterns of neuronal population in monkey inferior temporal cortex. J Neurophysiol, 97(6):4296-309, 2007.
17. Z. Kourtzi and N. Kanwisher. Representation of perceived object shape by the human lateral occipital complex. Science, 293(5534):1506-1509, 2001.
18. N. Kriegeskorte. Relating population-code representations between man, monkey, and computational models. Frontiers in Neuroscience, 3(3):363, 2009.
19. N. Kriegeskorte, M. Mur, D. A. Ruff, R. Kiani, J. Bodurka, H. Esteky, K. Tanaka, and P. A. Bandettini. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron, 60(6):1126-41, 2008.
20. A Krizhevsky, I Sutskever, and G Hinton. ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 2012.
21. P. Lennie and J. A. Movshon. Coding of color and form in the geniculostriate visual pathway (invited review). J Opt Soc Am A Opt Image Sci Vis, 22(10):2013-33, 2005.
22. D. G. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 2004.
23. N. Majaj, H. Najib, E. Solomon, and J.J. DiCarlo. A unified neuronal population code fully explains human object recognition. In Computational and Systems Neuroscience (COSYNE), 2012.
24. David Marr, Tomaso Poggio, and Shimon Ullman. Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. MIT Press, July 2010.
25. J. Mutch and D. G. Lowe. Object class recognition and localization using sparse features with limited receptive fields. IJCV, 2008.
26. Bruno A Olshausen and David J Field. How close are we to understanding v1? Neural computation, 17(8):1665-1699, 2005.
27. N. Pinto, D. D. Cox, and J. J. DiCarlo. Why is Real-World Visual Object Recognition Hard. PLoS Comput Biol, 2008.
28. N. Pinto, D. Doukhan, J. J. DiCarlo, and D. D. Cox. A High-Throughput Screening Approach to Discovering Good Forms of Biologically Inspired Visual Representation. PLoS Computational Biology, 5(11), 2009.
29. T. Serre, A. Oliva, and T. Poggio. A feedforward architecture accounts for rapid categorization. Proc Natl Acad Sci U S A, 104(15):6424-9, 2007. 0027-8424 (Print) Journal Article.
30. Thomas Serre, Gabriel Kreiman, Minjoon Kouh, Charles Cadieu, Ulf Knoblich, and Tomaso Poggio. A quantitative theory of immediate visual recognition. In Prog. Brain Res., volume 165, pages 33-56. Elsevier, 2007.