How invariant feature selectivity is achieved in cortex

Frontiers in Synaptic Neuroscience

Volumn 8, Issue AUG, 2016, Pages

  Sharpee, Tatyana O ^a  

^a SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

Author keywords

Area V4; Auditory system; Convolutional Neural Networks (CNN); Curvature; Object recognition; Phase invariance; Quadrature model; Visual system

Indexed keywords

AUDITORY SYSTEM; BRAIN CORTEX; MODEL; NERVE CELL; RECOGNITION; STIMULUS; STRIATE CORTEX; VISION; VISUAL AREA V4;

EID: 84993981981     PISSN: None     EISSN: 16633563     Source Type: Journal    
DOI: 10.3389/fnsyn.2016.00026     Document Type: Article

References (74)

1. Adelson, E. H., and Bergen, J. R. (1985). Spatiotemporal energy models for the perception of motion. J. Opt. Soc. Am. A 2, 284-299. doi: 10.1364/JOSAA.2.000284
2. Aldworth, Z. N., Miller, J. P., Gedeon, T., Cummins, G. I., and Dimitrov, A. G. (2005). Dejittered spike-conditioned stimulus waveforms yield improved estimates of neuronal feature selectivity and spike-timing precision of sensory interneurons. J. Neurosci. 25, 5323-5332. doi: 10.1523/JNEUROSCI.0359-05.2005
3. Atencio, C. A., Sharpee, T. O., and Schreiner, C. E. (2008). Cooperative nonlinearities in auditory cortical neurons. Neuron 58, 956-966. doi: 10.1016/j.neuron.2008.04.026
4. Atencio, C. A., Sharpee, T. O., and Schreiner, C. E. (2009). Hierarchical computation in the canonical auditory cortical circuit. Proc. Natl. Acad. Sci. U.S.A. 106, 21894-21899. doi: 10.1073/pnas.0908383106
5. Bialek, W. (2013). Biophysics: Searching for Principles. Princeton, NJ; Oxford, UK: Princeton University Press.
6. Bialek, W., and de Ruyter van Steveninck, R. R. (2005). Features and dimensions: motion estimation in fly vision. arXiv:q-bio/0505003, 1-18.
7. Bouvrie, J., Rosasco, L., and Poggio, T. (2009). "On invariance in hierarchical models," in Advances in Neural Information Processing Systems, Vol. 22, eds Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, A. Culotta (Red Hook, NY: Curran Associates, Inc.), 162-170.
8. Cadieu, C. F., and Olshausen, B. A. (2012). Learning intermediate-level representations of form and motion from natural movies. Neural Comput. 24, 827-866. doi: 10.1162/NECO_a_00247
9. Cadieu, C., Kouh, M., Pasupathy, A., Connor, C. E., Riesenhuber, M., and Poggio, T. (2007). A model of V4 shape selectivity and invariance. J. Neurophysiol. 98, 1733-1750. doi: 10.1152/jn.01265.2006
10. Carandini, M., and Heeger, D. J. (2013). Normalization as a canonical neural computation. Nat. Rev. Neurosci. 13, 51-62. doi: 10.1038/nrn3136
11. Chichilnisky, E. J. (2001). A simple white noise analysis of neuronal light responses. Network 12, 199-213. doi: 10.1080/713663221
12. Connor, C. E., Brincat, S. L., and Pasupathy, A. (2007). Transformation of shape information in the ventral pathway. Curr. Opin. Neurobiol. 17, 140-147. doi: 10.1016/j.conb.2007.03.002
13. David, S. V., Hayden, B. Y., and Gallant, J. L. (2006). Spectral receptive field properties explain shape selectivity in area V4. J. Neurophysiol. 96, 3492-3505. doi: 10.1152/jn.00575.2006
14. de Boer, E., and Kuyper, P. (1968). Triggered Correlation. IEEE Trans. Biomed. Eng. 15, 169-179. doi: 10.1109/TBME.1968.4502561
15. Desimone, R., Albright, T. D., Gross, C. G., and Bruce, C. (1984). Stimulus-selective properties of inferior temporal neurons in the macaque. J. Neurosci. 4, 2051-2062.
16. DiCarlo, J. J., and Cox, D. D. (2007). Untangling invariant object recognition. Trends Cogn. Sci. 11, 333-341. doi: 10.1016/j.tics.2007.06.010
17. DiCarlo, J. J., Zoccolan, D., and Rust, N. C. (2012). How does the brain solve visual object recognition? Neuron 73, 415-434. doi: 10.1016/j.neuron.2012.01.010
18. Dimitrov, A. G., and Gedeon, T. (2006). Effects of stimulus transformations on estimates of sensory neuron selectivity. J. Comput. Neurosci. 20, 265-283. doi: 10.1007/s10827-006-6357-1
19. Dimitrov, A. G., Sheiko, M. A., Baker, J., and Yen, S. C. (2009). Spatial and temporal jitter distort estimated functional properties of visual sensory neurons. J. Comput. Neurosci. 27, 309-319. doi: 10.1007/s10827-009-0144-8
20. Eickenberg, M., Rowekamp, R. J., Kouh, M., and Sharpee, T. O. (2012). Characterizing responses of translation-invariant neurons: maximally informative invariant dimensions. Neural Comput. 24, 2384-2421. doi: 10.1162/NECO_a_00330
21. Fitzgerald, J. D., Rowekamp, R. J., Sincich, L. C., and Sharpee, T. O. (2011). Second order dimensionality reduction using minimum and maximum mutual information models. PLoS Comput. Biol. 7:e1002249. doi: 10.1371/journal.pcbi.1002249
22. Freeman, J., Field, G. D., Li, P. H., Greschner, M., Gunning, D. E., Mathieson, K., et al. (2015). Mapping nonlinear receptive field structure in primate retina at single cone resolution. Elife 4:e05241. doi: 10.7554/eLife.05241
23. Gallant, J. L., Connor, C. E., Rakshit, S., Lewis, J. W., and Van Essen, D. C. (1996). Neural responses to polar, hyperbolic, and Cartesian gratings in area V4 of the macaque monkey. J. Neurophysiol. 76, 2718-2739.
24. Gollisch, T. (2006). Estimating receptive fields in the presence of spike-time jitter. Network 17, 103-129. doi: 10.1080/09548980600569670
25. Ito, M., and Gilbert, C. D. (1999). Attention modulates contextual influences in the primary visual cortex of alert monkeys. Neuron 22, 593-604. doi: 10.1016/S0896-6273(00)80713-8
26. Ito, M., Westheimer, G., and Gilbert, C. D. (1998). Attention and perceptual learning modulate contextual influences on visual perception. Neuron 20, 1191-1197. doi: 10.1016/S0896-6273(00)80499-7
27. Kaardal, J., Fitzgerald, J. D., Berry, M. J. 2nd., and Sharpee, T. O. (2013). Identifying functional bases for multidimensional neural computations. Neural Comput. 25, 1870-1890. doi: 10.1162/NECO_a_00465
28. Khaligh-Razavi, S. M., and Kriegeskorte, N. (2014). Deep supervised, but not unsupervised, models may explain IT cortical representation. PLoS Comput. Biol. 10:e1003915. doi: 10.1371/journal.pcbi.1003915
29. Kim, A. J., Lazar, A. A., and Slutskiy, Y. B. (2011). System identification of Drosophila olfactory sensory neurons. J. Comput. Neurosci. 30, 143-161. doi: 10.1007/s10827-010-0265-0
30. King, A. J., and Nelken, I. (2009). Unraveling the principles of auditory cortical processing: can we learn from the visual system? Nat. Neurosci. 12, 698-701. doi: 10.1038/nn.2308
31. Koch, C., and Ullman, S. (1985). Shifts in selective visual attention: towards the underlying neural circuitry. Hum. Neurobiol. 4, 219-227.
32. Lawlor, M., and Zucker, S. W. (2013). "Third-order edge statistics: contour continuation, curvature, cortical connections," in Advances in Neural Information Processing Systems 26, Vol. 26, eds C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger (Red Hook, NY: Curran Associates, Inc.), 1763-1771.
33. Le Cun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., et al. (1989). Backpropagation applied to handwritten zip code recognition. Neural Comput. 1, 541-551. doi: 10.1162/neco.1989.1.4.541
34. Lee, H., Grosse, R., Ranganath, R., and Ng, A. (2009). "Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations," in Proceedings of the Twenty-Sixth International Conference on Machine Learning (New York, NY: Association for Computing Machinery), 873-80.
35. Maravall, M., and Diamond, M. E. (2014). Algorithms of whisker-mediated touch perception. Curr. Opin. Neurobiol. 25, 176-186. doi: 10.1016/j.conb.2014.01.014
36. McManus, J. N., Li, W., and Gilbert, C. D. (2011). Adaptive shape processing in primary visual cortex. Proc. Natl. Acad. Sci. U.S.A. 108, 9739-9746. doi: 10.1073/pnas.1105855108
37. Meliza, C. D., and Margoliash, D. (2010). Emergence of selectivity and tolerance in the avian auditory cortex. J. Neurosci. 32, 15158-15168. doi: 10.1523/JNEUROSCI.0845-12.2012
38. Motter, B. C. (2009). Central V4 receptive fields are scaled by the V1 cortical magnification and correspond to a constant-sized sampling of the V1 surface. J. Neurosci. 29, 5749-5757. doi: 10.1523/JNEUROSCI.4496-08.2009
39. Movshon, J. A., and Newsome, W. T. (1996). Visual response properties of striate cortical neurons projecting to area MT in macaque monkeys. J. Neurosci. 16, 7733-7741.
40. Nagel, K. I., and Doupe, A. J. (2008). Organizing principles of spectro-temporal encoding in the avian primary auditory area field L. Neuron 58, 938-955. doi: 10.1016/j.neuron.2008.04.028
41. Nagel, K. I., McLendon, H. M., and Doupe, A. J. (2010). Differential influence of frequency, timing, and intensity cues in a complex acoustic categorization task. J. Neurophysiol. 104, 1426-1437. doi: 10.1152/jn.00028.2010
42. Nandy, A. S., Sharpee, T. O., Reynolds, J. H., and Mitchell, J. F. (2013). The fine structure of shape tuning in area V4. Neuron 78, 1102-1115. doi: 10.1016/j.neuron.2013.04.016
43. Nykamp, D. Q., and Ringach, D. L. (2002). Full identification of a linear-nonlinear system via cross-correlation analysis. J. Vis. 2, 1-11. doi: 10.1167/2.1.1
44. Olshausen, B. A., Anderson, C. H., and Van Essen, D. C. (1995). A multiscale dynamic routing circuit for forming size-and position-invariant object representations. J. Comput. Neurosci. 2, 45-62. doi: 10.1007/BF00962707
45. Olshausen, B., Andersen, C., and Essen, D. V. (1993). A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. J. Neurosci. 13, 4700-4719.
46. Pasupathy, A., and Connor, C. E. (1999). Responses to contour features in macaque area V4. J. Neurophysiol. 82, 2490-2502.
47. Pasupathy, A., and Connor, C. E. (2001). Shape representation in area V4: position-specific tuning for boundary conformation. J. Neurophysiol. 86, 2505-2519.
48. Pasupathy, A., and Connor, C. E. (2002). Population coding of shape in area V4. Nat. Neurosci. 5, 1332-1338. doi: 10.1038/972
49. Roe, A. W., Chelazzi, L., Connor, C. E., Conway, B. R., Fujita, I., Gallant, J. L., et al. (2012). Toward a unified theory of visual area v4. Neuron 74, 12-29. doi: 10.1016/j.neuron.2012.03.011
50. Rust, N. C., and Dicarlo, J. J. (2010). Selectivity and tolerance ("invariance") both increase as visual information propagates from cortical area V4 to IT. J. Neurosci. 30, 12978-12995. doi: 10.1523/JNEUROSCI.0179-10.2010
51. Rust, N. C., and DiCarlo, J. J. (2012). Balanced increases in selectivity and tolerance produce constant sparseness along the ventral visual stream. J. Neurosci. 32, 10170-10182. doi: 10.1523/JNEUROSCI.6125-11.2012
52. Samengo, I., and Gollisch, T. (2012). Spike-triggered covariance: geometric proof, symmetry properties, and extension beyond Gaussian stimuli. J. Comput. Neurosci. 34, 137-161. doi: 10.1007/s10827-012-0411-y
53. Schwartz, O., Pillow, J. W., Rust, N. C., and Simoncelli, E. P. (2006). Spike-triggered neural characterization. J. Vis. 6, 484-507. doi: 10.1167/6.4.13
54. Sen, K., Theunissen, F. E., and Doupe, A. J. (2001). Feature analysis of natural sounds in the songbird auditory forebrain. J. Neurophysiol. 86, 1445-1458. Available online at: http://jn.physiology.org/content/jn/86/3/1445.full.pdf
55. Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., and Poggio, T. (2007). Robust object recognition with cortex-like mechanisms. IEEE Trans. Pattern Anal. Mach. Intell. 29, 411-426. doi: 10.1109/TPAMI.2007.56
56. Sharpee, T. O., Atencio, C. A., and Schreiner, C. E. (2011b). Hierarchical representations in the auditory cortex. Curr. Opin. Neurobiol. 21, 761-767. doi: 10.1016/j.conb.2011.05.027
57. Sharpee, T. O., Kouh, M., and Reynolds, J. H. (2013). Trade-off between curvature tuning and position invariance in visual area V4. Proc. Natl. Acad. Sci. U.S.A. 110, 11618-11623. doi: 10.1073/pnas.1217479110
58. Sharpee, T. O., Miller, K. D., and Stryker, M. P. (2008). On the importance of static nonlinearity in estimating spatiotemporal neural filters with natural stimuli. J. Neurophysiol. 99, 2496-2509. doi: 10.1152/jn.01397.2007
59. Sharpee, T. O., Nagel, K. I., and Doupe, A. J. (2011a). Two-dimensional adaptation in the auditory forebrain. J. Neurophysiol. 106, 1841-1861. doi: 10.1152/jn.00905.2010
60. Sharpee, T. O., Sugihara, H., Kurgansky, A. V., Rebrik, S. P., Stryker, M. P., and Miller, K. D. (2006). Adaptive filtering enhances information transmission in visual cortex. Nature 439, 936-942. doi: 10.1038/nature04519
61. Simoncelli, E. P., and Heeger, D. J. (1998). A model of neuronal responses in visual area MT. Vision Res. 38, 743-761. doi: 10.1016/S0042-6989(97)00183-1
62. Ten Cate, C., Spierings, M., Hubert, J., and Honing, H. (2016). Can birds perceive rhythmic patterns? A review and experiments on a songbird and a parrot species. Front. Psychol. 7:730. doi: 10.3389/fpsyg.2016.00730
63. Theunissen, F. E., and Elie, J. E. (2014). Neural processing of natural sounds. Nat. Rev. Neurosci. 15, 355-366. doi: 10.1038/nrn3731
64. Trefethen, L. N., and Embree, M. (2005). Spectra and Pseudospectra: The Behavior of Nonnormal Matrices and Operators. Princeton, NJ: Princeton University Press.
65. Tsao, D. Y., and Livingstone, M. S. (2008). Mechanisms of face perception. Annu. Rev. Neurosci. 31, 411-437. doi: 10.1146/annurev.neuro.30.051606.094238
66. Ullman, S., and Soloviev, S. (1999). Computation of pattern invariance in brain-like structures. Neural Netw. 12, 1021-1036. doi: 10.1016/S0893-6080(99)00048-9
67. Victor, J., and Shapley, R. (1980). A method of nonlinear analysis in the frequency domain. Biophys. J. 29, 459-483. doi: 10.1016/S0006-3495(80)85146-0
68. Vintch, B., Movshon, J. A., and Simoncelli, E. P. (2015). A convolutional subunit model for neuronal responses in macaque V1. J. Neurosci. 35, 14829-14841. doi: 10.1523/JNEUROSCI.2815-13.2015
69. Vintch, B., Zaharia, A., Movshon, J. A., and Simoncelli, E. P. (2012). "Efficient and direct estimation of a neural subunit model for sensory coding," in Advances in Neural Information Processing Systems 25, eds F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger (Red Hook, NY: Curran Associates, Inc.), 3104-3112.
70. Wark, B., Lundstrom, B. N., and Fairhall, A. (2007). Sensory adaptation. Curr. Opin. Neurobiol. 17, 423-429. doi: 10.1016/j.conb.2007.07.001
71. Yamins, D. L., and DiCarlo, J. J. (2016). Using goal-driven deep learning models to understand sensory cortex. Nat. Neurosci. 19, 356-365. doi: 10.1038/nn.4244
72. Yamins, D. L., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., and DiCarlo, J. J. (2014). Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proc. Natl. Acad. Sci. U.S.A. 111, 8619-8624. doi: 10.1073/pnas.1403112111
73. Zeiler, M. D., and Fergus, R. (2014). Visualizing and understanding convolutional networks. Lect. Notes Comput. Sc. 8689, 818-833. doi: 10.1007/978-3-319-10590-1_53
74. Zoccolan, D., Kouh, M., Poggio, T., and DiCarlo, J. J. (2007). Trade-off between object selectivity and tolerance in monkey inferotemporal cortex. J. Neurosci. 27, 12292-12307. doi: 10.1523/JNEUROSCI.1897-07.2007