Why neurons mix: High dimensionality for higher cognition

Current Opinion in Neurobiology

Volumn 37, Issue , 2016, Pages 66-74

  Fusi, Stefano ^a   Miller, Earl K ^b   Rigotti, Mattia ^c  

^a Columbia University College of Physicians and Surgeons ^*  (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BEHAVIOR ASSESSMENT; COGNITION; CONCEPTUAL FRAMEWORK; DIMENSIONALITY; FUNCTIONAL ASSESSMENT; HUMAN; MATHEMATICAL COMPUTING; MEASUREMENT; MENTAL TASK; MIXED SELECTIVITY; NONHUMAN; PHYSICAL PARAMETERS; PHYSICAL PHENOMENA; PRIORITY JOURNAL; PROCESS DEVELOPMENT; REVIEW; SIGNAL DETECTION; STIMULUS RESPONSE; TASK PERFORMANCE; ANIMAL; BIOLOGICAL MODEL; NERVE CELL; PHYSIOLOGY;

ANIMALS; COGNITION; HUMANS; MODELS, NEUROLOGICAL; NEURONS;

EID: 84956707246     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2016.01.010     Document Type: Review

References (60)

1. Duncan J. The structure of cognition: attentional episodes in mind and brain. Neuron 2013, 80:35-50. 10.1016/j.neuron.2013.09.015.
2. Mansouri F.A., Matsumoto K., Tanaka K. Prefrontal cell activities related to monkeys' success and failure in adapting to rule changes in a Wisconsin card sorting test analog. J Neurosci 2006, 26:2745-2756.
3. Churchland M.M., Shenoy K.V. Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. J Neurophysiol 2007, 97:4235-4257.
4. Rigotti M., Rubin D.B.D., Morrison S.E., Salzman C.D., Fusi S. Attractor concretion as a mechanism for the formation of context representations. Neuroimage 2010, 52:833-847.
5. Mante V., Sussillo D., Shenoy K.V., Newsome W.T. Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 2013, 503:78-84. 10.1038/nature12742.
6. Rigotti M., Barak O., Warden M.R., Wang X.-J., Daw N.D., Miller E.K., Fusi S. The importance of mixed selectivity in complex cognitive tasks. Nature 2013, 497:585-590. 10.1038/nature12160.
7. Jun J.K., Miller P., Hernández A., Zainos A., Lemus L., Brody C.D., Romo R. Heterogenous population coding of a short-term memory and decision task. J Neurosci 2010, 30:916-929. 10.1523/JNEUROSCI.2062-09.2010.
8. Barak O., Tsodyks M., Romo R. Neuronal population coding of parametric working memory. J Neurosci 2010, 30:9424-9430. 10.1523/JNEUROSCI.1875-10.2010.
9. Stokes M.G., Kusunoki M., Sigala N., Nili H., Gaffan D., Duncan J. Dynamic coding for cognitive control in prefrontal cortex. Neuron 2013, 78:364-375. 10.1016/j.neuron.2013.01.039.
10. Pagan M., Urban L.S., Wohl M.P., Rust N.C. Signals in inferotemporal and perirhinal cortex suggest an untangling of visual target information. Nat Neurosci 2013, 16:1132-1139.
11. Meister M.L., Hennig J.A., Huk A.C. Signal multiplexing and single-neuron computations in lateral intraparietal area during decision-making. J Neurosci 2013, 33:2254-2267. Neurons in primate lateral intraparietal cortex were recorded during a visual direction-discrimination task, while manipulating the presence of a saccade target in their receptive fields during decision-making. Cells were shown to multiplex decision signals with decision-irrelevant visual signals, and also display heterogeneous dynamics that is much more complex than the conventionally reported ramping activity.
12. Raposo D., Kaufman M.T., Churchland A.K. A category-free neural population supports evolving demands during decision-making. Nat Neurosci 2014.
13. McNaughton B.L., Barnes C.A., O'Keefe J. The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats. Exp Brain Res 1983, 52:41-49.
14. Markus E.J., Qin Y.L., Leonard B., Skaggs W.E., McNaughton B.L., Barnes C.A. Interactions between location and task affect the spatial and directional firing of hippocampal neurons. J Neurosci 1995, 15:7079-7094. http://markus.lab.uconn.edu/wp-content/uploads/sites/1005/2015/01/Markus1995.pdf.
15. Wood E.R., Dudchenko P.A., Robitsek R.J., Eichenbaum H. Hippocampal neurons encode information about different types of memory episodes occurring in the same location. Neuron 2000, 27:623-633. http://hsinnamon.web.wesleyan.edu/wescourses/NSB-Psyc255/Readings/17.
16. McKenzie S., Frank A.J., Kinsky N.R., Porter B., Rivière P.D., Eichenbaum H. Hippocampal representation of related and opposing memories develop within distinct, hierarchically organized neural schemas. Neuron 2014, 83:202-215. 10.1016/j.neuron.2014.05.019.
17. Saez A., Rigotti M., Ostojic S., Fusi S., Salzman C.D. Abstract context representations in primate amygdala and prefrontal cortex. Neuron 2015, 87:869-881. 10.1016/j.neuron.2015.07.024.
18. Yuste R. From the neuron doctrine to neural networks. Nat Rev Neurosci 2015, 16:487-497.
19. DiCarlo J.J., Zoccolan D., Rust N.C. How does the brain solve visual object recognition?. Neuron 2012, 73:415-434.
20. Vapnik V.N. The nature of statistical learning theory. Statistics for engineering and information science 2000, Springer-Verlag, New York.
21. Gao P., Ganguli S. On simplicity and complexity in the brave new world of large-scale neuroscience. Curr Opin Neurobiol 2015, 32:148-155.
22. Churchland M.M., Cunningham J.P., Kaufman M.T., Foster J.D., Nuyujukian P., Ryu S.I., Shenoy K.V. Neural population dynamics during reaching. Nature 2012, 487:51-56.
23. Machens C.K., Romo R., Brody C.D. Functional, but not anatomical, separation of "what" and "when" in prefrontal cortex. J Neurosci 2010, 30:350-360. 10.1523/JNEUROSCI.3276-09.2010.
24. LeCun Y., Bengio Y., Hinton G. Deep learning. Nature 2015, 521:436-444. 10.1038/nature14539.
25. Hubel D.H., Wiesel T.N. Receptive fields of single neurones in the cat's striate cortex. J Physiol 1959, 148:574-591.
26. Riesenhuber M., Poggio T. Hierarchical models of object recognition in cortex. Nat Neurosci 1999, 2:1019-1025.
27. DiCarlo J.J., Cox D.D. Untangling invariant object recognition. Trends Cogn Sci 2007, 11:333-341.
28. Anselmi F., Rosasco L., Poggio T. On invariance and selectivity in representation learning 2015, arxiv:1503.05938.
29. Wang W., Carreira-Perpinán M.A. The role of dimensionality reduction in classification. Proc. of the 28th National Conference on Artificial Intelligence (AAAI 2014) 2014.
30. Cadieu C.F., Hong H., Yamins D., Pinto N., Majaj N.J., DiCarlo J.J. The neural representation benchmark and its evaluation on brain and machine 2013, arxiv:1301.3530.
31. Gross C.G., Rocha-Miranda C., Bender D. Visual properties of neurons in inferotemporal cortex of the macaque. J Neurophysiol 1972, 35:96-111.
32. Yamins D.L., Hong H., Cadieu C.F., Solomon E.A., Seibert D., DiCarlo J.J. Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proc Natl Acad Sci U S A 2014, 111:8619-8624.
33. Cortes C., Vapnik V. Support-vector networks. Mach Learn 1995, 20:273-297. 10.1007/BF00994018.
34. Barak O., Rigotti M. A simple derivation of a bound on the perceptron margin using singular value decomposition. Neural Comput 2011, 23:1935-1943. 10.1162/NECO_a_00152.
35. Jaeger H., Haas H. Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 2004, 304:78-80. 10.1126/science.1091277.
36. Maass W., Natschläger T., Markram H. Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput 2002, 14:2531-2560. 10.1162/089976602760407955.
37. Buonomano D.V., Maass W. State-dependent computations: spatiotemporal processing in cortical networks. Nat Rev Neurosci 2009, 10:113-125. 10.1038/nrn2558.
38. Sussillo D., Abbott L.F. Generating coherent patterns of activity from chaotic neural networks. Neuron 2009, 63:544. 10.1016/j.neuron.2009.07.018.
39. Rigotti M., Ben Dayan Rubin D., Wang X.-J., Fusi S. Internal representation of task rules by recurrent dynamics: the importance of the diversity of neural responses. Front Comput Neurosci 2010, 4:29. 10.3389/fncom.2010.00024.
40. Laje R., Buonomano D.V. Robust timing and motor patterns by taming chaos in recurrent neural networks. Nat Neurosci 2013, 16:925-933.
41. Zipser D., Andersen R.A. A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons. Nature 1988, 331:679-684.
42. Andersen R.A., Zipser D. The role of the posterior parietal cortex in coordinate transformations for visual-motor integration. Can J Physiol Pharmacol 1988, 66:488-501.
43. Pouget A., Sejnowski T.J. Spatial transformations in the parietal cortex using basis functions. J Cogn Neurosci 1997, 9:222-237.
44. Salinas E., Abbott L. Coordinate transformations in the visual system: how to generate gain fields and what to compute with them. Prog Brain Res 2001, 130:175-190.
45. Salinas E. Fast remapping of sensory stimuli onto motor actions on the basis of contextual modulation. J Neurosci 2004, 24:1113-1118.
46. Bourjaily M.A., Miller P. Synaptic plasticity and connectivity requirements to produce stimulus-pair specific responses in recurrent networks of spiking neurons. PLoS Comput Biol 2011, 7:e1001091. 10.1371/journal.pcbi.1001091.
47. Bourjaily M.A., Miller P. Dynamic afferent synapses to decision-making networks improve performance in tasks requiring stimulus associations and discriminations. J Neurophysiol 2012, 108:513-527.
48. Rutishauser U., Douglas R.J. State-dependent computation using coupled recurrent networks. Neural Comput 2009, 21:478-509.
49. Huang G.-B., Zhu Q.-Y., Siew C.-K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70:489-501.
50. Barak O., Rigotti M., Fusi S. The sparseness of mixed selectivity neurons controls the generalization-discrimination trade off. J Neurosci 2013, 33:3844-3856. 10.1523/JNEUROSCI.2753-12.2013.
51. Babadi B., Sompolinsky H. Sparseness and expansion in sensory representations. Neuron 2014, 83:1213-1226.
52. Caron S.J., Ruta V., Abbott L., Axel R. Random convergence of olfactory inputs in the drosophila mushroom body. Nature 2013, 497:113-117. Using anatomical tracing techniques, the authors reconstructed the connectivity between glomeruli and Kenyon cells in the Drosophila. They show that each Kenyon cell integrates input from an apparently random combination of glomeruli. These random connections could be used to expand the dimensionality of the glomerular neural representations in order to facilitate learning of olfactory associations and behaviors.
53. Haxby J.V., Guntupalli J.S., Connolly A.C., Halchenko Y.O., Conroy B.R., Gobbini M.I., Hanke M., Ramadge P.J. A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron 2011, 72:404-416.
54. Lehky S.R., Kiani R., Esteky H., Tanaka K. Dimensionality of object representations in monkey inferotemporal cortex. Neural Comput 2014.
55. Balaguer-Ballester E., Lapish C.C., Seamans J.K., Durstewitz D. Attracting dynamics of frontal cortex ensembles during memory-guided decision-making. PLoS Comput Biol 2011, 7:e1002057. 10.1371/journal.pcbi.1002057.
56. Lapish C.C., Balaguer-Ballester E., Seamans J.K., Phillips A.G., Durstewitz D. Amphetamine exerts dose-dependent changes in prefrontal cortex attractor dynamics during working memory. J Neurosci 2015, 35:10172-10187. 10.1523/JNEUROSCI.2421-14.2015.
57. Rigotti M., Fusi S. Estimating the dimensionality of neural responses with fMRI repetition suppression. MLINI workshop at NIPS 2015.
58. Abbott L.F., Dayan P. The effect of correlated variability on the accuracy of a population code. Neural Comput 1999, 11:91-101.
59. Averbeck B.B., Latham P.E., Pouget A. Neural correlations, population coding and computation. Nat Rev Neurosci 2006, 7:358-366. 10.1038/nrn1888.
60. Moreno-Bote R., Beck J., Kanitscheider I., Pitkow X., Latham P., Pouget A. Information-limiting correlations. Nat Neurosci 2014, 17:1410-1417. 10.1038/nn.3807.