The Brain as an Efficient and Robust Adaptive Learner

Neuron

Volumn 94, Issue 5, 2017, Pages 969-977

  Denève, Sophie ^a   Alemi, Alireza ^a   Bourdoukan, Ralph ^a  

^a ECOLE NORMALE SUPÉRIEURE   (France)

Author keywords

adaptive control; balanced excitation inhibition; efficient coding; error feedback; learning; prediction errors; recurrent networks; robustness; spike coding

Indexed keywords

ADAPTIVE BEHAVIOR; ADAPTIVE CONTROL THEORY; ADAPTIVE LEARNING; CONNECTOME; FEEDBACK SYSTEM; INTERNEURON; LEARNING; NERVE CELL INHIBITION; NERVE CELL NETWORK; NERVE CELL PLASTICITY; NERVE CELL STIMULATION; NEUROPHYSIOLOGY; PREDICTION; PRIORITY JOURNAL; REVIEW; SPIKE; TASK PERFORMANCE; THEORY; ADAPTATION; BRAIN; CONSTRUCTIVE FEEDBACK; HUMAN; NERVE CELL; PHYSIOLOGY;

ADAPTATION, PHYSIOLOGICAL; BRAIN; FORMATIVE FEEDBACK; HUMANS; INTERNEURONS; LEARNING; NEURAL INHIBITION; NEURONAL PLASTICITY; NEURONS;

EID: 85020287484     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2017.05.016     Document Type: Review

References (43)

1. Abbott, L.F., DePasquale, B., Memmesheimer, R.-M., Building functional networks of spiking model neurons. Nat. Neurosci. 19 (2016), 350–355.
2. Barrett, D., Deneve, S., Machens, C., Optimal compensation for neuron death. bioRxiv, 2015, 10.1101/029512.
3. Boerlin, M., Denève, S., Spike-based population coding and working memory. PLoS Comput. Biol., 7, 2011, e1001080.
4. Boerlin, M., Machens, C.K., Denève, S., Predictive coding of dynamical variables in balanced spiking networks. PLoS Comput. Biol., 9, 2013, e1003258.
5. Bourdoukan, R., and Denève, S. (2015). Enforcing balance allows local supervised learning in spiking recurrent networks. In Advances in Neural Information Processing Systems, pp. 982–990.
6. Bourdoukan, R., Barrett, D., Deneve, S., and Machens, C.K. (2012). Learning optimal spike-based representations. In Advances in Neural Information Processing Systems, pp. 2285–2293.
7. Brea, J., Gaál, A.T., Urbanczik, R., Senn, W., Prospective coding by spiking neurons. PLoS Comput. Biol., 12, 2016, e1005003.
8. Brendel, W., Bourdoukan, R., and Vertechi, P. (2017). Learning to represent signals spike by spike. arXiv, arXiv:1703.03777.
9. Brown, H., Adams, R.A., Parees, I., Edwards, M., Friston, K., Active inference, sensory attenuation and illusions. Cogn. Process. 14 (2013), 411–427.
10. Chalk, M., Gutkin, B., Denève, S., Neural oscillations as a signature of efficient coding in the presence of synaptic delays. eLife, 5, 2016, e13824.
11. Churchland, M.M., Yu, B.M., Cunningham, J.P., Sugrue, L.P., Cohen, M.R., Corrado, G.S., Newsome, W.T., Clark, A.M., Hosseini, P., Scott, B.B., et al. Stimulus onset quenches neural variability: a widespread cortical phenomenon. Nat. Neurosci. 13 (2010), 369–378.
12. Denève, S., Jardri, R., Circular inference: mistaken belief, misplaced trust. Current Opinion in Behavioral Sciences 11 (2016), 40–48.
13. Denève, S., Machens, C.K., Efficient codes and balanced networks. Nat. Neurosci. 19 (2016), 375–382.
14. Eichler, S.A., Meier, J.C., E-I balance and human diseases—from molecules to networking. Front. Mol. Neurosci., 1, 2008, 2.
15. Eliasmith, C., A unified approach to building and controlling spiking attractor networks. Neural Comput. 17 (2005), 1276–1314.
16. Eliasmith, C., Anderson, C.H., Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems. 2004, MIT press.
17. Gilbert, C.D., Li, W., Top-down influences on visual processing. Nat. Rev. Neurosci. 14 (2013), 350–363.
18. Haruno, M., Wolpert, D.M., Kawato, M., Mosaic model for sensorimotor learning and control. Neural Comput. 13 (2001), 2201–2220.
19. Hebb, D.O., The Organization of Behavior: A Neuropsychological Approach. 1949, John Wiley & Sons.
20. Isaacson, J.S., Scanziani, M., How inhibition shapes cortical activity. Neuron 72 (2011), 231–243.
21. Koren, V., Denève, S., Computational account of spontaneous activity as a signature of predictive coding. PLoS Comput. Biol., 13, 2017, e1005355.
22. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 436–444.
23. Li, N., Daie, K., Svoboda, K., Druckmann, S., Robust neuronal dynamics in premotor cortex during motor planning. Nature 532 (2016), 459–464.
24. Lillicrap, T.P., Cownden, D., Tweed, D.B., Akerman, C.J., Random synaptic feedback weights support error backpropagation for deep learning. Nat. Commun., 7, 2016, 13276.
25. Lin, I.-C., Okun, M., Carandini, M., Harris, K.D., The nature of shared cortical variability. Neuron 87 (2015), 644–656.
26. Rao, R.P., Ballard, D.H., Dynamic model of visual recognition predicts neural response properties in the visual cortex. Neural Comput. 9 (1997), 721–763.
27. Rao, R.P., Ballard, D.H., Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2 (1999), 79–87.
28. Sanner, R.M., Slotine, J.E., Gaussian networks for direct adaptive control. IEEE Trans. Neural Netw. 3 (1992), 837–863.
29. Schiess, M., Urbanczik, R., Senn, W., Somato-dendritic synaptic plasticity and error-backpropagation in active dendrites. PLoS Comput. Biol., 12, 2016, e1004638.
30. Schwemmer, M.A., Fairhall, A.L., Denéve, S., Shea-Brown, E.T., Constructing precisely computing networks with biophysical spiking neurons. J. Neurosci. 35 (2015), 10112–10134.
31. Slotine, J.J.E., Coetsee, J.A., Adaptive sliding controller synthesis for non-linear systems. Int. J. Control 43 (1986), 1631–1651.
32. Slotine, J., Li, W., Nonlinear Applied Control. 1991, Prentive Hall.
33. Sussillo, D., Abbott, L.F., Generating coherent patterns of activity from chaotic neural networks. Neuron 63 (2009), 544–557.
34. Thalmeier, D., Uhlmann, M., Kappen, H.J., Memmesheimer, R.-M., Learning universal computations with spikes. PLoS Comput. Biol., 12, 2016, e1004895.
35. Tolhurst, D.J., Movshon, J.A., Dean, A.F., The statistical reliability of signals in single neurons in cat and monkey visual cortex. Vision Res. 23 (1983), 775–785.
36. Urbanczik, R., Senn, W., Learning by the dendritic prediction of somatic spiking. Neuron 81 (2014), 521–528.
37. van Vreeswijk, C., Sompolinsky, H., Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274 (1996), 1724–1726.
38. Vertechi, P., Brendel, W., and Machens, C.K. (2014). Unsupervised learning of an efficient short-term memory network. In Advances in Neural Information Processing Systems, pp. 3653–3661.
39. Vogels, T.P., Sprekeler, H., Zenke, F., Clopath, C., Gerstner, W., Inhibitory plasticity balances excitation and inhibition in sensory pathways and memory networks. Science 334 (2011), 1569–1573.
40. Wolpert, D.M., Ghahramani, Z., Computational principles of movement neuroscience. Nat. Neurosci. 3:Suppl (2000), 1212–1217.
41. Yizhar, O., Fenno, L.E., Prigge, M., Schneider, F., Davidson, T.J., O'Shea, D.J., Sohal, V.S., Goshen, I., Finkelstein, J., Paz, J.T., et al. Neocortical excitation/inhibition balance in information processing and social dysfunction. Nature 477 (2011), 171–178.
42. Zhang, S., Xu, M., Kamigaki, T., Hoang Do, J.P., Chang, W.C., Jenvay, S., Miyamichi, K., Luo, L., Dan, Y., Selective attention. Long-range and local circuits for top-down modulation of visual cortex processing. Science 345 (2014), 660–665.
43. Žiburkus, J., Cressman, J.R., Schiff, S.J., Seizures as imbalanced up states: excitatory and inhibitory conductances during seizure-like events. J. Neurophysiol. 109 (2013), 1296–1306.