When response variability increases neural network robustness to synaptic noise

Neural Computation

Volumn 18, Issue 6, 2006, Pages 1349-1379

  Basalyga, Gleb ^a   Salinas, Emilio ^a  

^a WAKE FOREST SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; ARTIFACT; BIOLOGICAL MODEL; BRAIN CORTEX; CYTOLOGY; HUMAN; MOTONEURON; NERVE CELL NETWORK; PHYSIOLOGY; REVIEW; SENSORY NERVE CELL; SYNAPSE;

ALGORITHMS; ANIMALS; ARTIFACTS; CEREBRAL CORTEX; HUMANS; MODELS, NEUROLOGICAL; MOTOR NEURONS; NERVE NET; NEURONS, AFFERENT; SYNAPSES;

EID: 33646811213     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2006.18.6.1349     Document Type: Review

References (42)

1. Andersen, R. A., Essick, G. K., & Siegel, R. M. (1985). Encoding of spatial location by posterior parietal neurons. Science, 230, 450-458.
2. Ben-Yishai, R., Bar-Or, R. L., & Sompolinsky, H. (1995). Theory of orientation tuning in visual cortex. Proc. Natl. Acad. Sci. USA, 92, 3844-3848.
3. Bishop, C. M. (1995). Training with noise is equivalent to Tikhonov regularization. Neural Computation, 7, 108-116.
4. Brotchie, P. R., Andersen, R. A., Snyder, L. H., & Goodman, S. J. (1995). Head position signals used by parietal neurons to encode locations of visual stimuli. Nature, 375, 232-235.
5. Carpenter, G. A., & Grossberg, S. (1987). Art2: Self-organization of stable category recognition codes for analog input patterns. Applied Optics, 26, 4919-4930.
6. Compte, A., Brunel, N., Goldman-Rakic, P., & Wang, X.-J. (2000). Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cerebral Cortex, 10, 910-923.
7. Crist, R. E., Li, W., & Gilbert, C. (2001). Learning to see: Experience and attention in primary visual cortex. Nature Neumscience, 4(4), 519-525.
8. Dayan, P., & Abbott, L. (2001). Theoretical neuroscience: Computational and mathematical modeling of neural systems. Cambridge, MA: MIT Press.
9. Dean, A. (1981). The variability of discharge of simple cells in the cat striate cortex. Exp. Brain Res., 44, 437-440.
10. Gammaitoni, L., Hänggi, P., Jung, P., & Marchesoni, F. (1998). Stochastic resonance. Rev. Mod. Phys., 70, 223-287.
11. Golub, C. H., & van Loan, C. F. (1996). Matrix computations (3rd ed.). Baltimore, MD: John Hopkins University Press.
12. Hansel, D., & Sompolinsky, H. (1998). Modeling feature selectivity in local cortical circuits. In C. Koch, & L. Segev (Eds.), Methods in neuronal modeling: From synapse to networks (pp. 499-567). Cambridge, MA: MIT Press.
13. Haykin, S. (1999). Neural networks: A comprehensive foundation. Upper Saddle River, NJ: Prentice Hall.
14. Hertz, J., Krogh, A., & Palmer, R. G. (1991). Introduction to the theory of neural computation. Reading, MA: Addison-Wesley.
15. Hinton, G. E. (1989). Connectionist learning procedures. Artificial Intelligence, 40, 185-234.
16. Holt, G. R., Softky, W. R., Koch, C., & Douglas, R. J. (1996). Comparison of discharge variability in vitro and in vivo in cat visual cortex neurons. Journal Neurophysiology, 75, 1806-1814.
17. Hopfield, J. J., & Brody, C. D. (2004). Learning rules and network repair in spike-timing-based computation networks. Proc. Natl. Acad. Sci. USA, 101, 337-342.
18. Kilgard, M. P., & Merzenich, M. M. (1998). Plasticity of temporal information processing in the primary auditory cortex. Nature Neuroscience, 1, 727-731.
19. Laing, C. R., & Chow, C. C. (2001). Stationary bumps in networks of spiking neurons. Neural Computation, 13(7), 1473-1494.
20. Levin, J. E., & Miller, J. P. (1996). Broadband neural encoding in the cricket cereal sensory system enhanced by stochastic resonance. Nature, 380, 165-168.
21. McCloskey, M., & Cohen, N. J. (1989). Catastrophic interference in connectionist networks: The sequential learning problem. Psychology of Learning and Motivation, 24, 109-165.
22. Murray, A. F., & Edwards, P. J. (1994). Enhanced MLP performance and fault tolerance resulting from synaptic weight noise during training. IEEE Transactions on Neural Networks, 5(5), 792-802.
23. Nozaki, D., Mar, D. J., Crigg, P., & Collins, J. J. (1999). Effects of colored noise on stochastic resonance in sensory neurons. Physical Review Letters, 82, 2402-2405.
24. Pouget, A., & Sejnowski, T. J. (1997). Spatial transformations in the parietal cortex using basis functions. Journal of Cognitive Neuroscience, 9, 222-237.
25. Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1992). Numerical recipes in C. Cambridge: Cambridge University Press.
26. Renart, A., Song, P., & Wang, X. J. (2003). Robust spatial working memory through homeostatic synaptic scaling in heterogeneous cortical networks. Neuron, 38, 473-485.
27. Salinas, E. (2003). Background synaptic activity as a switch between dynamical states in a network. Neural Computation, 15(7), 1439-1475.
28. Salinas, E. (2004). Context-dependent selection of visuomotor maps. BMC Neuroscience, 5(1), 47.
29. Salinas, E., & Abbott, L. F. (1995). Transfer of coded information from sensory to motor networks. Journal of Neuroscience, 15, 6461-6474.
30. Salinas, E., & Sejnowski, T. J. (2001). Gain modulation in the central nervous system: Where behavior, neurophysiology and computation meet. Neuroscientist, 2, 539-550.
31. Salinas, E., & Thier, P. (2000). Gain modulation: A major computational principle of the central nervous system. Neuron, 27, 15-21.
32. Seung, H. S., Lee, D. D., Reis, B. Y., & Tank, D. W. (2000). Stability of the memory of eye position in a recurrent network of conductance-based model neurons. Neuron, 26, 259-271.
33. Shadlen, M. N., & Newsome, W. T. (1994). Noise, neural codes and cortical organization. Curr. Opin. Neurobiol, 4, 569-579.
34. Softky, W. P., & Koch, C. (1992). Cortical cells should fire regularly, but do not. Neural Computation, 4(5), 643-646.
35. Softky, W. R., & Koch, C. (1993). The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPS. Journal of Neuroscience, 13, 334-350.
36. Stevens, C. F., & Zador, A. M. (1998). Input synchrony and the irregular firing of cortical neurons. Nature. Neuroscience, 1, 210-217.
37. Turrigiano, G. G., & Nelson, S. B. (2000). Hebb and homeostasis in neuronal plasticity. Curr. Opin. Neurobiol, 10, 358-364.
38. van Kampen, N. G. (1992). Stochastic processes in physics and chemistry. Amsterdam: Elsevier.
39. Vilar, J. M. G.,&Rubi, J.M. (2000). Scaling of noise, and constructive, aspects of fluctuations. Berlin: Springer-Verlag.
40. Wang, X., Merzenich, M. M., Sameshima, K., & Jenkins, W. (1995). Remodelling of hand representation in adult cortex determined by timing of tactile stimulation. Nature, 378, 71-75.
41. Zhang, K. (1996). Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: A theory. Journal of Neuroscience, 16(6), 2112-2126.
42. Zipser, D., & Andersen, R. A. (1988). A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons. Nature, 331, 679-684.