Feedforward inhibition and synaptic scaling - Two sides of the same coin?

PLoS Computational Biology

Volumn 8, Issue 3, 2012, Pages

  Keck, Christian ^a   Savin, Cristina ^b   Lücke, Jörg ^a,c  

^a FRANKFURT INSTITUTE FOR ADVANCED STUDIES   (Germany)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^c GOETHE UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN; NEURONS;

ADAPTIVE PROCESS; BRAIN REGIONS; FEEDFORWARD INHIBITION; MIXTURE MODELING; MODELING APPROACH; NEURAL CIRCUITS; POISSON NOISE; PROBABILISTIC MODELS; SCALINGS; TECHNICAL TERMS;

MAXIMUM LIKELIHOOD;

ARTICLE; CELL INTERACTION; CONTROLLED STUDY; FEEDFORWARD INHIBITION; HEBBIAN PLASTICITY; LEARNING; MATHEMATICAL ANALYSIS; NERVE CELL MEMBRANE POTENTIAL; NERVE CELL PLASTICITY; NERVE CHARACTERISTICS AND FUNCTIONS; POISSON DISTRIBUTION; STATISTICAL MODEL; STIMULUS RESPONSE; SYNAPTIC POTENTIAL; SYNAPTIC SCALING; TASK PERFORMANCE;

EID: 84861110370     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1002432     Document Type: Article

References (64)

1. Baccus SA, Meister M, (2002) Fast and slow contrast adaptation in retinal circuitry. Neuron 36: 909-919.
2. Sclar G, Maunsell JH, Lennie P, (1990) Coding of image contrast in central visual pathways of the macaque monkey. Vision Res 30: 1-10.
3. Mante V, Frazor RA, Bonin V, Geisler WS, Carandini M, (2005) Independence of luminance and contrast in natural scenes and in the early visual system. Nat Neurosci 8: 1690-1697.
4. Stopfer M, Jayaraman V, Laurent G, (2003) Intensity versus identity coding in an olfactory system. Neuron 39: 991-1004.
5. Assisi C, Stopfer M, Laurent G, Bazhenov M, (2007) Adaptive regulation of sparseness by feedforward inhibition. Nat Neurosci 10: 1176-1184.
6. Olsen SR, Wilson RI, (2008) Lateral presynaptic inhibition mediates gain control in an olfactory circuit. Nature 452: 956-960.
7. Swadlow HA, (2003) Fast-spike interneurons and feedforward inhibition in awake sensory neocortex. Cereb Cortex 13: 25-32.
8. Pouille F, Scanziani M, (2001) Enforcement of temporal fidelity in pyramidal cells by somatic feed-forward inhibition. Science 293: 1159-1163.
9. Mittmann W, (2004) Feed-forward inhibition shapes the spike output of cerebellar Purkinje cells. J Physiol 563: 369-378.
10. Wehr M, Zador AM, (2005) Synaptic mechanisms of forward suppression in rat auditory cortex. Neuron 47: 437-445.
11. Pouille F, Marin-Burgin A, Adesnik H, Atallah BV, Scanziani M, (2009) Input normalization by global feedforward inhibition expands cortical dynamic range. Nat Neurosci 12: 1577-1585.
12. Isaacson JS, Scanziani M, (2011) How Inhibition Shapes Cortical Activity. Neuron 72: 231-243.
13. Chance FS, Abbott LF, Reyes AD, (2002) Gain modulation from background synaptic input. Neuron 35: 773-782.
14. Fellous J, Rudolph M, Destexhe A, (2003) Synaptic background noise controls the input/output characteristics of single cells in an in vitro model of in vivo activity. Neuroscience 122: 811-829.
15. Shu Y, Hasenstaub A, Badoual M, Bal T, McCormick DA, (2003) Barrages of synaptic activity control the gain and sensitivity of cortical neurons. J Neurosci 23: 10388-10401.
16. Turrigiano GG, Leslie KR, Desai NS, Rutherford LC, Nelson SB, (1998) Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature 391: 892-896.
17. Leslie KR, Nelson SB, Turrigiano GG, (2001) Postsynaptic depolarization scales quantal amplitude in cortical pyramidal neurons. J Neurosci 21: 1-6.
18. Turrigiano GG, Nelson SB, (2004) Homeostatic plasticity in the developing nervous system. Nat Rev Neurosci 5: 97-107.
19. Turrigiano GG, (2008) The self-tuning neuron: synaptic scaling of excitatory synapses. Cell 135: 422-435.
20. Abbott LF, Nelson SB, (2000) Synaptic plasticity: taming the beast. Nat Neurosci 3: 1178-1183.
21. Gerstner W, Kistler WM, (2002) Mathematical formulations of Hebbian learning. Biol Cybern 87: 404-415.
22. Marr D, (1982) Vision: A Computational Investigation into the Human Representation and Processing of Visual Information New York Henry Holt and Co.
23. Duda RO, Hart PE, Stork DG, (2001) Pattern Classification. Wiley-Interscience (2nd Edition).
24. Dempster AP, Laird NM, Rubin DB, (1977) Maximum likelihood from incomplete data via the EM algorithm (with discussion). J R Stat Soc Series B Stat Methodol 39: 1-38.
25. Neal R, Hinton G, (1998) A view of the EM algorithm that justifies incremental, sparse, and other variants. In: Jordan MI, editors. Learning in Graphical Models Kluwer Academic Publishers pp. 355-368.
26. Yuille AL, Geiger D, (2003) Winner-take-all networks. In: Arbib M, editors. The handbook of brain theory and neural networks MIT Press pp. 1228-1231.
27. Dayan P, Abbott LF, (2001) Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems Cambridge MIT Press.
28. Rao RPN, Olshausen BA, Lewicki MS, eds. (2002) Probabilistic Models of the Brain: Perception and Neural Function. Neural Information Processing Cambridge, MA The MIT Press.
29. Fiser J, Berkes P, Orbán G, Lengyel M, (2010) Statistically optimal perception and learning: from behavior to neural representations. Trends Cogn Sci 14: 119-130.
30. Berkes P, Orban G, Lengyel M, Fiser J, (2011) Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment. Science 331: 83-87.
31. Lochmann T, Deneve S, (2011) Neural processing as causal inference. Curr Opin Neurobiol 21: 774-781.
32. Yuille AL, Grzywacz NM, (1989) A Winner-Take-All mechanism based on presynaptic inhibition feedback. Neural Comput 1: 334-347.
33. Elfadel IM, Wyatt JLJ, (1994) The 'softmax' nonlinearity: Derivation using statistical mechanics and useful properties as a multiterminal analog circuit element. Adv Neural Inf Process Syst 6: 882-887.
34. Kwok T, Smith K, (2005) Optimization via intermittency with a self-organizing neural network. Neural Comput 17: 2454-2481.
35. Fukai T, Tanaka S, (1997) A simple neural network exhibiting selective activation of neuronal ensembles: from winner-take-all to winners-share-all. Neural Comput 9: 77-97.
36. Liu SC, (1999) A winner-take-all circuit with controllable soft max property. Adv Neural Inf Process Syst 12: 717-723.
37. Mao ZH, Massaquoi SG, (2007) Dynamics of winner-take-all competition in recurrent neural networks with lateral inhibition. IEEE Trans Neural Netw 18: 55-69.
38. Ueda N, Nakano R, (1998) Deterministic annealing EM algorithm. Neural Netw 11: 271-282.
39. Sahani M, (1999) Latent variable models for neural data analysis [Ph.D. thesis]. Pasadena (California): California Institute of Technology. Available:citeseer.ist.psu.edu/sahani99latent.html.
40. LeCun Y (NEC). MNIST database of handwritten digits. Available:http://yann.lecun.com/exdb/mnist/.
41. LeCun Y, Bottou L, Bengio Y, Haffner P, (1998) Gradient-based learning applied to document recognition. Proceedings of the IEEE pp. 2278-2324.
42. Hinton G, Osindero S, Teh Y, (2006) A fast learning algorithm for deep belief nets. Neural Comput 18: 1527-1554.
43. Ranzato M, Huang F, Boureau Y, LeCun Y, (2007) Unsupervised learning of invariant feature hierarchies with applications to object recognition. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition; 17-22 June 2007.
44. Bruna J, Mallat S, (2010) Classification with scattering operators. Computing Research Repository abs/1011.3023.
45. Watt AJ, von Rossum MCW, MacLeod KM, Nelson SB, Turrigiano GG, (2000) Activity co-regulates quantal AMPA and NMDA current at neocortical synapses. Neuron 23: 659-670.
46. Echegoyen J, Neu A, Graber KD, Soltesz I, (2007) Homeostatic plasticity studied using in vivo hippocampal activity-blockade: synaptic scaling, intrinsic plasticity and age-dependence. PLoS One 2: e700.
47. Hofer SB, Ko H, Pichler B, Vogelstein J, Ros H, et al. (2011) Differential connectivity and response dynamics of excitatory and inhibitory neurons in visual cortex. Nat Neurosci 14: 1045-1052.
48. Douglas RJ, Martin KAC, (2004) Neuronal circuits of the neocortex. Annu Rev Neurosci 27: 419-451.
49. Bacci A, Huguenard J, (2005) Modulation of neocortical interneurons: extrinsic inuences and exercises in self-control. Trends Neurosci 28: 602-610.
50. Kuo SP, Trussell LO, (2011) Spontaneous Spiking and Synaptic Depression Underlie Noradrenergic Control of Feed-Forward Inhibition. Neuron 71: 306-318.
51. Klinkenberg I, Sambeth A, Blokland A, (2011) Acetylcholine and attention. Behav Brain Res 221: 430-442.
52. Heeger DJ, (1992) Normalization of cell responses in cat striate cortex. Vis Neurosci 9: 181-197.
53. Carandini M, Heeger D, (1997) Linearity and normalization in simple cells of the macaque primary visual cortex. J Neurosci 17: 8621-8644.
54. Rust NC, Schwartz O, Movshon JA, Simoncelli EP, (2005) Spatiotemporal elements of macaque V1 receptive fields. Neuron 46: 945-956.
55. Schwartz O, Simoncelli EP, (2000) Natural sound statistics and divisive normalization in the auditory system. Adv Neural Inf Process Syst pp. 166-172.
56. Rabinowitz NC, Willmore BDB, Schnupp JWH, King AJ, (2011) Contrast gain control in auditory cortex. Neuron 70: 1178-1191.
57. Olsen SR, Bhandawat V, Wilson RI, (2010) Divisive normalization in olfactory population codes. Neuron 66: 287-299.
58. Schwartz O, Simoncelli EP, (2001) Natural signal statistics and sensory gain control. Nat Neurosci 4: 819-825.
59. Ringach DL, (2010) Population coding under normalization. Vision Res 50: 2223-2232.
60. Deneve S, Latham PE, Pouget A, (1999) Reading population codes: a neural implementation of ideal observers. Nat Neurosci 2: 740-745.
61. Reynolds JH, Heeger DJ, (2009) The normalization model of attention. Neuron 61: 168-185.
62. Ohshiro T, Angelaki DE, Deangelis GC, (2011) A normalization model of multisensory integration. Nat Neurosci 14: 775-782.
63. Finn IM, Priebe NJ, Ferster D, (2007) The emergence of contrast-invariant orientation tuning in simple cells of cat visual cortex. Neuron 54: 137-152.
64. Lücke J, Sahani M, (2008) Maximal causes for non-linear component extraction. J Mach Learn Res 9: 1227-1267.