Independent component analysis in spiking neurons

PLoS Computational Biology

Volumn 6, Issue 4, 2010, Pages

  Savin, Cristina ^a   Joshi, Prashant ^a   Triesch, Jochen ^a  

^a FRANKFURT INSTITUTE FOR ADVANCED STUDIES   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

NEURAL NETWORKS; NEURONS; SENSORY ANALYSIS;

CORTEXES; INDEPENDENT COMPONENTS; INDEPENDENT COMPONENTS ANALYSIS; MODEL-BASED OPC; PLAUSIBLE MECHANISMS; PROPERTY; SCALINGS; SENSORY CODING; SPIKE TIMING DEPENDENT PLASTICITIES; SPIKING NEURONES;

INDEPENDENT COMPONENT ANALYSIS;

ARTICLE; BRAIN CORTEX; INDEPENDENT COMPONENT ANALYSIS; INFORMATION PROCESSING; LEARNING; MATHEMATICAL ANALYSIS; NERVE CELL; NERVE CELL EXCITABILITY; NERVE CELL PLASTICITY; SENSORY EVALUATION; SPIKE WAVE; ACTION POTENTIAL; ALGORITHM; BIOLOGICAL MODEL; PHYSIOLOGY; STATISTICS;

ACTION POTENTIALS; ALGORITHMS; MODELS, NEUROLOGICAL; NEURONAL PLASTICITY; NEURONS; STOCHASTIC PROCESSES;

EID: 77954576671     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1000757     Document Type: Article

References (46)

1. Barlow H (2001) Redundancy reduction revisited. Network 12: 241-253.
2. Simoncelli E, Olshausen B (2001) Natural image statistics and neural representations. Annu Rev Neuroscience 24: 1193-1216.
3. Simoncelli E (2003) Vision and the statistics of the visual environment. Curr Op Neurobiol 13: 144-149.
4. Olshausen B, Field D (2004) Sparse coding of sensory inputs. Curr Op Neurobiol 14: 481-487.
5. Hyvärinen A, Karhunen J, Oja E (2001) Independent Component Analysis. Wiley Series on Adaptive and Learning Systems for Signal Processing, Communication and Control.
6. Klampfl S, Legenstein R, Maass W (2009) Spiking neurons can learn to solve information bottleneck problems and extract independent components. Neural Computation 21: 911-959.
7. Parra L, Beck J, Bell A (2009) On the maximization of information flow between spiking neurons. Neural Comp 21: 1-19.
8. Clopath C, Büsing L, Vasilaki E, Gerstner W (2010) Connectivity reflects coding: a model of voltage-based stdp with homeostasis. Nature Neuroscience.
9. Olshausen B, Field D (1997) Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Research 37: 3311-3325.
10. Olshausen B, Field D (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381: 607-609.
11. Lennie P (2003) The cost of neural computation. Current Biology 13: 493-497.
12. Baddeley R, Abbott L, Booth M, Sengpiel F, Freeman T, et al. (1997) Responses of neurons in primary and inferior temporal visual cortices to natural scenes. Proceedings Biological Sciences 264: 1775-1783.
13. Stemmler M, Koch C (1999) How voltage-dependent conductances can adapt to maximize the information encoded by neuronal firing rate. Nature Neuroscience 2: 521-527.
14. Zhang W, Linden D (2003) The other side of the engram: experience-dependent changes in neuronal intrinsic excitability. Nature Reviews Neuroscience 4: 885-900.
15. Cudmore R, Turrigiano G (2004) Long-term potentiation of intrinsic excitability in LV visual cortical neurons. J Neurophysiol 92: 341-348.
16. Triesch J (2007) Synergies between intrinsic and synaptic plasticity mechanisms. Neural Computation 19: 885-909.
17. Gerstner W, Kempter R, van Hemmen J, Wagner H (1996) A neuronal learning rule for sub-millisecond temporal coding. Nature 383: 76-78.
18. Markram H, Lübke J, Frotscher M, Sackmann B (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APS and EPSPS. Science 275: 213-215.
19. Bi G, Poo M (1998) Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci 18: 10464-10472.
20. Turrigiano G, Nelson S (2004) Homeostatic plasticity in the developing nervous system. Nature Reviews Neuroscience 5: 97-107.
21. Foldiák P (1990) Forming sparse representations by local anti-Hebbian learning. Biological Cybernetics 64: 165-170.
22. Bienenstock E, Cooper L, Munro P (1982) Theory for the development of neuron selectivity: Orientation specificity and binocular interactions in visual cortex. Journal of Neuroscience 2: 32-48.
23. Toyoizumi T, Pfister J, Aihara K, Gerstner W (2005) Generalized Bienenstock- Cooper-Munro rule for spiking neurons that maximizes information transmission. PNAS 102: 5239-5244.
24. Izhikevich E, Desai N (2003) Relating STDP to BCM. Neural Computation 15: 1511-1523.
25. Martinez-Conde S, Macknik S, Hubel D (2004) The role of fixational eye movements in visual perception. Nature Reviews Neuroscience 5: 229-240.
26. Song S, Miller K, Abbott L (2000) Competitive Hebbian learning through spiketiming-dependent synaptic plasticity. Nature Neurosci 3: 919-926.
27. Pfister J, Gerstner W (2006) Triplets of spikes in a model of spike timingdependent plasticity. Journal of Neuroscience 26: 9673-9682.
28. Lücke J, Sahani M (2008) Maximal causes for non-linear component extraction. Journal of Machine Learning Research 9: 1227-1267.
29. Bell A, Sejnowski T (1997) The independent components of natural scenes are edge filters. Vision Research 37: 3327-3338.
30. Hyvärinen A (1999) Survey on Independent Component Analysis. Neural Computing Surveys 2: 94-128.
31. van Hateren J (1998) Independent component filters of natural images compared with simple cells in primary visual cortex. Proceedings of the Royal Society B: Biological Sciences 265: 359-366.
32. Falconbridge M, Stamps R, Badcock D (2006) A simple Hebbian/anti-Hebbian network learns the sparse, independent components of natural images. Neural Computation 18: 415-429.
33. Weber C, Triesch J (2008) A sparse generative model of V1 simple cells with intrinsic plasticity. Neural Computation 20: 1261-1284.
34. Lücke J (2009) Receptive field self-organization in a model of the fine-structure in V1 cortical columns. Neural Computation 21: 2805-2845.
35. Cox D (1955) Some statistical methods connected with series of events. Journal of the Royal Statistical Society, Series B 17: 129-164.
36. Intrator N, Cooper L (1992) Objective function formulation of the BCM theory of visual cortical plasticity: Statistical connections, stability conditions. Neural Networks 5: 3-17.
37. Intrator N (1998) Neuronal goals: efficient coding and coincidence detection. In: Springer-Verlag, editor (1998) ICONIP Hong Kong: Progress in Neural Information Processing, volume 1. pp 29-34.
38. Blais B, Intrator N, Shouval H, Cooper L (1998) Receptive field formation in natural scene environments: comparison of single cell learning rules. Neural Computation 10: 1797-1813.
39. Huber P (1985) Projection pursuit. The Annals of Statistics 13: 435-475.
40. Hyvärinen A (1997) One-unit contrast functions for independent component analysis: a statistical analysis. In: Neural Networks for Signal Processing. Pp 388-397.
41. Oja E (1997) The nonlinear PCA learning rule in independent component analysis. Neurocomputing 17: 25-46.
42. Joshi P, Triesch J (2009) Rules for information-maximization in spiking neurons using intrinsic plasticity. In: Proc. IJCNN. pp 1456-1461.
43. Kapur N (1990) Maximum Entropy Models in Science and Engineering Wiley-Interscience.
44. Olshausen B, Simoncelli E (2001) Natural image statistics and neural representation. Annu Rev Neuroscience 24: 1193-1216.
45. Butko N, Triesch J (2007) Learning sensory representations with intrinsic plasticity. Neurocomputing 70.
46. Macke J, Berens P, Ecker A, Tolias A, Bethge M (2009) Generating spike trains with specified correlation coefficients. Neural Comp 21: 397-423.