Role of homeostasis in learning sparse representations

Neural Computation

Volumn 22, Issue 7, 2010, Pages 1812-1836

  Perrinet, Laurent U ^a  

^a CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ANIMAL; COMPUTER SIMULATION; HOMEOSTASIS; HUMAN; LEARNING; LETTER; NERVE CELL; NERVE CELL NETWORK; PATTERN RECOGNITION; PHYSIOLOGY; PRIMATE; SIGNAL PROCESSING; VISION; VISUAL CORTEX; VISUAL FIELD;

ACTION POTENTIALS; ANIMALS; COMPUTER SIMULATION; HOMEOSTASIS; HUMANS; LEARNING; NERVE NET; NEURONS; PATTERN RECOGNITION, VISUAL; PRIMATES; SIGNAL PROCESSING, COMPUTER-ASSISTED; VISUAL CORTEX; VISUAL FIELDS; VISUAL PERCEPTION;

EID: 77956001002     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2010.05-08-795     Document Type: Letter

References (51)

1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716-723.
2. Assisi, C., Stopfer, M., Laurent, G., & Bazhenov, M. (2007). Adaptive regulation of sparseness by feedforward inhibition. Nature Neuroscience, 10(9), 1176-1184.
3. Atick, J. J. (1992). Could information theory provide an ecological theory of sensory processing? Network: Computation in Neural Systems, 3(2), 213-252.
4. Barlow, H. B. (2001). Redundancy reduction revisited. Network: Computation in Neural Systems, 12, 241-245.
5. Baudot, P., Levy, M., Monier, C., Chavane, F., René A., Huguet, N., et al. (2004). Time-coding, low noise Vm attractors, and trial-by-trial spiking reproducibility during natural scene viewing in V1 cortex. In Society for Neuroscience Abstracts: 34th Annual Meeting of the Society for Neuroscience, San Diego, USA (pp. 948-512). Washington, DC: Society for Neuroscience.
6. Bednar, J. A., Kelkar, A., & Miikkulainen, R. (2004). Scaling self-organizing maps to model large cortical networks. Neuroinformatics, 2(3), 275-302.
7. Bethge, M., Rotermund, D., & Pawelzik, K. (2003). Second order phase transition in neural rate coding: Binary encoding is optimal for rapid signal transmission. Physical Review Letters, 90(8), 088104.
8. Bolz, J., & Gilbert, C. D. (1989). The role of horizontal connections in generating long receptive fields in the cat visual cortex. European Journal of Neuroscience, 1(3), 263-268.
9. Brüderle, D., Müller, E., Davison, A., Muller, E., Schemmel, J., & Meier, K. (2009). Establishing a novel modeling tool: A python-based interface for a neuromorphic hardware system. Frontiers in Neuroinformatics, 3, 17.
10. Chapman, B., & Stryker, M. P. (1992). Origin of orientation tuning in the visual cortex. Current Opinion in Neurobiology, 2(4), 498-501.
11. Delorme, A., & Thorpe, S. J. (2003). Early cortical orientation selectivity: How fast shunting inhibition decodes the order of spike latencies. Journal of Computational Neuroscience, 15, 357-365.
12. DeWeese, M. R., Wehr, M., & Zador, A. M. (2003). Binary coding in auditory cortex. Journal of Neuroscience, 23(21), 7940-7949.
13. Doi, E., Balcan, D. C., & Lewicki, M. S. (2007). Robust coding over noisy overcomplete channels. IEEE Transactions in Image Processing, 16(2), 442-452.
14. Field, D. J. (1994). What is the goal of sensory coding? Neural Computation, 6(4), 559-601.
15. Fischer, S., Redondo, R., Perrinet, L., & Cristóbal, G. (2007). Sparse approximation of images inspired from the functional architecture of the primary visual areas. EURASIP Journal on Advances in Signal Processing, vol. 2007(1):122.
16. Fyfe, C., & Baddeley, R. J. (1995). Finding compact and sparse-distributed representations of visual images. Network: Computation in Neural Systems, 6, 333-344.
17. Hebb, D. O. (1949). The organization of behavior: A neuropsychological theory. New York: Wiley.
18. Hosoya, T., Baccus, S. A., & Meister, M. (2005). Dynamic predictive coding by the retina. Nature, 436(7047), 71-77.
19. Jones, J. P., & Palmer, L. A. (1987). An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. Journal of Neurophysiology, 58(6), 1233-1258.
20. Laughlin, S. B. (1981). A simple coding procedure enhances a neuron's information capacity. Zeitung für Naturforschung, 9-10(36), 910-912.
21. Lee, D. D., & Seung, H. S. (1999). Learning the parts of objects by nonnegative matrix factorization. Nature, 401, 788-791.
22. Lee, H., Battle, A., Raina, R., & Ng, A. (2007). Efficient sparse coding algorithms. In B. Schölkopf, J. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems, 19 (pp. 801-808). Cambridge, MA: MIT Press.
23. Lewicki, M. S., & Sejnowski, T. J. (2000). Learning overcomplete representations. Neural Computation, 12(2), 337-365.
24. Mallat, S. (1998). A wavelet tour of signal processing (2nd ed.). Orlando, FL: Academic Press.
25. Mallat, S., & Zhang, Z. (1993). Matching pursuit with time-frequency dictionaries. IEEE Transactions on Signal Processing, 41(12), 3397-3414.
26. Nikitin, A. P., Stocks, N. G., Morse, R. P., & McDonnell, M. D. (2009). Neural population coding is optimized by discrete tuning curves. Physical Review Letters, 103(13), 138101.
27. Oja, E. (1982). A simplified neuron model as a principal component analyzer. Journal of Mathematical Biology, 15, 267-273.
28. Olshausen, B. A. (2002). Sparse codes and spikes. In R. P. N. Rao, B. A. Olshausen, & M. S. Lewicki (Eds.), Probabilistic models of the brain: perception and neural Function (pp. 257-272). Cambridge, MA: MIT Press.
29. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381(6583), 607-609.
30. Olshausen, B. A., & Field, D. J. (1997). Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Research, 37, 3311-3325.
31. Olshausen, B. A., & Millman, K. J. (2000). Learning sparse codes with a mixture-of-gaussians prior. In M. I. Jordan, M. J. Kearns, & S. A. Solla (Eds.), Advances in neural information processing systems, 12 (pp. 887-893). Cambridge, MA: MIT Press.
32. Pece, A. E. C. (2002). The problem of sparse image coding. Journal of Mathematical Imaging and Vision, 17, 89-108.
33. Perrinet, L. (2004). Finding independent components using spikes: A natural result of Hebbian learning in a sparse spike coding scheme. Natural Computing, 3(2), 159-175.
34. Perrinet, L. (2007). Dynamical neural networks: Modeling low-level vision at short latencies. European Physical Journal, 142, 163-225.
35. Perrinet, L., Samuelides, M., & Thorpe, S. J. (2002). Sparse spike coding in an asynchronous feed-forward multi-layer neural network using Matching Pursuit. Neurocomputing, 57C, 125-134.
36. Perrinet, L., Samuelides, M., & Thorpe, S. J. (2003). Emergence of filters from natural scenes in a sparse spike coding scheme. Neurocomputing, 58-60(C), 821-826.
37. Perrinet, L., Samuelides, M., & Thorpe, S. J. (2004). Coding static natural images using spiking event times: Do neurons cooperate? IEEE Transactions on Neural Networks, 15(5), 1164-1175.
38. Ranzato, M. A., Poultney, C. S., Chopra, S., & LeCun, Y. (2007). Efficient learning of sparse overcomplete representations with an energy-based model. In B. Schölkopf, J. Platt, & T. Hoffman (Eds.), Advances in neural information processing systems, 19 (pp. 1137-1144). Cambridge, MA: MIT Press.
39. Rebollo-Neira, L., & Lowe, D. (2002). Optimized orthogonal Matching Pursuit approach. IEEE Signal Processing Letters, 9(4), 137-140.
40. Rehn, M., & Sommer, F. T. (2007). A model that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fields. Journal of Computational Neuroscience, 22(2), 135-146.
41. Rissanen, J. (1978). Modeling by shortest data description. Automatica, 14, 465-471.
42. Saito, N. (2001). The generalized spike process, sparsity, and statistical independence. In D. N. Rockmore & D. M. Healy (Eds.), Modern signal processing (pp. 317-340). Cambridge: Cambridge University Press.
43. Schemmel, J., Gruebl, A., Meier, K., & Mueller, E. (2006). Implementing synaptic plasticity in a VLSI spiking neural network model. In Proceedings of the 2006 International Joint Conference on Neural Networks. Piscataway, NJ: IEEE Press.
44. Shahaf, G., Eytan, D., Gal, A., Kermany, E., Lyakhov, V., Zrenner, C., et al. (2008). Order-based representation in random networks of cortical neurons. PLoS Computational Biology, 4(11), e1000228+.
45. Smith, E. C., & Lewicki, M. S. (2006). Efficient auditory coding. Nature, 439(7079), 978-982.
46. Srinivasan, M. V., Laughlin, S. B., & Dubs, A. (1982). Predictive coding: A fresh view of inhibition in the retina. Proceedings of the Royal Society of London. Series B, Biological Sciences, 216(1205), 427-459.
47. van Hateren, J. H. (1993). Spatiotemporal contrast sensitivity of early vision. Vision Research, 33, 257-267.
48. Vinje, W. E., & Gallant, J. L. (2000). Sparse coding and decorrelation in primary visual cortex during natural vision. Science, 287, 1273-1276.
49. Weber, C., & Triesch, J. (2008). A sparse generative model of V1 simple cells with intrinsic plasticity. Neural Computation, 20(5), 1261-1284.
50. Zhaoping, L. (2006). Theoretical understanding of the early visual processes by data compression and data selection. Network: Computation in Neural Systems, 17(4), 301-334.
51. Zibulevsky, M., & Pearlmutter, B. A. (2001). Blind source separation by sparse decomposition. Neural Computation, 13(4), 863-882.