Transformation-invariant visual representations in self-organizing spiking neural networks

Frontiers in Computational Neuroscience

Volumn 6, Issue JUL, 2012, Pages

  Evans, Benjamin D ^a   Stringer, Simon M ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Continuous transformation learning; Inferior temporal cortex; Integrate and fire; Spiking neural net; Trace learning; Transformation invariant visual object recognition

Indexed keywords

FACE RECOGNITION; INTELLIGENT AGENTS; NEURONS; OBJECT RECOGNITION;

CONTINUOUS TRANSFORMATIONS; INFERIOR TEMPORAL CORTICES; INTEGRATE AND FIRES; TRACE LEARNING; VISUAL OBJECT RECOGNITION;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CELL TRANSFORMATION; CONNECTOME; CONTINUOUS TRANSFORMATION LEARNING; CONTROLLED STUDY; CYTOARCHITECTURE; INTEGRATE AND FIRE NEURON; LEARNING; MATHEMATICAL ANALYSIS; NERVE CELL; NERVE CELL MEMBRANE POTENTIAL; NERVE CELL PLASTICITY; NERVE CELL STIMULATION; NERVE CONDUCTION; POSTSYNAPTIC MEMBRANE; PRESYNAPTIC NERVE; SIMULATION; SPIKE TIME DEPENDENT PLASTICITY; SPIKE WAVE; SPIKING NEURAL NETWORK; STIMULATION; SYNAPSE; SYNAPTIC STRENGTH; TRAINING; TRANSFORMATION INVARIANT VISUAL OBJECT RECOGNITION; VISUAL MEMORY;

EID: 84880987399     PISSN: None     EISSN: 16625188     Source Type: Journal    
DOI: 10.3389/fncom.2012.00046     Document Type: Article

References (55)

1. Abbott, L. F., and Nelson, S. B. (2000). Synaptic plasticity: taming the beast. Nat. Neurosci. 3, 1178-1183.
2. Amit, D. J., and Brunel, N. (1997). Dynamics of a recurrent network of spiking neurons before and following learning. Network 8, 373-404.
3. Bell, A. J., and Sejnowski, T. J. (1997). The “independent components” of natural scenes are edge filters. Vision Res. 37, 3327-3338.
4. Bi, G-Q., and Poo, M-m. (1998). Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18, 10464-10472.
5. Bialek, W., Rieke, F., de Ruyter van Steveninck, R. R., and Warland, D. (1991). Reading a neural code. Science 252, 1854-1857.
6. Booth, M. C. A., and Rolls, E. T. (1998). View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. Cereb. Cortex 8, 510-523.
7. Dan, Y., and Poo, M-m. (2006). Spike timing-dependent plasticity: from synapse to perception. Physiol. Rev. 86, 1033-1048.
8. David, S. V., Vinje, W. E., and Gallant, J. L. (2004). Natural stimulus statistics alter the receptive field structure of v1 neurons. J. Neurosci. 24, 6991-7006.
9. Desimone, R. (1991). Face-selective cells in the temporal cortex of monkeys. J. Cogn. Neurosci. 3, 1-8.
10. Diesmann, M., Gewaltig, M. O., and Aertsen, A. (1999). Stable propagation of synchronous spiking in cortical neural networks. Nature 402, 529-533.
11. Elliffe, M. C. M., Rolls, E. T., and Stringer, S. M. (2002). Invariant recognition of feature combinations in the visual system. Biol. Cybern. 86, 59-71.
12. Felsen, G., and Dan, Y. (2005). A natural approach to studying vision. Nat. Neurosci. 8, 1643-1646.
13. Felsen, G., Touryan, J., Han, F., and Dan, Y. (2005). Cortical sensitivity to visual features in natural scenes. PLoS Biol. 3:e342. doi: 10.1371/journal.pbio.0030342
14. Ferster, D., and Spruston, N. (1995). Cracking the neuronal code. Science 270, 756-757.
15. Földiák, P. (1991). Learning invariance from transformation sequences. Neural Comput. 3, 194-200.
16. Földiák, P. (1993). “The ‘ideal homunculus’: statistical inference from neuronal population responses,” in Computation and Neural Systems, eds F. H. Eeckman and J. M. Bower (Norwell, MA: Kluwer Academic Publishers), 55-60.
17. Fries, P., Schröder, J. H., Roelfsema, P. R., Singer, W., and Engel, A. K. (2002). Oscillatory neuronal synchronization in primary visual cortex as a correlate of stimulus selection. J. Neurosci. 22, 3739-3754.
18. Fukushima, K. (1988). Neocognitron: a hierarchical neural network capable of visual pattern recognition. Neural Netw. 1, 119-130.
19. Gerstner, W., and Kistler, W. (2006). Spiking Neuron Models: Single Neurons, Populations, Plasticity, 3rd Edn. Cambridge, UK: Cambridge University Press.
20. Hebb, D. O. (1949). The Organization of Behaviour: A Neuropsychological Theory. New York, NY: Wiley.
21. Hubel, D. H., and Wiesel, T. N. (1968). Receptive fields and functional architecture of monkey striate cortex. J. Physiol. 195, 215-243.
22. Ito, M., Tamura, H., Fujita, I., and Tanaka, K. (1995). Size and position invariance of neuronal response in monkey inferotemporal cortex. J. Neurophysiol. 73, 218-226.
23. Izhikevich, E. M. (2003). Simple model of spiking neurons. IEEE Trans. Neural Netw. 14, 1569-1572. Available online at: http://vesicle.nsi.edu/users/izhikevich/publications/whichmod.htm
24. Kreiter, A. K., and Singer, W. (1996). Stimulus-dependent synchronization of neuronal responses in the visual cortex of the awake macaque monkey. J. Neurosci. 16, 2381-2396.
25. Kuwabara, N., and Suga, N. (1993). Delay lines and amplitude selectivity are created in subthalamic auditory nuclei: the brachium of the inferior colliculus of the mustached bat. J. Neurophysiol. 69, 1713-1724.
26. Maass, W., and Bishop, C. M. (eds.) (1999). Pulsed Neural Networks. Cambridge, MA: MIT Press.
27. MacKay, D. J. C. (2003). Information Theory, Inference and Learning Algorithms. Cambridge, CA: Cambridge University Press.
28. Markram, H., Lübke, J., Frotscher, M., and Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275, 213-215.
29. Masquelier, T., Hugues, E., Deco, G., and Thorpe, S. J. (2009). Oscillations, phase-of-firing coding, and spike timing-dependent plasticity: an efficient learning scheme. J. Neurosci. 29, 13484-13493.
30. McCormick, D. A., Connors, B. W., Lighthall, J. W., and Prince, D. A. (1985). Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons of the neocortex. J. Neurophysiol. 54, 782-806.
31. McCulloch, W., and Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biol. 5, 115-133.
32. Mel, B. (1997). Seemore: combining color, shape, and texture histogramming in a neurally inspired approach to visual object recognition. Neural Comput. 9, 777-804.
33. Michler, F., Eckhorn, R., and Wachtler, T. (2009). Using spatiotemporal correlations to learn topographic maps for invariant object recognition. J. Neurophysiol. 102, 953-964.
34. Op de Beeck, H., and Vogels, R. (2000). Spatial sensitivity of macaque inferior temporal neurons. J. Comp. Neurol. 426, 505-518.
35. Perrinet, L. (2003). Comment Déchiffrer le Code Impulsionnel de la Vision? Étude du Flux Parallèle, Asynchrone et épars dans le Traitement Visuel Ultra-Rapide. Ph.D. thesis, Université Paul Sabatier, Toulouse, France.
36. Perrinet, L., Delorme, A., Samuelides, M., and Thorpe, S. J. (2001). Networks of integrate-and-fire neuron using rank order coding A: how to implement spike time dependent hebbian plasticity. Neurocomputing 38-40, 817-822.
37. Quiroga, R. Q., Reddy, L., Kreiman, G., Koch, C., and Fried, I. (2005). Invariant visual representation by single neurons in the human brain. Nature 435, 1102-1107.
38. Riesenhuber, M., and Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nat. Neurosci. 2, 1019-1025.
39. Rolls, E. T., and Milward, T. (2000). A model of invariant object recognition in the visual system: learning rules, activation functions, lateral inhibition, and information-based performance measures. Neural Comput. 12, 2547-2572.
40. Rolls, E. T., and Treves, A. (1998). Neural Networks and Brain Function. Oxford University Press, Oxford.
41. Rolls, E. T., Treves, A., and Tovee, M. J. (1997). The representational capacity of the distributed encoding of information provided by populations of neurons in primate temporal visual cortex. Exp. Brain Res. 114, 149-162.
42. Rullen, R. V., and Thorpe, S. J. (2001). Rate coding versus temporal order coding: what the retinal ganglion cells tell the visual cortex. Neural Comput. 13, 1255-1283.
43. Šíma, J., and Orponen, P. (2003). General-purpose computation with neural networks: a survey of complexity theoretic results. Neural Comput. 15, 2727-2778.
44. Simoncelli, E. P. (2003). Vision and the statistics of the visual environment. Curr. Opin. Neurobiol. 13, 144-149.
45. Stringer, S. M., Perry, G., Rolls, E. T., and Proske, J. H. (2006). Learning invariant object recognition in the visual system with continuous transformations. Biol. Cybern. 94, 128-142.
46. Stringer, S. M., and Rolls, E. T. (2000). Position invariant recognition in the visual system with cluttered environments. Neural Netw. 13, 305-315.
47. Tanaka, K. (1996). Representation of visual features of objects in the inferotemporal cortex. Neural Netw. 9, 1459-1475.
48. Tanaka, K., Saito, H., Fukada, Y., and Moriya, M. (1991). Coding visual images of objects in the inferotemporal cortex of the macaque monkey. J. Neurophysiol. 66, 170-189.
49. Thorpe, S., Fize, D., and Marlot, C. (1996). Speed of processing in the human visual system. Nature 381, 520-522.
50. Thorpe, S. J., Delorme, A., Van Rullen, R., and Paquier, W. (2000). “Reverse engineering of the visual system using networks of spiking neurons,” in Proceedings. ISCAS 2000 Geneva. The 2000 IEEE International Symposium on Circuits and Systems (2000), Vol. 4, (Geneva), 405-408.
51. Tovee, M. J., Rolls, E. T., and Azzopardi, P. (1994). Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. J. Neurophysiol. 72, 1049-1060.
52. Troyer, T. W., Krukowski, A. E., Priebe, N. J., and Miller, K. D. (1998). Contrast-invariant orientation tuning in cat visual cortex: thalamocortical input tuning and correlation-based intracortical connectivity. J. Neurosci. 18, 5908-5927.
53. van Hateren, J. H., and van der Schaaf, A. (1998). Independent component filters of natural images compared with simple cells in primary visual cortex. Proc. Biol. Sci. 265, 359-366.
54. van Rossum, M. C., Bi, G-Q., and Turrigiano, G. G. (2000). Stable hebbian learning from spike timing-dependent plasticity. J. Neurosci. 8812-8821.
55. Wallis, G., and Rolls, E. T. (1997). Invariant face and object recognition in the visual system. Prog. Neurobiol. 51, 167-194.