Self-organization of symmetry networks: Transformation invariance from the spontaneous symmetry-breaking mechanism

Neural Computation

Volumn 12, Issue 3, 2000, Pages 565-596

  Webber, Chris J S ^a  

^a DEFENCE SCIENCE AND TECHNOLOGY LABORATORY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; LEARNING; MATHEMATICS; NERVE CELL; NONLINEAR SYSTEM; NORMAL DISTRIBUTION; PHYSIOLOGY; SYNAPSE;

ACTION POTENTIALS; LEARNING; MATHEMATICS; NEURAL NETWORKS (COMPUTER); NEURONS; NONLINEAR DYNAMICS; NORMAL DISTRIBUTION; SYNAPSES;

EID: 0034149902     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976600300015718     Document Type: Article

References (28)

1. Barlow, H. B. (1989). Unsupervised learning. Neural Computation, 1, 295-311.
2. Bartlett, M. S., & Sejnowski, T. (1995). Unsupervised learning of invariant representations of faces through temporal association. In J. M. Bower (Ed.), The neurobiology of computation. Norwell, MA: Kluwer.
3. Bell, A. J., & Sejnowski, T. J. (1997). The "independent components" of natural scenes are edge filters. Vision Research, 37, 3327-3338.
4. Blais, B. S., Intrator, N., Shouval, H. V., & Cooper, L. N. (1998). Receptive field formation in natural scene environments: Comparison of single-cell learning rules. Neural Computation, 10, 1797-1813.
5. Field, D. J. (1987). Relations between the statistics of natural images and the response properties of cortical cells. Journal of the Optical Society of America, 4, 2379-2394.
6. Foldiak, P. (1991). Learning invariance from transformation sequences. Neural Computation, 3, 194-200.
7. Friedman, J. H. (1987). Exploratory projection pursuit. Journal of the American Statistical Association, 82, 249-266.
8. Fukumi, M., Omatu, S., Takeda, F., & Kosaka, T. (1992). Rotation-invariant neural pattern recognition system with application to coin recognition. IEEE Transactions on Neural Networks, 3, 272-279.
9. Fukushima, K., & Miyake, S. (1982). Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position. Pattern Recognition, 15, 455-469.
10. Hebb, D. O. (1949). The organisation of behaviour. New York: Wiley.
11. Hinton, G. E. (1987). Learning translation invariant recognition in a massively parallel network. In G. Goos & J. Hartmanis (Eds.), PARLE: Parallel architectures and languages europe (pp. 1-13).New York: Springer-Verlag.
12. Hubel, D. H., & Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. Journal of Physiology, 160, 106-154.
13. Le Cun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., & Jackel, L. (1989). Backpropagation applied to handwritten zip code recognition. Neural Computation, 1, 541-551.
14. Minsky, M. L., & Papert, S. A. (1969). Perceptrons. Cambridge, MA: MIT Press.
15. Oja, E. (1982). A simplified neuron model as a principal component analyser. Journal of Mathematical Biology, 15, 267-273.
16. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381, 607-609.
17. Rao, R. P. N., & Ballard, D. H. (1998). Development of localized oriented receptive fields by learning a translation-invariant code for natural images. Network: Computation in Neural Systems, 9, 219-234.
18. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning internal representations by error propagation. In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructures of cognition (Vol. 1, pp. 318-362). Cambridge, MA: MIT Press.
19. Shawe-Taylor, J. (1989). Building symmetries into feedforward networks. In First IEEE Conference on Artificial Neural Networks (pp. 158-162).
20. Shawe-Taylor, J. (1993). Symmetries and discriminability in feedforward network architectures. IEEE Transactions on Neural Networks, 4, 816-826.
21. Simard, P., Victorri, B., Le Cun, Y., & Denker, J. (1991). Tangent prop - a formalism for specifying selected invariances in an adaptive network. Neural Information Processing Systems, 4, 895-903.
22. Wallis, G., Rolls, E., & Foldiak, P. (1993). Learning invariant responses to the natural transformations of objects. Proceedings of the 1993 International Joint Conference on Neural Networks, 2, 1087-1090.
23. Webber, C. J. S. (1991). Self-organisation of position- and deformation-tolerant neural representations. Network: Computation in Neural Systems, 2, 43-61.
24. Webber, C. J. S. (1994). Self-organisation of transformation-invariant detectors for constituents of perceptual patterns. Network: Computation in Neural Systems, 5, 471-496.
25. Webber, C. J. S. (1997). Generalisation and discrimination emerge from a self-organising componential network: A speech example. Network: Computation in Neural Systems, 8, 425-440.
26. Webber, C. J. S. (1998). Emergent componential coding of a handwriting-image database by neural self-organisation. Network: Computation in Neural Systems, 9, 433-447.
27. Wood, J. J. (1995). A model of adaptive invariance. Unpublished doctoral dissertation, University of London.
28. Yamagishi, K. (1994). Spontaneous symmetry breaking and the formation of columnar structures in the primary visual cortex. Network: Computation in Neural Systems, 5, 61-73.