Development of localized oriented receptive fields by learning a translation-invariant code for natural images

Network: Computation in Neural Systems

Volumn 9, Issue 2, 1998, Pages 219-234

  Rao, Rajesh P N ^a   Ballard, Dana H ^b  

^a SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

^b University of Rochester   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; CYTOLOGY; HUMAN; NERVE CELL; PHOTOSTIMULATION; PHYSIOLOGY; SYNAPSE; VISION; VISUAL CORTEX;

ANIMALS; CYTOLOGY; HUMANS; NEURAL NETWORKS (COMPUTER); NEURONS; PATTERN RECOGNITION, AUTOMATED; PHOTIC STIMULATION; PHYSIOLOGY; SYNAPSES; VISION; VISUAL CORTEX;

IM; MLCS; MLOWN; NLM;

EID: 26444495697     PISSN: 0954898X     EISSN: None     Source Type: Journal    
DOI: 10.1088/0954-898x/9/2/005     Document Type: Article

References (73)

1. Adelson E H and Movshon J A 1982 Phenomenal coherence of moving visual patterns Nature 300 523-25
2. Atick J J 1992 Could information theory provide an ecological theory of sensory processing Network: Comput. Neural Syst. 3 213-51
3. Atick J J and Redlich A N 1992 What does the retina know about natural scenes? Neural Comput. 4 196-210
4. Atick J J and Redlich A N 1993 Convergent algorithm for sensory receptive field development Neural Comput. 5 45-60
5. Baddeley R J and Hancock P J B 1991 A statistical analysis of natural images matches psychophysically derived orientation tuning curves Proc. R. Soc. B 246 219-223
6. Barlow H B 1961 Possible principles underlying the transformation of sensory messages Sensory Communication ed W A Rosenblith (Cambridge, MA: MIT Press) pp 217-34
7. Barlow H B 1972 Single units and cognition: A neurone doctrine for perceptual psychology Perception 1 371-94
8. Barlow H B 1989 Unsupervised learning Neural Comput. 1 295-311
9. Barlow H B 1994 What is the computational goal of the neocortex? Large-Scale Neuronal Theories of the Brain ed C Koch and J L Davis (Cambridge, MA: MIT Press) pp 1-22
10. Barrow H G 1987 Learning receptive fields Proc. IEEE 1st Int. Conf. on Neural Networks (San Diego, CA, June 1987) ed M Caudill and C Butler (Piscataway, NJ: IEEE) vol 4, pp 115-21
11. Barrow H G and Bray A J 1992 A model of adaptive development of complex cortical cells Artificial Neural Networks 2 ed I Aleksander and J Taylor (Amsterdam: Elsevier Science) pp 881-4
12. Baum L E, Petrie T, Soules G and Weiss N 1970 A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains Ann. Math. Stat. 41 164-71
13. Bell A J and Sejnowski T J 1997 The 'independent components' of natural scenes are edge filters Vision Res. 37 3327-38.
14. Bienensíock E L, Cooper L N and Munro P W 1982 Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex J. Neurosci. 2 32-48
15. Black M J and Jepson A D 1996 Eigentracking: Robust matching and tracking of articulated objects using a view-based representation Proc. 4th Eur. Conf. on Computer Vision (ECCV V6, Cambridge, UK, April 1996) ed B Buxton and R Cipolla (Berlin: Springer) vol I, pp 329-12
16. Brooks V B 1986 The Neural Basis of Motor Control (Oxford: Oxford University Press)
17. Bryson A E and Ho Y C 1975 Applied Optimal Control (New York: Wiley)
18. Bülthoff H H, Edelman S Y and Tarr M J 1995 How are three-dimensional objects represented in the brain? Cereb. Cortex 5 247-60
19. Cowan J D 1995 Neural networks: the early days Advances in Neural Information Processing Systems 2 ed D S Touretzky (San Mateo, CA: Morgan Kaufmann) pp 893-900
20. Dempster A P, Laird N M and Rubin D B 1977 Maximum likelihood from incomplete data via the EM algorithm J. R. Stat. Soc. B 39 1-38
21. Dodwell P C 1983 The Lie transformation group model of visual perception Percept. Psychophys. 34 1-16
22. Duffy C J and Wurtz R H 1991 Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large field stimuli J. Neurophysiol. 65 1329-45
23. Duhamel J, Colby C L and Goldberg M E 1992 The updating of the representation of visual space in parietal cortex by intended eye movements Science 255 90-2
24. Felleman D J and Van Essen D C 1991 Distributed hierarchical processing in the primate cerebral cortex Cereb. Cortex 1 1-47
25. Ferraro M and Caelli T M 1994 Lie transformation groups, integral transforms, and invariant pattern recognition Spatial Vis. 8 33-44
26. Field D J 1987 Relations between the statistics of natural images and the response properties of cortical cells J. Opt. Suc. Am. A 4 2379-94
27. Field D J 1994 What is the goal of sensory coding? Neural Comput. 6 559-601
28. Földiák P 1990 Forming sparse representations by local anti-Hebbian learning Biol. Cybern. 64 165-70
29. Földiák P 1991 Learning invariance from transformation sequences Neural Comput. 3 194-200
30. Freeman W T and Tenenbaum J B 1997 Learning bilinear models for two-factor problems in vision Proc. IEEE Computer Soc. Conf. on Computer Vision and Pattern Recognition (CVPR, San Juan, Puerto Rico, June 1997) (Los Alamitos, CA: IEEE Computer Society) pp 554-60
31. Fukushima K 1980 Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position Biol. Cybern. 36 193-202
32. Gross C G, Rocha-Miranda C E and Bender D B 1972 Visual properties of neurons in inferotemporal cortex of the macaque J. Neurophysiol. 35 96-111
33. Hancock P J B, Baddeley R J and Smith L S 1992 The principal components of natural images Network: Comput. Neural Syst. 3 61-70
34. Hinton G E 1981 A parallel computation that assigns canonical object-based frames of reference Proc. 7th Int. Joint Conf. on Artificial Intelligence (Vancouver, August 1981) vol 2, pp 683-5
35. Hinton G E, McClelland J L and Rumelhart D E 1986 Distributed representations Parallel Distributed Processing: Explorations in the Microstructure of Cognition vol 1 (Cambridge, MA: MIT Press)
36. Hoffman W C 1977 An informal historical description of the "LTG/NP" Cahiers de Psychologie 20 139-50
37. Horn B K P and Schunck B G 1981 Determining optical flow Artificial Intell. 17 185-203
38. Hubel D H and Wiesel T N 1968 Receptive fields and functional architecture of monkey striate cortex J. Physiol. 195 215-43
39. Jordan M I and Rumelhart D E 1992 Forward models: Supervised learning with a distal teacher Cogn. Sci. 16 307-54
40. Koenderink J J 1988 Operational significance of receptive field assemblies Biol. Cybern. 58 163-71
41. Koenderink J J and van Doorn A J 1987 Representation of local geometry in the visual system Biol. Cybern. 55 367-75
42. Kohonen T, Kaski S and Lappalainen H 1997 Self-organizing formation of various invariant-feature filters in the adaptive-subspace SOM Neural Comput. 9 1321-44
43. Konen W, Maurer T and Von der Malsberg C 1994 A fast dynamic link matching algorithm for invariant pattern recognition Neural Networks 7 1019-30
44. LeCun Y, Boser B, Denker J S, Henderson B, Howard R E, Hubbard W and Jackel L D 1989 Backpropagation applied to handwritten zip code recognition Neural Comput. 1 541-51
45. Lewicki M S and Sejnowski T J 1998 Learning nonlinear overcomplete representations for efficient coding ed M I Jordan, M J Kearns and S A Solla Advances in Neural Information Processing Systems 10 (Cambridge, MA: MIT Press) to appear
46. Linsker R 1988 Self-organization in a perceptual network Computer 21 105-17
47. Logothetis N K, Pauls J, Büllhoff H H and Poggio T 1994 View-dependent object recognition by monkeys Curr. Biol. 4 401-14
48. Nordberg K 1994 Signal representation and processing using operator groups Linkoping Studies in Science and Technology, Dissertations No 366, Department of Electrical Engineering, Linköping University, Sweden
49. Oja E 1989 Neural networks, principal components, and subspaces Int. J. Neural Syst. 1 61-8
50. Olshausen B A, Anderson C H and Van Essen D C 1995 A multiscale dynamic routing circuit for forming size- and position-invariant object representations J. Comput. Neurosci. 2 45-62
51. Olshausen B A and Field D J 1996 Emergence of simple-cell receptive field properties by learning a sparse code for natural images Nature 381 607-9
52. Olshausen B A and Field D J 1997 Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Res. 37 3311-25
53. Pitts W and McCulloch W S 1947 How we know universale: the perception of auditory and visual forms Bull. Math. Biophys. 9 127-47
54. Poggio T and Edelman S 1990 A network that learns to recognize 3D objects Nature 343 263-6
55. Pougct A and Sejnowski T J 1995 Spatial representations in the parietal cortex may use basis functions Advances in Neural Information Processing Systems 7 ed D S Touretzky and T K Leen (Cambridge, MA: MIT Press) pp 157-164
56. Rao R P N and Ballard D H 1996 A class of stochastic models for invariant recognition, motion, and stereo Technical Report 96.1, National Resource Laboratory for the Study of Brain and Behavior, Department of Computer Science, University of Rochester, NY
57. Rao R P N and Ballard D H 1997 Dynamic model of visual recognition predicts neural response properties in the visual cortex Neural Comput. 9 721-63
58. Rao R P N and Ballard D H 1997 Efficient encoding of natural time varying images produces oriented space-time receptive fields Technical Report 97.4, National Resource Laboratory for the study of Brain and Behavior, Department of Computer Science, University of Rochester, NY
59. Rao R P N and Ruderman 1998 Learning Lie transformation groups for invariant visual perception, in preparation
60. Salinas E and Abbott L F 1996 Transfer of coded information from sensory to motor networks J. Neurosci. 15 6461-74
61. Sanger T D 1989 Optimal unsupervised learning in a single-layer linear feedforward neural network Neural Networks 2 459-73
62. Simard P, LeCun Y and Denker J 1993 Efficient pattern recognition using a new transformation distance Advances in Neural Information Processing Systems V (San Mateo, CA: Morgan Kaufmann) pp 50-8
63. Simoncelli E P, Freeman W T, Adelson E H and Heeger D J 1992 Shiftable multiscale transforms IEEE Trans. Information Theory 38 587-607
64. Stone J V 1996 Learning perceptually salient visual parameters using spatiotemporal smoothness constraints Neural Comput. 8 1463-92
65. Tarr M J and Pinker S 1989 Mental rotation and orientation-dependence in shape recognition Cogn. Psychol. 21 233-82
66. Tsao T R, Shyu H J, Libert J M and Chen V C 1991 A Lie group approach to a neural system for three-dimensional interpretation of visual motion IEEE Trans. Neural Networks 2 149-55
67. Van Gool L, Moons T, Pauwels E and Oosterlinck A 1995 Vision and Lie's approach to invariance Image Vision Comput. 13 259-77
68. Wallis G, Rolls E and Földiák P 1993 Learning invariant responses to the natural transformations of objects Proc. 1993 Int. Joint Conf. on Neural Networks (Nagoya, Japan, October 1993) (Piscataway, NJ: IEEE) vol 2, pp 1087-90
69. Webber C J 1991 Self-organization of position- and deformation-tolerant neural representations Network: Comput. Neural Syst. 2 43-61
70. Williams R J 1985 Feature discovery through error-correction learning Technical Report 8501, Institute for Cognitive Science, University of California at San Diego
71. Wiskott L 1998 Learning invariance manifolds, submitted
72. Young R A 1985 The Gaussian derivative theory of spatial vision: Analysis of cortical cell receptive field line-weighting profiles General Motors Research Publication GMR-4920
73. Zipser D and Andersen R A 1988 A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons Nature 331 679-84