Learning as Extraction of Low-Dimensional Representations

Psychology of Learning and Motivation - Advances in Research and Theory

Volumn 36, Issue C, 1997, Pages 353-380

  Edelman, Shimon ^a   Intrator, Nathan ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77956683219     PISSN: 00797421     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0079-7421(08)60288-1     Document Type: Chapter

References (86)

1. Amari S., Cichocki A., and Yang H.H. A new learning algorithm for blind signal separation. In: Tesauro G., Touretzky D., and Leen T. (Eds). Advances in neural information processing systems (Vol. 8). (1996), MIT Press, Cambridge, MA
2. Atick J.J., Griffin P.A., and Redlich A.N. The vocabulary of shape: Principal shapes for probing perception and neural response. Network. 7 (1996) 1-5
3. Barlow H.B. Sensory mechanisms, the reduction of redundancy, and intelligence. The mechanisation of thought processes. (1959), H.M.S.O., London (pp. 535-539)
4. Barlow H.B. Conditions for versatile learning, Helmholtz's unconscious inference, and the task of perception. Vision Research. 30 (1990) 1561-1571
5. Barlow H.B. What is the computational goal of the neocortex. In: Koch C., and Davis J.L. (Eds). Large-scale neuronal theories of the brain. (1994), MIT Press, Cambridge, MA 1-22 Chap. 1
6. Baxter J. The canonical metric for vector quantization. (1995), University of London NeuroCOLT NC-TR-95-047
7. Beck J. Surface color perception. (1972), Cornell University Press, Ithaca, NY
8. Bell A.J., and Sejnowski T.J. An information-maximisation approach to blind separation and blind deconvolution. Neural Computation. 7 6 (1995) 1129-1159
9. Bellman R.E. Adaptive control processes. (1961), Princeton University Press, Princeton, NJ
10. Bienenstock E., Cooper L., and Munro P.W. Theory for the development of neural selectivity: orientation specificity and binocular interaction in visual cortex. Journal of Neuroscience. 2 (1982) 32-48
11. Borg I., and Lingoes J. Multidimensional similarity structure analysis. (1987), Springer, Berlin
12. Boynton R.M. Color, hue, and wavelength. In: Carterette E.C., and Friedman M.P. (Eds). Handbook of perception. V (1978), Academic Press, New York 301-347
13. Bridle J.S., and MacKay D.J.C. Unsupervised classifiers, mutual information and Phantom Targets'. In: Moody J., Hanson S., and Lippmann R. (Eds). Advances in neural information processing systems. 4 (1992), Morgan Kaufmann, San Mateo, CA 1096-1101
14. J. Buckheit, & D.L. Donoho (1995). Improved linear discrimination using time-frequency dictionaries. Stanford university technical report
15. Cohen J. Dependency of the spectral reflectance curves of the Munsell color chips. Psychonomic Sciences. I (1964) 369-370
16. Comon P. Independent component analysis, a new concept. Signal Processing. 36 (1994) 287-314
17. Cortese J.M., and Dyre B.P. Perceptual similarity of shapes generated from Fourier Descriptors. Journal of Experimental Psychology: Human Perception and Performance. 22 (1996) 133-143
18. Cottrell G.W., Munro P., and Zipser D. Learning internal representations from grayscale images: An example of extensional programming. Ninth Annual Conference of the Cognnitive Science Society. (1987), Erlbaum, Hillsdale, NJ 462-473
19. Cutzu F., and Edelman S. Faithful representation of similarities among three-dimensional shapes in human vision. Proceedings of the National Academy of Science. 93 (1996) 12046-12050
20. P. Demartines, & He J. Arault (1996). Curvilinear component analysis: a self-organizing neural network for non linear mapping of data sets. Submitted to IEEE Transaction on Neural Networks
21. DeMers D., and Cottrell G. Nonlinear dimensionality reduction. In: Hanson S.J., Cowan J.D., and Giles C.L. (Eds). Advances in neural information processing systems Vol. 5. (1993), Morgan Kaufmann, San Mateo, CA 580-587
22. Desimone R., and Ungerleider L. Neural mechanisms of visual processing in monkeys. In: Boler F., and Grafman J. (Eds). Handbook of neuropsychology. 2 (1989), Elsevier, Amsterdam 267-299
23. De Valois R.L., and De Valois K.K. Neural coding of color. In: Carterette E.C., and Friedman M.P. (Eds). Handbook of perception. V (1978), Academic Press, New York 117-166
24. Diaconis P., and Freedman D. Asymptotics of graphical projection pursuit. Annals of Statistics. 12 (1984) 793-815
25. Duda R.O., and Hart P.E. Pattern classification and scene analysis. (1973), Wiley, New York
26. D'Zmura M., and Iverson G. A formal approach to color constancy: the recovery of surface and light source spectral properties using bilinear models. In: Dowling C., Roberts F., and Theuns P. (Eds). Recent progress in mathematical psychology. (1996), Erlbaum, Hillsdale, NJ
27. Edelman S. Representation of similarity in 3D object discrimination. Neural Computation. 7 (1995) 407-422
28. Edelman S. Representation, similarity, and the chorus of prototypes. Minds and Machines. 5 (1995) 45-68
29. S. Edelman F. Cutzu, & S. Duvdevani-Bar (1996 Similarity to reference shapes as a basis for shape representation G. W. Cottrell (Ed.), Proceedings of 18th Annual Conf. of the Cognitive Science Society, pp. 260-265, San Diego, CA
30. Edelman S., and Duvdevani-Bar S. Similarity, connectionism, and the problem of representation in vision. Neural Computation. 9 (1997) 701-720
31. Efron B., and Tibshirani R. An introduction to the bootstrap. (1993), Chapman and Hall, London
32. Elman J.L., and Zipser D. Learning the hidden structure of speech. Journal of the Acoustical Society of America. 83 (1988) 1615-1626
33. Field D.J. What is the goal of sensory coding. Neural Computation. 6 (1994) 559-601
34. Fisher R.A. The use of multiple measurements in taxonomic problems. Annals of Eugenics. 7 (1936) 179-188
35. Friedman J.H. Exploratory projection pursuit. Journal of the American Statistical Association. 82 (1987) 249-266
36. Geman S., Bienenstock E., and Doursat R. Neural networks and the bias-variance dilemma. Neural Computation. 4 (1992) 1-58
37. Gutfinger D., and Sklansky J. Robust classifiers by mixed adaptation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 13 (1991) 552-567
38. Hastie T., Tibshirani R., and Buja A. Flexible discriminant analysis by optimal scoring. Journal of the American Statistical Association. 89 (1994) 1255-1270
39. Huber P.J. Projection pursuit (with discussion). The Annals of Statistics. 13 (1985) 435-475
40. Intrator N. A neural network for feature extraction. In: Touretzky D.S., and Lippmann R.P. (Eds). Advances in neural information processing systems. 2 (1990), Morgan Kaufmann, San Mateo, CA 719-726
41. Intrator N. Combining exploratory projection pursuit and projection pursuit regression with application to neural networks. Neural Computation. 5 3 (1993) 443-455
42. Intrator N., and Cooper L.N. Objective function formulation of the BCM theory of visual cortical plasticity: Statistical connections, stability conditions. Neural Networks. 5 (1992) 3-17
43. N. Intrator, & S. Edelman (1997). Learning low dimensional representations of visual objects with extensive use of prior knowledge. Network, in press
44. Intrator N., Reisfeld D., and Yeshurun Y. Face recognition using a hybrid supervised/ unsupervised neural network. Pattern Recognition Letters. 17 (1996) 67-76
45. Jacobs D.W. The space requirements of indexing under perspective projections. IEEE Transactions on Pattern Analysis and Machine Intelligence. 18 (1996) 330-333
46. Jacobs R.A., Jordan M.I., Nowlan S.J., and Hinton G.E. Adaptive mixtures of local experts. Neural Computation. 3 1 (1991) 79-87
47. Judd D.B., MacAdam D.L., and Wyszecki G. Spectral distribution of typical daylight as a function of correlated color temperature. Journal of the Optical Society of America. 54 (1964) 1031-1040
48. Kambhatla N., and Leen T.K. Fast non-linear dimension reduction. In: Cowan J.D., Tesauro G., and Alspector J. (Eds). Advances in neural information processing systems. 6 (1994), Morgan Kaufmann, San Mateo, CA
49. Kammen D., and Yuille A. Spontaneous symmetry-breaking energy functions and the emergence of orientation selective cortical cells. Biological Cybernetics. 59 (1988) 23-31
50. Koontz W.L.G., and Fukunaga K. A nonlinear feature extraction algorithm using distance information. IEEE Trans. Comput. 21 (1972) 56-63
51. Kruskal J.B. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika. 29 1 (1964) 1-27
52. Kruskal J.B., and Wish M. Multidimensional scaling. (1978), Sage Publications, Beverly Hills, CA
53. Le Cun Y., Boser B., Denker J., Henderson D., Howard R., Hubbard W., and Jackel L. Backpropagation applied to handwritten zip code recognition. Neural Computation. 1 (1989) 541-551
54. Leen T.K., and Kambhatla N. Fast non-linear dimension reduction. In: Cowan J.D., Tesauro G., and Alspector J. (Eds). Advances in neural information processing systems. 6 (1994), Morgan Kauffman, San Francisco, CA
55. Linsker R. From basic network principles to neural architecture. Proceedings of the National Academy of Sciences, USA. 83 (1986) 7508-7512 8390-8394, 8779-8783
56. Logothetis N.K., Pauls J., and Poggio T. Shape recognition in the inferior temporal cortex of monkeys. Current Biology. 5 (1995) 552-563
57. Miller K.D., Keller J., and Stryker M.P. Ocular dominance column development: Analysis and simulation. Science. 240 (1989) 605-615
58. Millikan R. Language, thought, and other biological categories. (1984), MIT Press, Cambridge, MA
59. Moody J., and Darken C. Fast learning in networks of locally tuned processing units. Neural Computations. 1 (1989) 281-289
60. Moses Y., Adini Y., and Ullman S. In: Eklundh J.-O. (Ed). Face recognition: the problem of compensating for illumination changes. (1994), Springer-Verlag 286-296 Proc. ECCV-94
61. Nosofsky R.M. Exemplar-based accounts of relations between classification, recognition, and typicality. Journal of Experimental Psychology: Learning, Memory and Cognition. 14 (1988) 700-708
62. Nowlan S.J., and Hinton G.E. Simplifying neural networks by soft weight-sharing. Neural Computation. 4 (1992) 473-493
63. Oja E. A simplified neuron model as a principal component analyzer. Journal of Mathematical Biology. 15 (1982) 267-273
64. Poggio T., and Edelman S. A network that learns to recognize three-dimensional objects. Nature. 343 (1990) 263-266
65. Poincaré H. Mathematics and science: Last essays. (1913), Dover, New York Translated by J. W. Bolduc
66. Rolls E.T., and Tovee M.J. Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. Journal of Neurophysiology. 73 (1995) 713-726
67. Rose K., Gurewitz E., and Fox C. Vector quantization by deterministic annealing. IEEE Transactions on Information Theory. 38 (1992) 1249-1257
68. Rosenblatt F. The perceptron: A probabilistic model for information storage and organization in the brain. Psych. Rev. 65 (1958) 386-407 [Reprinted in Neurocomputing (MIT Press, 1988).
69. T. Sanger (1989). Optimal unsupervised learning in feedforward neural networks. AI Lab TR 1086, MIT
70. Sejnowski T.J. Storing covariance with nonlinearly interacting neurons. Journal of Mathematical Biology. 4 (1977) 303-321
71. Shepard R.N. The analysis of proximities: Multidimensional scaling with unknown distance function part i. Psychometrika. 27 2 (1962) 125-140
72. Shepard R.N. Metric structures in ordinal data. Journal of Mathematical Psychology. 3 (1966) 287-315
73. Shepard R.N. Multidimensional scaling, tree-fitting, and clustering. Science. 210 (1980) 390-397
74. Shepard R.N. Toward a universal law of generalization for psychological science. Science. 237 (1987) 1317-1323
75. Shepard R.N., and Cermak G.W. Perceptual-cognitive explorations of a toroidal set of free-form stimuli. Cognitive Psychology. 4 (1973) 351-377
76. Shepard R.N., and Chipman S. Second-order isomorphism of internal representations: Shapes of states. Cognitive Psychology. 1 (1970) 1-17
77. Siedlecki W., Siedlecka K., and Sklansky J. An overview of mapping techniques for exploratory pattern analysis. Pattern Recognition. 21 (1988) 411-429
78. Stone C.J. Optimal global rates of convergence for nonparametric regression. Annals of statistics. 10 (1982) 1040-1053
79. Tverksy A. Features of similarity. Psychological Review. 84 (1977) 327-352
80. Ullman S., and Basri R. Recognition by linear combinations of models. IEEE Transactions on Pattern Analysis and Machine Intelligence. 13 (1991) 992-1005
81. Waibel A., Hanazawa T., Hinton G., Shikano K., and Lang K. Phoneme recognition using time-delay neural networks. IEEE Transactions on ASSP. 37 (1989) 328-339
82. Webb A.R. Multidimensional-scaling by iterative majorization using radial basis functions. Pattern Recognition. 28 (1959) 753-759
83. Wigner E.P. The unreasonable effectiveness of mathematics in the natural sciences. Comm. Pure Appl. Math. XIII (1960) 1-14
84. Yamac M. Can we do better by combining "supervised" and "nonsupervised" machine learning for pattern analysis. (1969), Brown University Ph.D. dissertation
85. Young G., and Householder A.S. Discussion of a set of points in terms of their mutual distances. Psychometrika. 3 (1938) 19-22
86. Young M.P., and Yamane S. Sparse population coding of faces in the inferotemporal cortex. Science. 256 (1992) 1327-1331