Making a Low-dimensional Representation Suitable for Diverse Tasks

Connection Science

Volumn 8, Issue 2, 1996, Pages 205-224

  Intrator, Nathan ^a,c   Edelman, Shimon ^b  

^a TEL AVIV UNIVERSITY   (Israel)

^b WEIZMANN INSTITUTE OF SCIENCE   (Israel)

^c BROWN UNIVERSITY   (United States)

Author keywords

Imposing bias on neural networks; Multiple task training; Transfer in neural networks

Indexed keywords

EID: 0030488027     PISSN: 09540091     EISSN: None     Source Type: Journal    
DOI: 10.1080/095400996116884     Document Type: Article

References (43)

1. Baxt, W.G. & White, H. (1995) Bootstrapping confidence intervals for clinical input variable effects in network trained to identify the presence of acute myocardial infraction. Neural Computation, 7, 624-638.
2. Baxter, J. (1995) Learning internal representations. In Proceedings of COLT '95.
3. Bellman, R.E. (1961) Adaptive Control Processes. Princeton, NJ: Princeton University Press.
4. Borg, I. & Lingoes, J. (1987) Multidimensional Similarity Structure Analysis. Berlin: Springer.
5. Breiman, L. (1992) Stacked regression. Technical Report TR-367, Department of Statistics, University of California, Berkeley.
6. Breiman, L. (1994) Bagging predictors. Technical Report TR-421, Department of Statistics, University of California, Berkeley.
7. Brigham, J.C. (1986) The influence of race on face recognition. In H.D. Ellis, M.A. Jeeves & F. Newcombe (Eds), Aspects of Face Processing. Dordrecht: Martinus Nijhoff, pp. 170-177.
8. Caruana, R. (1993) Multitask connectionist learning. Proceedings of the 1993 Connectionist Models Summer School. San Mateo, CA, pp. 372-379.
9. Caruana, R. (1995) Learning many related tasks at the same time with backpropagation. In G. Tesauro, D. Touretzky & T. Leen (Eds), Advances in Neural Information Processing Systems, Vol. 7. San Mateo, CA: Morgan Kaufmann, pp. 657-664.
10. Cutzu, F. & Edelman, S. (1995) Explorations of shape space. CS-TR 95-01, Weizmann Institute of Science.
11. Edelman, S. (1995a) Representation of similarity in 3D object discrimination. Neural Computation, 7, 407-422.
12. Edelman, S. (1995b) Representation, similarity, and the chorus of prototypes. Minds and Machines, 5, 45-68.
13. Efron, B. & Tibshirani, R. (1993) An Introduction to the Bootstrap. London: Chapman and Hall.
14. Gasser, M. (1995) Transfer in a connectionist model of the acquisition of morphology. CogSci TR 147, Indiana University, Bloomington, IN. An expanded version of a paper presented at the Morphology Workshop, Nijmegen, 13 June 1995.
15. Grossman, T. & Lapedes, A. (1993) Use of bad training data for better prediction. In J.D. Cowan, G. Tesauro & J. Alspector (Eds), Advances in Neural Information Processing Systems, Vol. 6. San Mateo, CA: Morgan Kaufmann, pp. 342-350.
16. Hintzman, D.L. (1994) Twenty-five years of learning and memory: Was the cognitive revolution a mistake? In C. Urniltá & M. Moscovitch (Eds), Attention and Performance, Vol. XV. Cambridge, MA: MIT Press, Chapter 16, pp. 360-391.
17. Hofmann, T. & Buhmann, J. (1994) Multidimensional scaling and data clustering. In J.D. Cowan, G. Tesauro & J. Alspector (Eds), Neural Information Processing Systems, Vol. 7. San Mateo, CA: Morgan Kaufmann, pp. 459-466.
18. Huber, P.J. (1985) Projection pursuit (with discussion). Annals of Statistics, 13, 435-475.
19. Intrator, N. (1993) Combining exploratory projection pursuit and projection pursuit regression with application to neural networks. Neural Computation, 5, 443-455.
20. Intrator, N. & Cooper, L.N. (1992) Objective function formulation of the BCM theory of visual cortical plasticity: Statistical connections, stability conditions. Neural Networks, 5, 3-17.
21. Kramer, A.F., Strayer, D.L. & Buckley, J. (1990) Development and transfer of automatic processing. Journal of Experimental Psychology: Human Perception and Performance, 16, 505-522.
22. Kruskal, J.B. (1964) Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika, 29, 1-27.
23. Lando, M. & Edelman, S. (1995) Receptive field spaces and class-based generalization from a single view in face recognition. Network, 6, 551-576.
24. LeBlanc, M. & Tibshirani, R. (1994) Combining estimates in regression and classification. Preprint.
25. Logan, G. (1988) Towards an instance theory of automatization. Psychological Review, 95, 492-527.
26. Maddox, W.T. & Ashby, F.G. (1993) Comparing decision bound and exemplar models of categorization. Perception and Psychophysics, 53, 49-70.
27. Martin, G. (1988) The effects of old learning on new in hopfield and backpropagation nets. Technical Report ACA-HI-019, Microelectronics and Computer Technology Corporation (MCC).
28. McLaren, I.P.L., Leevers, H.J. & Mackintosh, N.J. (1994) Recognition, categorization, and perceptual learning (or, how learning to classify things together helps one to tell them apart). In C. Umiltá & M. Moscovitch (Eds), Attention and Performance, Vol. XV. Cambridge, MA: MIT Press, Chapter 35, pp. 889-909.
29. Murre, J.M.J. (1996) Transfer of learning in backpropagation networks and in related neural networks models. In J. Levy, D. Bairaktaris, J. Bullinaria & P. Cairns (Eds), Connectionist Models of Memory and Language. London: UCL Press.
30. Pickover, C. (1990) Computers, Pattern, Chaos, and Beauty. New York: St Martin's Press.
31. Pratt, L.Y. (1993) Transferring previously learned back-propagation neural networks to new learning tasks. Technical Report ML-TR-37, Rutgers University, CS Dept.
32. Price, D., Knerr, S., Personnaz, L. & Dreyfus, G. (1995) Pairwise neural network classifiers with probabilistic outputs. In G. Tesauro, D. Touretzky & T. Leen (Eds), Advances in Neural Information Processing, Vol. 7. Cambridge, MA: MIT Press, pp. 1109-1116.
33. Raviv, Y. & Intrator, N. (1996) Bootstrapping with noise: An effective regularization technique. Connection Science, 8 (in press).
34. Reder, L. & Klatzky, R.L. (1994) Transfer: Training for peformance. In D. Druckman & R.A. Bjork (Eds), Learning, Remembering, Believing: Enhancing Human Performance. Washington, DC: National Academy Press, Chapter 3, pp. 25-56. Also available as TR CMU-CS-94-187; The effect of context on training: is learning situated?
35. Sammon, J.W. (1969) A nonlinear mapping for data structure analysis. IEEE Transactions in Computing, 18, 401-409.
36. SAS (1989) SAS/STAT User's Guide, Version 6. Cary, NC: SAS Institute.
37. Shepard, R.N. (1966) Metric structures in ordinal data. Journal of Mathematical Psychology, 3, 287-315.
38. Shepard, R.N. (1980) Multidimensional scaling, tree-fitting, and clustering. Science, 210, 390-397.
39. Shepard, R.N. (1987) Toward a universal law of generalization for psychological science. Science, 237, 1317-1323.
40. Simard, P., Victorri, B., LeCun, Y. & Denker, J. (1992) Tangent prop - a formalism for specifying selected invariances in an adaptive network. In J. Moody, R. Lippman & S.J. Hanson (Eds), Neural Information Processing Systems, Vol. 4. San Mateo, CA: Morgan Kaufmann, pp. 895-903.
41. Stone, M. (1974) Cross-validatory choice and assessment of statistical predictions (with discussion). Journal of Royal Statistical Society B, 36, 111-147.
42. Thrun, S. & Mitchell, T. (1995) Learning one more thing. In C. Mellish (Ed.), Proceedings of 14th IJCAI, Vol. 2. San Mateo, CA: Morgan Kaufmann, pp. 1217-1223.
43. Young, G. & Householder, A.S. (1938) Discussion of a set of points in terms of their mutual distances. Psychometrika, 3, 19-22.