Knowledge-based cascade-correlation: Using knowledge to speed learning

Connection Science

Volumn 13, Issue 1, 2001, Pages 43-72

  Shultz, Thomas R ^a   Rivest, Francois ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

Cascade correlation; Generative networks; Knowledge; Learning

Indexed keywords

CASCADE-CORRELATION; SPEED LEARNING;

ALGORITHMS; ERROR ANALYSIS; NEURAL NETWORKS; PROBLEM SOLVING;

KNOWLEDGE BASED SYSTEMS;

EID: 0035536720     PISSN: 09540091     EISSN: None     Source Type: Journal    
DOI: 10.1080/09540090110047767     Document Type: Article

References (30)

1. Baxter, J. 1995, Learning internal representations. In Proceedings of the Eighth International Conference on Computational Learning Theory (Santa Cruz CA: ACM Press).
2. Buckingham, D., and Shultz, T. R., 1994, A connectionist model of the development of velocity, time, and distance concepts. In Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society (Hillsdale, NJ: Erlbaum).
3. Caruana, R., 1993, Multitask learning: a knowledge-based source of inductive bias. In Proceedings of the Tenth International Machine Learning Conference (San Mateo, CA: Morgan Kaufmann).
4. Caruana, R., 1997, Multitask learning. Machine Learning, 28: 41-75.
5. Clark, A., and Thornton, C., 1997, Trading spaces: computation, representation, and the limits of uninformed learning. Behavioral and Brain Sciences, 20: 57-97.
6. Fahlman, S. E., 1988, Faster-learning variations on back-propagation: an empirical study. In D. S. Touretzky, G. E. Hinton and T. J. Sejnowski (eds) Proceedings of the 1988 Connectionist Models Summer School (Los Altos, CA: Morgan Kaufmann).
7. Fahlman, S. E., and Lebiere, C., 1990, The cascade-correlation learning architecture. In D. S. Touretzky (ed.) Advances in Neural Information Processing Systems 2 (Los Altos, CA: Morgan Kaufmann).
8. Fodor, J. A., 1983, The Modularity of Mind (Cambridge, MA: MIT Press).
9. French, R., 1992, Semi-distributed representations and catastrophic forgetting in connectionist networks. Connection Science, 4: 365-377.
10. Gallinari, P., 1995, Training of modular neural net systems. In M. A. Arbib (ed.) The Handbook of Brain Theory and Neural Networks (Cambridge, MA: MIT Press).
11. Heit, E., 1994, Models of the effects of prior knowledge on category learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20: 1264-1282.
12. Jordan, M. I., and Jacobs, R. A., 1994, Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6: 181-214.
13. Karmiloff-Smith, A., 1992, Beyond Modularity: A Developmental Perspective on Cognitive Science (Cambridge, MA: MIT Press).
14. Keil, F. C., 1987, Conceptual development and category structure. In U. Neisser (ed.) Concepts and Conceptual Development: Ecological and Intellectual Factors in Categorization (Cambridge: Cambridge University Press).
15. Mareschal, D., and Shultz, T. R., 1999, Development of children's seriation: a connectionist approach. Connection Science, 11: 149-186.
16. Murphy, G. L., 1993. A rational theory of concepts. The Psychology of Learning and Motivation, 29: 327-359.
17. Nakamura, G., 1985, Knowledge-based classification of ill-defined categories. Memory and Cognition, 13: 377-384.
18. Pazzani, M. J., 1991, Influence of prior knowledge on concept acquisition: experimental and computational results. Journal of Experimental Psychology: Learning, Memory, and Cognition, 17: 416-432.
19. Pratt, L. Y., 1993, Discriminability-based transfer between neural networks. In Advances in Neural Information Processing Systems 5 (San Mateo. CA: Morgan Kaufmann).
20. Robins, A. V., 1995. Catastrophic forgetting, rehearsal, and pseudorehearsal. Connection Science, 7: 123-146.
21. Shavlik, J. W., 1994, A framework for combining symbolic and neural learning. Machine Learning, 14: 321-331.
22. Shultz, T. R., 1998, A computational analysis of conservation. Developmental Science, 1: 103-126.
23. Shultz, T. R., Buckingham, D., and Oshima-Takane, Y., 1994a. A connectionist model of the learning of personal pronouns in English. In S. J. Hanson, T. Petsche, M. Kearns and R. L. Rivest (eds) Computational Learning Theory and Natural Learning Systems, Vol. 2: Intersection between Theory and Experiment (Cambridge, MA: MIT Press).
24. Shultz, T. R., Mareschal, D., and Schmidt, W. C., 1994b, Modeling cognitive development on balance scale phenomena. Machine Learning, 16: 57-86.
25. Shultz, T. R., and Rivest, F., 2000a, Knowledge-based cascade-correlation. In Proceedings of the International Joint Conference on Neural Networks (Los Alamitos, CA: IEEE Computer Society Press).
26. Shultz, T. R., and Rivest, F., 2000b, Using knowledge to speed learning: a comparison of knowledge-based cascade-correlation and multi-task learning. In Proceedings of the Seventeenth International Conference on Machine Learning (San Francisco, CA: Morgan Kaufmann).
27. Silver, D., and Mercer, R., 1996, The parallel transfer of task knowledge using dynamic learning rates based on a measure of relatedness. Connection Science, 8: 277-294.
28. Sirois, S., and Shultz, T. R., 1998, Neural network modeling of developmental effects in discrimination shifts. Journal of Experimental Child Psychology, 71: 235-274.
29. Thrun, S., and Mitchell, T 1993, Integrating inductive neural network learning and explanation-based learning. In R. Bajcsy (ed.) Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence (San Mateo, CA: Morgan Kaufmann).
30. Wisniewski, E. J., 1995, Prior knowledge and functionally relevant features in concept learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21: 449-468.