Trading spaces: Computation, representation, and the limits of uninformed learning

Behavioral and Brain Sciences

Volumn 20, Issue 1, 1997, Pages 57-66

  Clark, Andy ^a   Thornton, Chris ^b  

^a WASHINGTON UNIVERSITY   (United States)

^b UNIVERSITY OF SUSSEX   (United Kingdom)

Author keywords

Connectionism; Learning; Representation; Search; Statistics

Indexed keywords

COMPUTER MODEL; LEARNING; SHORT SURVEY;

HUMANS; LEARNING; MODELS, PSYCHOLOGICAL; NEURAL NETWORKS (COMPUTER);

EID: 0030854548     PISSN: 0140525X     EISSN: None     Source Type: Journal    
DOI: 10.1017/S0140525X97000022     Document Type: Short Survey

References (141)

1. Agre, P. E. (1993) The symbolic worldview: Reply to Vera and Simon. Cognitive Science 17(1):61-69. [RSS]
2. Agre, P. E. (1995) Computation and embodied agency. Informatica 19(4):527-35. [RSS]
3. Anderson, J. A. (1995) An introduction to neural networks. MIT Press. [KH]
4. Anderson, J. R. (1983) The architecture cognition. Harvard University Press. [KH]
5. Armstrong, S. L., Gleitman, L. R. & Gleitman, H. (1983) What some concepts might not be. Cognition 13:263-308. [KK]
6. Ausubel, D. (1963) The psychology of meaningful verbal learning. Grune & Stratton. [SO]
7. Barkow, J. H., Cosmides, L. & Tooby, J. (1992) The adapted mind: Evolutionary psychology and the generation of culture. Oxford University Press. [AW]
8. Baum, E. B. & Haussler, D. (1989) What size net gives valid generalization? Neural Computation 1:151-60. [JAB]
9. Baum, E. B. & Wilczek, F. (1988) Supervised learning of probability distributions by neural networks. In: Neural information processing systems, ed. D. Z. Anderson. American Institute of Physics. [RID]
10. Baxter, T. (1995) Learning internal representations. In: Proceeding of the Eighteenth International Conference on Computational Learning Theory. ACM Press. [NS]
11. Becker, S. & Cun, Y. (1988) Improving the convergence of back-propagation learning with second-order methods [CRG-TR-88-5]. University of Toronto Connectionist Research Group. [aAC]
12. Berkeley, I., Dawson, M., Medler, D., Schopflocher, D. & Hornsby, L. (1995) Density plots of hidden unit activations reveal interpretable bands. Connection Science 7(2):167-86. [ISNB]
13. Brooks, R. (1991) Intelligence without representation. Artificial Intelligence 47:139-59. [RSS]
14. Bullinaria, J. A. (1994) Modeling reading, spelling and past tense learning with artificial neural networks. Brain and Language (in press). [JAB]
15. Campbell, D. (1974) Evolutionary epistemology. In: The philosophy of Karl Popper, ed. P. Schillp. Open Court. [aAC]
16. Carey, S. & Spelke, E. (1994) Domain-specific knowledge and conceptual change. In: Mapping the mind: Domain specificity in cognition and culture, ed. L. A. Hirschfeld & S. A. Gelman. Cambridge University Press. [DL]
17. Caruana, R. A. (1994) Multitask connectionist learning. In: Proceedings of the 1993 Connectionist Summer School. Erlbaum. [NS]
18. Chi, M. T. H. (1992) Conceptual change within and across ontological categories. In: Cognitive models of science, ed. R. N. Giere. University of Minnesota Press. [DL]
19. Chomsky, N. (1959) Review of Skinner's "Verbal behavior." Language 35:26-58. [SO]
20. Chomsky, N. & Miller, G. (1963) Introduction to the formal analysis of natural language. In: Handbook of mathematical psychology vol. 2, ed. R. D. Luce, R. R. Bush & E. Galanter. Academic Press. [aAC]
21. Churchland, P. M. (1995) The engine of reason, the seat of the soul. MIT Press. [aAC]
22. Churchland, P. & Sejnowski, T. (1992) The computational brain. MIT/Bradford. [aAC]
23. Clark, A. (1989) Microcognition. MIT Press. [rAC]
24. (1993) Associative engines: Connectionism, concepts and representational change. MIT/Bradford. [arAC]
25. (1997) Being there: Putting brain, body and the world together again. MIT Press. [RSS, rAC]
26. Clark, A. & Karmiloff-Smith, A. (1993) The cognizer's innards: A psychological and philosophical perspective on the development of thought. Mind and Language 8:487-519. [aAC]
27. Clark, A. & Toribio, J. (1994) Doing without representing? Synthese 101:401-31. [RSS]
28. Cloete, I. & Ludik, J. (1993) Increased complexity training. In: Proceeding: New trends in neural computation, ed. J. Mira, J. Cabestony, & A. Prieto. Lecture notes in computer science, no. 686. Springer-Verlag [NS]
29. Dawson, M. & Schopflocher, D. (1992) Modifying the generalized Delta Rule to train networks of nonmonotonic processors for pattern classification. Connection Science 4(1):19-31. [ISNB]
30. Dennett, D. (1991) Conciousness explain. Little, Brown. [aAC]
31. (1994) Labeling and Learning: Commentary on Clark and Karmiloff-Smith. Mind and language 8:544-548. [aAC]
32. Dienes, Z. & Berry, D. (in press) How implicit is implicit learning? Psychonomic Bulletin and Review. [AV]
33. Dietterich, T., London, B., Clarkson, K. & Dromey, G. (1982) Learning and inductive inference. In: The handbook of artificial intelligence, vol. 3, ed. P. Cohen & E. Feigenbaum. Morgan Kaufmann. [aAC]
34. Dominey, P. F. (1995) Complex sensory-motor sequence learning based on recurrent state-representation and reinforcement learning. Biological Cybernetics 73:265-74. [PFD]
35. Dominey, P. F. (in press) An anatomically structured sensory-motor sequence learning system displays some general linguistic capacities. Brain and Language. [PFD]
36. Dominey, P. F., Arbib, M. A. & Joseph, J. P. (1995) A model of cortico-striatal plasticity for learning oculomotor associations and sequences. Journal of Cognition and Neuroscience 7(3):311-36. [PFD]
37. Dominey, P. F., Ventre-Dominey, J., Broussolle, E. & Jeannerod, M. (1995) Analogical transfer in sequence learning: Human and neural-network models of fronto-striatal function. Annals of the New York Academy of Sciences 769:369-73. [PFD]
38. Dominey, P. F., Ventre-Dominey, J., Broussolle, E. & Jeannerod, M. (in press) Analogical transfer is effective in a serial reaction time task in Parkinsons disease: Evidence for a dissociable sequence learning mechanism. Neuropsychologia. [PFD]
39. Dreyfus, H. L. (1992) What computers still can't do: A critique of artificial reason, rev. ed. MIT Press. [RSS]
40. Elman, J. (1993). Learning and development in neural networks: The importance of starting small. Cognition 48:71-99. [arAC, JAB, RID, MGG, GFM, DM, KH, NS, PS, TD]
41. Eysenck, M. W. & Keane, M. T. (1995) Cognitive psychology: A student's handbook. Erlbaum. [SO]
42. Fahlman, S. & Lebiere, C. (1990) The cascade-correlation learning architecture [CMU-CS-90-100]. Carnegie-Mellon University, School of Computer Science, Pittsburgh, PA 15213. [aAC]
43. Fahlman, S. E. & Lebiere, C. (1990) The cascade correlation learning architecture. In: Advances in neural information processing systems 2, ed. D. Touretzky. Morgan Kaufman. [NS]
44. Fodor, J. A. (1975) The language of thought. Harvard University Press. [RSS]
45. (1995) The folly of simulation. In: Speaking minds: Interviews with twenty eminent cognitive scientists, ed. P. Baumgartner & S. Payr. Princeton University Press. [RSS]
46. Funt, B. V. (1980) Problem solving with diagrammatic representations. Artificial Intelligence 13:210-30. [JO]
47. Gagne, R. M. (1962) The acquisition of knowledge. Psychological Review 69:355-65. [SO]
48. Gallant, S. I. (1994) Neural network learning and expert systems. MIT Press. [KH]
49. Gallistel, R. (1994) Interview. Journal of Cognitive Neuroscience 6(2):174-79. [aAC]
50. Gentner, D., Rattermann, M. J. & Forbus, K. D. (1993) The roles of similarity in transfer: Separating retrievability from inferential soundness. Cognitive Psychology 25:524-75. [DL]
51. Gick, M. & Holyoak, K. J. (1980) Analogical problem solving. Cognitive Psychology 12:306-55. [NS]
52. (1983) Schema induction and analogical transfer. Cognitive Psychology 15:1-38. [NS]
53. Gold, R. (1987) The description of cognitive development: Three Piagetian themes. Oxford University Press. [DL]
54. Goldberg, D. (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley. [aAC]
55. Golden, R. M. (1988) A unified framework for connectionist systems. Biological Cybernetics 59:109-20. [RMG]
56. (forthcoming) Mathematical methods for neural network analysis and design. MIT Press. [RMG, rAC]
57. Goldstone, R. L. (1994) The role of similarity in categorization: Providing a groundwork. Cognition 52:125-57. [KK]
58. Gomez, R. L. & Schaveneveldt, R. W. (1994) What is learned from artificial grammars? Transfer tests of simple association. Journal of Experimental Psychology: Learning, Memory, and Cognition 20(2):396-410. [PFD]
59. Goswami, U. (1991) Analogical reasoning: What develops? A review of research and theory. Child Development 62:1-22. [DL]
60. Haberlandt, K. F. (1990) Expose hidden assumptions in network theory. Behavioral and Brain Sciences 13:495-96. [KH]
61. Haberlandt, K. F., Graesser, A. C., Schneider, N. J. & Kiely, J. (1986) Effects of task and new arguments on word reading times. Journal of Memory and Language 25:314-22. [KH]
62. Halford, G. S. (1993) Children's understanding: The development of mental models. Erlbaum. [GSH]
63. Halford, G. S., Wilson, W. H. & Phillips, S. (submitted) Processing capacity defined by relational complexity: Implications tor comparative, developmental, and cognitive psychology. [GSH]
64. Hare, M., Elman, J. & Daugherty, K. (1995) Default generalization in connectionist networks. Language and Cognitive Processes 10:601-30. [GFM]
65. Hertz, J., Krogh, A. & Palmer, R. G. (1991) Introduction to the theory of neural computation. Addison-Wesley. [RID]
66. Hinton, G. & Sejnowski, T. (1986) Learning and relearning in Boltzmann machines. In: Parallel distributed processing: Exploration of the microstructures of cognition, vols, 1 & 2, ed. D. Rumelhart, J. McClelland & the PDP Research Group. MIT Press. [aAC, NC]
67. Hutchins, E. (1995) Cognition in the wild. MIT Press. [rAC]
68. Jackson, G. M., Jackson, S. R., Harrison, J., Henderson, L. & Kennard, C. (1995) Serial reaction time learning and Parkinsons disease: Evidence for a procedural learning deficit. Neuropsychologia 33(5):577-93. [PFD]
69. Jacobs, R., Jordan, M. & Barto, A. (1991a) Task decomposition through competition in a modular connectionist architecture: The what and where visual tasks. Cognitive Science 15:219-50. [aAC]
70. Jacobs, R., Jordan, M., Nowlan, S. & Hinton, G. (1991b) Adaptive mixtures of local experts. Neural Computation 3:79-87. [aAC]
71. Jarvella, R. J. (1979) Immediate memory and discourse processing. In: The psychology of learning and motivation: Advances in research and theory, ed. G. H. Bower. Academic Press. [KH]
72. Karmiloff-Smith, A. (1979) A functional approach to child language. Cambridge University Press. [aAC]
73. (1992a) Nature, nurture and PDP: Preposterous development postulates? Connection Science [special issue on philosophical issues in connectionist modelling] 4(3/4):253-70. [arAC, TD, NS]
74. (1992) Beyond modularity: A developmental perspective on cognitive science. MIT Press. [DM]
75. Karmiloff-Smith, A. & Clark. A. (1993) What's special about the development of the human mind/brain? Mind and Language 8(4):569-81. [aAC]
76. Keil, F. C. (1994) The birth and nurturance of concepts by domains. In: Mapping the mind: Domain specificity in cognition and culture, ed. L. A. Hirschfeld & S. A. Gelman. Cambridge University Press. [DL]
77. Kintsch, W. (1988) The use of knowledge in discourse processing: A construction-integration model. Psychological Review 95:163-82. [KH]
78. Kirsh, D. (1991) When is information explicitly represented? In: Information, thought and content, ed. P. Hanson. UBC Press. [aAC]
79. Kirsh, D. (1995) The intelligent use of space. Artificial Intelligence 72:1-52. [aAC]
80. Kirsh, D. & Maglio, P. (1994) On distinguishing epistemic from pragmatic action. Cognitive Science 18:513-19. [aAC]
81. Krogh, A. & Hertz, J. A. (1992) A simple weight decay can improve generalization. In: Advances in neural information processing systems, ed. J. E. Moody, S. J. Hanson & R. P. Lippman. Morgan Kauffman. [JAB]
82. Kurtz, K. J. (1996) Category-based similarity. Poster presented at the Eighteenth Annual Conference of the Cognitive Science Society, San Diego, CA. [KK]
83. Larkin, J. H. & Simon, H. A. (1987) Why a diagram is (sometimes) worth ten thousand words. Cognitive Science 11:65-100. [JO]
84. LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W. & Jackal, L. (1989) Back propagation applied to handwritten zipcode recognition. Neural Computation 1:541-51. [aAC]
85. Leiser, D. (1.996) Computational emergence and developmental emergence: A sobering survey. Intellectica 22:203-220. [DM]
86. Lewicki, P., Hill, T. & Bizot, E. (1988) Acquisition of procedural knowledge about a pattern of stimuli that can not be articulated. Cognitive Psychology 20:24-37. [AV]
87. Lindsay, R. K. (1988) Images and inference. Cognition 29:229-50. [JO]
88. MacKay, D. J. C. (1992a) Bayesian interpolation. Neural Computation 4:415-47. [JAB]
89. (1992b) A practical Bayesian framework for backpropagation networks. Neural Computation 4:448-72. [NC]
90. Marcus, G. F. (submitted a) Rethinking eliminative connectionism. [GFM]
91. (submitted b) What does it take to get a connectionist model to generalize a low frequency default? [GFM]
92. Marcus, G. F., Brinkmann, U., Clahsen, IL, Wiese, R. & Pinker, S. (1995) German inflection: The exception that proves the rule. Cognitive Psychology 29:186-256. [GFM]
93. Marr, D. (1982) Vision. Freeman. [aAC]
94. McClelland, J. L. & Rumelhart, D. E. (1988) Exploration in parallel distributed processing: A handbook of models, programs, and exercises. MIT Press/Bradford. [RID]
95. Miller, G. A. (1956) The magic number seven plus or minus two: Some limits on our capacity for processing information. Psychological Review 63:81-93. [SO, KH]
96. Minsky, M. & Papert, S. (1988) Perceptrons: An introduction to computational geometry, 3rd ed., expanded. MIT Press. [aAC, ISNB]
97. Murphy, G. L. & Medin, D. L. (1985) The role of theories in conceptual coherence. Psychological Review 92:289-316. [KK]
98. Newport, E. (1990) Maturational constraints on language learning. Cognitive Science 14:11-28. [arAC, TD]
99. Nissen, M. J. & Bullemer, P (1987) Attentional requirements of learning: Evidence from performance measures. Cognition Psychology 19:1-32. [PFD]
100. Nowlan, S. N. & Hinton, G. E. (1992) Simplifying neural networks by soft weight sharing. Neural Computation 4:473-93. [JAB]
101. Ohlsson, S. (1996) Learning from performance errors. Psychological Review 2-241-62. [SO]
102. Ohlsson, S. & Rees, E. (1991) The function of conceptual understanding in the learning of arithmetic procedures. Cognition and Instruction 8:103-79. [SO]
103. Perruchet, F. & Gallego, J. (in press) A subjective unit formation account ot implicit learning. In: How implicit is implicit learning? ed. D. Berry. Oxford University Press. [AV]
104. Perruchet, P. Gallego, J. & Savy, I. (1990) A critical reappraisal of the evidence for unconscious abstraction of deterministic rules in complex experimental situations. Cognitive Psychology 22:493-516. [AV]
105. Piaget, J. (1971) Biology and knowledge. Chicago University Press. [DM]
106. (1974) Adaptation vitale et psychologie de l'intelligence. Hermann. [DL]
107. Port, R. & Van Gelder, T. (1995) Mind as motion: Explorations in the dynamics of cognition. MIT Press. [RSS]
108. Quinlan, J. (1986) Induction of decision trees. Machine Learning 1:81-106. [aAC]
109. (1993) C4.5: Programs for machine learning. Morgan Kaufmann. [aAC]
110. Reber, A. S. (1993) implicit learning and tacit knowledge: An essay on the cognitive unconscious. Oxford University Press. [KH]
111. Reeves, L. M. & Weisbert, R. W. (1994) The role of content and abstract information in analogical transfer. Psychological Bulletin 115:381-400. [DL]
112. Rendell, L. (1989) A study of empirical learning for an involved problem. In: Proceedings of the Eleventh Joint Conference on Artificial Intelligence. Morgan Kaufmann. [aAC]
113. Rescorla, R. A. & Wagner, A. R. (1972) A theory of Pavlovian conditioning: The effectiveness of reinforcement and nonreinforcement. In: Classical conditioning 2: Current research and theory, ed. A. H. Black & W. F. Prokasy. Appleton-Century-Crofts. 64-69. [RID]
114. Richard, M. E. & Lippman, R. P. (1991) Neural network classifiers estimate Bavesian a posteriori probabilities. Neural Computation 3:461-83. [NC]
115. Rozin, P. (1976) The evolution of intelligence and access to the cognitive unconscious. In: Progress in psychobiology and physiological psychology, ed. J. Sprague & A. Epstein. Academic Press. 245-80. [AW]
116. Rudy, J. W. (1991) Elemental and configural associations, the hippocampus and development. Developmental Psychobiology 24(4):221-36. [GSH]
117. Rumelhart, D. E., Durbin, R., Golden, R. & Chauvin, Y. (1995) Backpropagation: The basic theory. In: Backpropagation, ed D. E. Rumelhart & Y. Chauvin. Cambridge, MA: MIT Press. Bradford Books. [KK]
118. Rumelhart, D. E., Hinton, C. & Williams, R. (1986) Learning representations by backpropagating errors. Nature 323:533-36. [aAC, ISNB, KH, KK]
119. Schultz, T. R., Schmidt, W. C., Buckingham, D. & Mareshal, D. (1995) Modeling cognitive development with a generative connectionist algorithm. In: Developing cognitive competence: New approaches to process modeling, ed. T. Simon & G. Halford. Erlbaum. [DL]
120. Searle, J. R. (1990) Is the brain a digital computer? APA Proceeding 64(3):21-37. [RSS]
121. Sejnowski, T. & Rosenberg, C. (1987) Parallel networks that learn to pronounce English text. Complex Systems 1:145-68. [aAC]
122. Sejnowski, T. J. & Rosenberg, C. R. (1986) NETtalk: A parallel network that learns to read aloud (Report No. JHU/EECS - 86/01). Johns Hopkins University. [KH]
123. Stenning, K. & Oberlander, J. (1995) A cognitive theory of graphical and linguistic reasoning: Logic and implementation. CognitiveScience 19:97-140. [JO]
124. Stufflebeam, R. S. (1995) Representations, explanation, and PDP: Is representation talk really necessary? Informatica 19(4):599-613. [RSS]
125. (1997) Whither internal representations? In defense of antirepsentationalism and other heresies. Doctoral dissertation, Washington University, St. Louis, MO. [RSS]
126. Sun, R. & Bookman, L. (1994) Conditional architectures integrating neural and symbolic processes. Kluwer. [DM]
127. Sutton, R. S. & Barto, A. G. (1981) Towards a modern theory of adaptive networks: Expectation and prediction. Psychological Review 88:135-70. [RID]
128. Szilas, N. & Ronco, E. (1995) Action for learning in nonsymbohc systems. In: Proceeding of the European Conference on Cognitive Science. INRIA. [NS]
129. Tetewsky, S., Shultz, T. & Buckingham, D. (1993) Reducing retroactive interference in connectionist models of recognition memory. Canadian Society for Brain, Behaviour, and Cognitive Science. Third Annual Meeting. [NS]
130. Tetewsky, S. J., Shultz, T. R. & Takane, Y. (1995) Training regimens and function compatibility: Implications for understanding the effects of knowledge on concept learning. In: Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society. Erlbaum. 304-309. [NS]
131. Thagard, P. (1989) Explanatory coherence. Behavioral and Brain Sciences 12:435-502. [DL]
132. Thagard, P., Holyoak, K. J., Nelson, G. & Gochfeld, D. (1990) Analogical retrieval by constraint satisfaction. Artificial Intelligence 46:259-310 [PFD]
133. Thompson, R., Oden, D. & Boyson, S. (in press) Language-naive chimpanzees (pan troglodytes) judge relations between relations in a conceptual matching-to-sample task. Journal of Experimental Psychology: Animal Behavior Processes. [rAC]
134. Utgoff, P. (1986) Machine learning of inductive bias, vol. 15 (Kluwer International Series in Engineering and Computer Science). Kluwer. [aAC]
135. Valiant, L. G. (1984) A theory of the learnable. Communications of the ACM 27:1134-42. [NC]
136. Van Gelder, T. (1995) What might cognition be if not computation? Journal of Philosophy 92(7):345-81. [RSS]
137. Vinter, A. & Perruchet, P. (1994) Is there an implicit level of representation? Behavioral and Brain Sciences 17:730-31. [AV]
138. Vosniadou, S. & Brewer, W. F. (1987) Theories of knowledge restructuring in development. Review of Educational Research 57:51-6-. [DL]
139. White, H. (1989) Some asymptotic results for learning in single hidden-layer feedforward network models. Journal of the American Statistical Association 84:1003-13. [RMG]
140. Wilson, A. & Hendler, J. (1993) Linking symbolic and subsymbolic computing. Connection Science 5:3-4. [DM]
141. Wisniewski, E. J. & Medin, D. L. (1994) On the interaction of theory and data in concept learning. Cognitive Science 18:221-81. [KK]