Semantic systematicity and context in connectionist networks

Connection Science

Volumn 12, Issue 2, 2000, Pages 111-142

  Bodén, Mikael ^a   Niklasson, Lars ^a  

^a UNIVERSITY OF SKÖVDE   (Sweden)

Author keywords

Classicalism; Compositionality; Connectionism; Content; Context; Learning internal representation; Representation; Systematicity; Weight representations

Indexed keywords

EID: 0034338073     PISSN: 09540091     EISSN: None     Source Type: Journal    
DOI: 10.1080/09540090050129754     Document Type: Article

References (58)

1. Aizawa, K., 1997, Exhibiting versus explaining systematicity: a reply to Hadley and Hayward. Mind and Machines, 7: 39-55.
2. Blank, D. S., Meeden, L. A., and Marshall, J. B., 1992, Exploring the symbolic/subsymbolic continuum: a case study of RAAM. In J. Dinsmore (ed.) The Symbolic and Connectionist Paradigms: Closing the Gap (Hillsdale NJ: Lawrence Erlbaum), pp. 113-148.
3. Bodén, M., 1996, A connectionist variation on inheritance. In Artificial Neural Networks - ICANN 1996 Berlin: Springer), pp. 343-348.
4. Bodén, M., 1997, Context-sensitive connectionist representations for nonmonotonic inheritance. PhD thesis, University of Exeter, UK.
5. Browne, A., and Pilkington, J., 1994, Performing structure-sensitive processes on sub-symbolic representations. In Proceedings of the 1994 Irish Neural Networks Conference, University College Dublin, Ireland, pp. 19-24.
6. Butler, K., 1995, Content, Context, and Compositionality. Mind and Language, 10(1/2): 3-24.
7. Chalmers, D. J., 1990, Syntactic transformations on distributed representations. Connection Science, 2(1, 2): 53-62.
8. Chalmers, D. J., 1992, Subsymbolic computation and the chinese room. In J. Dinsmore (ed.) The Symbolic and Connectionist Paradigms: Closing the Gap (Hillsdale, NJ: Lawrence Erlbaum), pp. 25-48.
9. Chrisley, R., 1996, Non-conceptual psychological explanation: content and computation. PhD thesis, University of Oxford.
10. Chrisman, L., 1991, Learning recursive distributed representations for holistic computation. Connection Science, 3(4): 345-366.
11. Clark, A., 1993, Associative Engines (Cambridge, MA: MIT Press).
12. Elman, J. L., 1990, Finding structure in time. Cognitive Science, 14: 179-211.
13. Fodor, J. A. and McLaughlin, B. P., 1990, Connectionism and the problem of systematicity - why Smolensky's solution doesn't work. Cognition, 35: 183-204.
14. Fodor, J. A., and Pylyshyn, Z. W., 1988. Connectionism and cognitive architecture: a critical analysis. Cognition, 28: 3-71.
15. Genescreth, M. R., and Nilsson, N. J., 1987, Logical Foundations of Artificial Intelligence (Los Altos, CA: Morgan Kaufmann).
16. Goschke, T., 1990, Connectionist representation, semantic compositionality, and the instability of concept structure. Psychological Research, 52: 253-270.
17. Goschke, T., and Koppelberg, D., 1991, The concept of representation and the representation of concepts in connectionist models. In W. Ramsey, S. Stich and D. E. Rumelhart (eds) Philosophy and Connectionist Theory (Hillsdale, NJ: Lawrence Erlbaum), pp. 129-161.
18. Hadley, R. F., 1994, Systematicity in connectionist language learning. Mind and Language, 9(3): 247-272.
19. Hadley, R. F., 1994b, Systematicity revisited: reply to Chater & Christiansen and Niklasson & van Gelder. Mind and Language, 9(4): 431-443.
20. Hadley, R. F., and Cardei, V. C., 1999, Language acquisition from sparse input without error feedback. Neural Networks, 12: 217-235.
21. Hadley, R. F., and Hayward, M. B., 1997, Strong semantic systematicity from Hebbian connectionist learning. Minds and Machines, 7: 1-37.
22. Halford, G. S., Bain, J. D., Maybery, M. T., and Andrews, G., 1998, Induction of relational schemas: common processes in reasoning and complex learning. Cognitive Psychology, 35:(3): 201-245.
23. Hanson, S. J., and Burr, D. J., 1990, What connectionist models learn: learning and representation in connectionist networks. Behavioral and Brain Sciences, 13: 471-518.
24. Hinton, G. E., 1990, Mapping part-whole hierarchies into connectionist networks. Artificial Intelligence, 46: 47-75.
25. Hinton, G. E., McClelland, J. L., and Rumelhart, D. E., 1986, Distributed representations. In D. E. Rumelhart, J. McClelland and the PDF Research Group (eds) Parallel Distributed Processing, Vol. 1 (Cambridge, MA: MIT Press), pp. 77-109.
26. Marcus, G., 1998, Can connectionism save constructivism? Cognition, 66(2): 153-182.
27. Matthews, R. J., 1994, Three-concept monte - explanation, implementation and systematicity. Synthese, 101: 346-363.
28. McCarthy, J., 1980, Circumscription - a form of nonmonotic reasoning. Artificial Intelligence, 13: 27-39.
29. Minsky, M., 1975, A framework for representing knowledge. In P. H. Winston (ed.) The Psychology of Computer Vision (New York: McGraw Hill).
30. Minsky, M., and Papert, S., 1969, Perceptrons (Cambridge, MA: MIT Press).
31. Narayana, A., and Bodén, M., 1996, Representations for changing one's mind. In D. Peterson (ed.) Forms of Representation (Exeter: Intellect Books), pp. 101-117.
32. Niklasson, L., 1995, Systematicity, the Scarlet Pimpernel of cognitive science. PhD thesis. University of Sheffield, UK.
33. Niklasson, L., and Bodén, M., 1997, On representing structure and structured representations in connectionist networks. In A. Browne (ed.) Current Perspectives in Neural Computing (Bristol: Institute of Physics), pp. 20-50.
34. Niklasson, L., and van Gelder, T., 1994. On being systematically connectionist. Mind and Language, 9(3): 288-302.
35. Niklasson, L. F., 1993, Structure sensitivity in connectionist models. In Proceedings of the 1993 Connectionist Models Summer School (Hillsdale, NJ: Lawrence Erlbaum), pp. 162-169.
36. Niklasson, L. F., and Sharkey, N. E., 1992, Connectionism and the issues of compositionality and systematicity. In R. Trappl (ed.) Cybernetics and Systems Research (Singapore: World Scientific), pp. 1367-1374.
37. Palmer, S. E., 1978, Fundamental aspects of cognitive representation. In E. Rosch and B. B. Lloyd (eds) Cognition and Categorization (Hillsdale, NJ: Lawrence Erlbaum).
38. Phillips, S., 1998, Are feedforward and recurrent networks systematic? Analysis and implications for a connectionist cognitive architecture. Connection Science, 10(2): 137-160.
39. Phillips, S., and Halford, G. S., 1997, Systematicity: psychological evidence with connectionist implications. In Proceedings of the Nineteenth Annual Meeting of the Cognitive Science Society (Hillsdale, NJ: Lawrence Erlbaum), pp. 614-619.
40. Phillips, S. A., 1994, Strong systematicity within connectionism - the tensor-recurrent network. In Proceedings of the Cognitive Science Society (Hillsdale, NJ: Lawrence Erlbaum).
41. Pollack, J. B., 1990, Recursive distributed representations. Artificial Intelligence, 46: 77-105.
42. Quillian, M. R., 1968, Semantic memory. In M. Minsky (ed.) Semantic Information Processing (Cambridge, MA: MIT Press), pp. 216-260.
43. Reiter, R., 1980, A logic for default reasoning. Artificial Intelligence, 13: 81-132.
44. Rumelhart, D. E., Hinton, G. E., and Williams, R. J., 1986, Learning internal representations by back-propagating errors. Nature, 323: 533-536.
45. Sandewall, E., 1986, Nonmonotonic inference rules for multiple inheritance with exceptions. Proceedings of IEEE, 10(74): 1345-1353.
46. Sejnowski, T., and Rosenberg, C., 1987, Parallel networks that learn to pronounce English text. Complex Systems, 1: 145-168.
47. Sharkey, N. E., 1991, Connectionist representation techniques. Artificial Intelligence Review, 5: 143-167.
48. Sharkey, N. E., and Jackson, S., 1994, Three horns of the Representational Trilemma. In Honavar and Uhr (eds) Artificial Intelligence and Neural Networks. Steps Toward Principled Integration (Academic Press), pp. 155-190.
49. Sharkey, N. E., and Jacobson, S., 1995, An internal report for connectionists. In R. Sun and L. Bookman (eds) Computational Architectures Integrating Neural and Symbolic Processes (Boston, MA: Kluwer Academic Press), pp. 223-244.
50. Smolensky, P., 1987, The constituent structure of connectionist mental states: a reply to Fodor and Pylyshyn. Southern Journal of Philosophy, 26: 137-160.
51. Smolensky, P., 1990, Tensor product variable binding and the representation of symbolic structures in connectionist systems. Artificial Intelligence, 46: 159-216.
52. Touretzky, D. S., 1986, The Mathematics of Inheritance (London: Pitman).
53. Touretzky, D. S., Horty, J. F., and Thomason, R. H., 1987, A clash of intuitions: the current state of nonmonotonic multiple inheritance systems. In Proceedings of IJCAI 87 (Los Altos, CA: Morgan Kaufmann), pp. 476-482.
54. van Gelder, T., 1990, Compositionality: a connectionist variation on a classical theme. Cognitive Science, 14: 335-364.
55. van Gelder, T., 1991a, Classical questions, radical answers: connectionism and the structure of mental representations. In T. E. Horgan and J. Tienson (eds) Connectionism and the Philosophy of Mind (Dordrecht: Kluwer), pp. 355-381.
56. van Gelder, T., 1991b, What is the 'D' in 'PDF'? A survey of the concept of distribution. In W. Ramsey, S. Stich and D. E. Rumelhart (eds) Philosophy and Connectionist Theory (Hillsdale, NJ: Lawrence Erlbaum), pp. 33-60.
57. van Gelder, T., and Niklasson, L., 1994, Classicalism and cognitive architecture. In A. Ram and K. Eiselt (eds) Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society (Hillsdale, NJ: Lawrence Erlbaum), pp. 905-909.
58. Woods, W. A., 1975, What's in a link: foundations for semantic networks. In D. G. Bobrow and A. M. Collins (eds) Representation and Understanding: Studies in Cognitive Science (New York: Academic Press), pp. 35-82.