Syntactic systematicity in sentence processing with a recurrent self-organizing network

Neurocomputing

Volumn 71, Issue 7-9, 2008, Pages 1172-1179

  Farkaš, Igor ^a   Crocker, Matthew W ^b  

^a Physics and Informatics   (Slovakia)

^b SAARLAND UNIVERSITY   (Germany)

Author keywords

Next word prediction; Recurrent neural network; Self organization; Systematicity

Indexed keywords

DATA PROCESSING; FEEDFORWARD NEURAL NETWORKS; LEARNING ALGORITHMS; SELF ORGANIZING MAPS; SYNTACTICS;

ARTIFICIAL LANGUAGE LEARNING; NEXT-WORD PREDICTION; SYNTACTIC SYSTEMATICITY;

RECURRENT NEURAL NETWORKS;

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATIC SPEECH RECOGNITION; COMPUTER LANGUAGE; COMPUTER MODEL; CONTROLLED STUDY; INFORMATION PROCESSING; INTERMETHOD COMPARISON; NETWORK LEARNING; PERCEPTRON; PREDICTION; PRIORITY JOURNAL; PROCESS CONTROL; SPEECH ARTICULATION; SYSTEM ANALYSIS;

EID: 40649098781     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2007.11.025     Document Type: Article

References (27)

1. Aizawa K. The Systematicity Arguments (2003), Kluwer Academic Publishers, Dordrecht
2. Bodén M. Generalization by symbolic abstraction in cascaded recurrent networks. Neurocomputing 57 (2004) 87-104
3. Bodén M., and van Gelder T. On being systematically connectionist. Mind Lang. 9 3 (1994) 288-302
4. Chalmers D. Connectionism and compositionality: why Fodor and Pylyshyn were wrong. Philos. Psychol. 6 (1993) 305-319
5. Christiansen M., and Chater N. Generalization and connectionist language learning. Mind Lang. 9 (1994) 273-287
6. Elman J. Finding structure in time. Cognitive Sci. 14 (1990) 179-211
7. Elman J. Learning and development in neural networks: the importance of starting small. Cognition 48 1 (1993) 71-79
8. I. Farkaš, M. Crocker, Recurrent networks and natural language: exploiting self-organization, in: Proceedings of the 28th Annual Conference of the Cognitive Science Society, Lawrence Erlbaum, Hillsdale, NJ, 2006.
9. I. Farkaš, M. Crocker, Systematicity in sentence processing with a recursive self-organizing neural network, in: Proceedings of the 15th European Symposium on Artificial Neural Networks, 2007.
10. Fodor J., and Pylyshyn Z. Connectionism and cognitive architecture: a critical analysis. Cognition 28 (1988) 3-71
11. Frank S. Learn more by training less: systematicity in sentence processing by recurrent networks. Connection Sci. 18 3 (2006) 287-302
12. Frank S. Strong systematicity in sentence processing by an echo-state network. Proceedings of ICANN, Part I, Lecture Notes in Computer Science vol. 4131 (2006), Springer, Berlin
13. Hadley R. Systematicity in connectionist language learning. Mind Lang. 9 3 (1994) 247-272
14. Hadley R., Rotaru-Varga A., Arnold D., and Cardei V. Syntactic systematicity arising from semantic predictions in a hebbian-competitive network. Connection Sci. 13 (2001) 73-94
15. Hammer B., Micheli A., Sperduti A., and Strickert M. Recursive self-organizing network models. Neural Networks 17 8-9 (2004) 1061-1085
16. Jaeger H. Adaptive nonlinear system identification with echo state networks. Advances in Neural Information Processing Systems vol. 15 (2003), MIT Press, Cambridge, MA
17. James D., and Miikkulainen R. Sardnet: a self-organizing feature map for sequences. Advances in Neural Information Processing Systems vol. 7 (1995), MIT Press, Cambridge, MA
18. Miikkulainen R. Subsymbolic case-role analysis of sentences with embedded clauses. Cognitive Sci. 20 (1996) 47-73
19. Pickering M., and Garrod S. Do people use language production to make predictions during comprehension. Trends Cognitive Sci. 11 (2007) 105-110
20. Rohde D., and Plaut D. Language acquisition in the absence of explicit negative evidence: how important is starting small?. Cognition 72 (1999) 67-109
21. Rohde D., and Plaut D. Connectionist models of language processing. Cognitive Stud. 10 1 (2003) 10-28
22. Tiňo P., and Farkaš I. On non-Markovian topographic organization of receptive fields in recursive self-organizing map. In: Wang L., Chen K., and Ong Y. (Eds). Advances in Natural Computation, ICNC 2005, Lecture Notes in Computer Science (2005), Springer, Berlin
23. Tiňo P., Farkaš I., and van Mourik J. Recursive self-organizing map as a contractive iterative function system. In: Gallagher M., Hogan J., and Maire F. (Eds). Intelligent Data Engineering and Automated Learning, IDEAL 2005, Lecture Notes in Computer Science (2005), Springer, Berlin
24. Tiňo P., Farkaš I., and van Mourik J. Dynamics and topographic organization in recursive self-organizing map. Neural Comput. 18 (2006) 2529-2567
25. van der Velde F., van der Voort van der Kleij G., and de Kamps M. Lack of combinatorial productivity in language processing with simple recurrent networks. Connection Sci. 16 1 (2004) 21-46
26. Voegtlin T. Recursive self-organizing maps. Neural Networks 15 8-9 (2002) 979-992
27. von der Malsburg C. Self-organization and the brain. In: Arbib M. (Ed). The Handbook of Brain Theory and Neural Networks (2003), MIT Press, Cambridge, MA 1002-1005