Broad-coverage parsing with neural networks

Neural Processing Letters

Volumn 21, Issue 2, 2005, Pages 121-132

  Mayberry III, Marshall R ^a   Miikkulainen, Risto ^a  

^a University of Texas at Austin   (United States)

Author keywords

Cognitive modeling; Natural language processing; Neural networks; Parsing; Recursive autoassociative memory; Simple recurrent network

Indexed keywords

COGNITIVE SYSTEMS; CONTEXT SENSITIVE GRAMMARS; ERRORS; HEURISTIC METHODS; LINGUISTICS; MATHEMATICAL MODELS; OPTIMIZATION; RANDOM PROCESSES; RECURRENT NEURAL NETWORKS; TREES (MATHEMATICS); VECTORS;

COGNITIVE MODELING; NATURAL LANGUAGE PROCESSING; PARSING; RECURSIVE AUTOASSOCIATIVE MEMORY; SIMPLE RECURRENT NETWORKS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 17444410027     PISSN: 13704621     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11063-004-3423-4     Document Type: Article

References (24)

1. Allen, J. and Seidenberg, M.S.: The emergence of grammaticality in connectionist networks, In B: MacWhinney (ed.), Emergence of Language, pp. 115-151, Hillsdale: NJ, Erlbaum, 1999.
2. Miikkulainen, R.: Dyslexic and category-specific impairments in a self-organizing feature map model of the lexicon, Brain and Language 59 (1997), 334-366.
3. Miikkulainen, R.: Subsymbolic Natural Language Processing: An Integrated Model of Scripts, Lexicon, and Memory, Cambridge, MA: MIT Press, 1993.
4. Morris, W.C., Cottrell, G.W. and Elman, J.L.: A connectionist simulation of the empirical acquisition of grammatical relations. In: S. Wermter and R. Sun, (eds.), Hybrid Neural Systems, pp. 175-193, Springer-Verlag, 2000.
5. Plaut, D.C. and Shallice, T.: Perseverative and semantic influences on visual object naming errors in optic aphasia: A connectionist account, Journal of Cognitive Neuroscience, 5(1) (1993), 89-117.
6. St. John, M.F. and McClelland, J.L: Learning and applying contextual constraints in sentence comprehension, Artificial Intelligence 46 (1990), 217-258.
7. Bengio, Y., Simard, P. and Frasconi, P.: Learning long-term dependencies with gradient descent is difficult, IEEE Transactions on Neural Networks, 5(2) (1994), 157-166.
8. Berg, G.: A connectionist parser with recursive sentence structure and lexical disambiguation, In: W. Swartout (ed.), Proceedings of the Tenth National Conference on Artificial Intelligence, pp. 32-37, Cambridge, MA, MIT Press, 1992.
9. Ho, E.K. and Chan, L.: Analyzing holistic parsers: Implications for robust parsing and systematicity, Neural Computation 13(5) (2001), 1137-1170.
10. Sharkey, N.B. and Sharkey, A.J.C.: A modular design for connectionist parsing, In: M. Drossaers and A. Nijholt, (eds.), Twente Workshop on Language Technology 3: Connectionism and Natural Language Processing, pp. 87-96, Enschede, the Netherlands, 1992. Department of Computer Science, University of Twente.
11. Lane, P.C.R. and Henderson, J.B.H.: Incremental syntactic parsing of natural language corpora with simple synchrony networks, IEEE Transactions on Knowledge and Data Engineering 13(2) (2001), 219-231.
12. Mayberry, M.R. III and Miikkulainen, R.: Combining maps and distributed representations for shift-reduce parsing, In: S. Wermter and R. Sun, (eds.), Hybrid Neural Systems, pp. 144-157. Springer-Verlag, 2000.
13. Hammerton, J.: Clause identification with long short-term memory, In: W. Daelemans and R. Zajac, (eds), Proceedings of CoNLL-2001 pp. 61-63, 2001.
14. Lawrence, S., Giles, C.L. and Fong, S.: Natural language grammatical inference with recurrent neural networks, IEEE Transactions on Knowledge and Data Engineering 12(1) (2000), 126-140.
15. Christiansen, M.H. and Chater, N.: Toward a connectionist model of recursion in human linguistic performance, Cognitive Science, 23(2) (1999), 157-205.
16. Elman, J.L.: Finding structure in time, Cognitive Science 14 (1990), 179-211.
17. Chalmers, D.J.: Syntactic transformations on distributed representations, Connection Science 2 (1990), 53-62.
18. Pollack, J.B. Recursive distributed representations, Artificial Intelligence 46 (1990), 77-105.
19. Goller, C. and Küchler, A.: Learning task-dependent distributed representations by back-propagation through structure, IEEE Transactions on Neural Networks 1 (1996), 347-352.
20. Pollard, C. and Sag, I.A.: Head-Driven Phrase Structure Grammar. Studies in Contemporary Linguistics, The University of Chicago Press, Chicago, IL, 1994.
21. Munro, P., Cosic, C. and Tabasko, M.: A network for encoding, decoding and translating locative prepositions, Connection Science 3 (1991), 225-240.
22. Touretzky, D.S.: Connectionism and compositional semantics. In: J. Barnden and J. Pollack, (eds), High-Level Connectionist Models, volume 1 of Advances in Connectionist and Neural Computation Theory, Barnden, J. A., series (ed.), pp. 17-31. Norwood: NJ, Ablex, 1991.
23. Williams, R.J. and Zipser, D.: A learning algorithm for continually running fully recurrent neural networks, Neural Computation 1 (1989), 270-280.
24. Copestake, A., Carroll, J., Malouf, R. and Oepen, S.: The (New) LKB System, CSLI, Stanford University, 1999.