Broad-coverage parsing using human-like memory constraints

Computational Linguistics

Volumn 36, Issue 1, 2010, Pages 1-30

  Schuler, William ^a   AbdelRahman, Samir ^b   Miller, Tim ^a   Schwartz, Lane ^a  

^a University of Minnesota   (United States)

^b Cairo University   (Egypt)

Author keywords

[No Author keywords available]

Indexed keywords

HIDDEN MARKOV MODELS;

DISTINCT ELEMENTS; ENGLISH SENTENCES; HIERARCHICAL HIDDEN MARKOV MODEL; HUMAN-LIKE MEMORY; SHORT TERM MEMORY; STORAGE CAPACITY; SYNTACTICALLY ANNOTATED CORPUS; TIME SERIES MODELING;

SYNTACTICS;

EID: 77049102613     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/coli.2010.36.1.36100     Document Type: Article

References (57)

1. Abney, Steven P. and Mark Johnson. 1991. Memory requirements and local ambiguities of parsing strategies. J. Psycholinguistic Research, 20(3):233-250.
2. Ades, Anthony E. and Mark Steedman. 1982. On the order of words. Linguistics and Philosophy, 4:517-558.
3. Aho, Alfred V. and Jeffery D. Ullman. 1972. The Theory of Parsing, Translation and 28 Compiling; Volume. I: Parsing. Prentice-Hall, Englewood Cliffs, NJ.
4. Baker, James. 1975. The Dragon system: an overview. IEEE Transactions on Acoustics, Speech and Signal Processing, 23(1):24-29.
5. Bellman, Richard. 1957. Dynamic Programming. Princeton University Press, Princeton, NJ.
6. Berg, George. 1992. A connectionist parser with recursive sentence structure and lexical disambiguation. In Proceedings of the Tenth National Conference on Artificial Intelligence, pages 32-37, San Jose, CA.
7. Bever, Thomas G. 1970. The cognitive basis for linguistic structure. In J. R. Hayes, editor, Cognition and the Development of Language. Wiley, New York, pages 279-362.
8. Brown-Schmidt, Sarah, Ellen Campana, and Michael K. Tanenhaus. 2002. Reference resolution in the wild: Online circumscription of referential domains in a natural interactive problem-solving task. In Proceedings of the 24th Annual Meeting of the Cognitive Science Society, pages 148-153, Fairfax, VA.
9. Charniak, Eugene. 2000. A maximum-entropy inspired parser. In Proceedings of the First Meeting of the North American Chapter of the Association for Computational Linguistics (ANLP-NAACL'00), pages 132-139, Seattle, WA.
10. Chomsky, Noam and George A. Miller. 1963. Introduction to the formal analysis of natural languages. In Handbook of Mathematical Psychology. Wiley, New York, pages 269-321.
11. Collins, Michael. 1999. Head-driven statistical models for natural language parsing. Ph.D. thesis, University of Pennsylvania.
12. Cowan, Nelson. 2001. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences, 24:87-185.
13. Crain, Stephen and Mark Steedman. 1985. On not being led upthe garden path: The use of context by the psychological syntax processor. In D. R. Dowty, L. Karttunen, and A. M. Zwicky, editors, Natural Language Parsing: Psychological, Computational, and Theoretical Perspectives, number 1 in Studies in Natural Language Processing. Cambridge University Press, Cambridge, pages 320-358.
14. Earley, Jay. 1970. An efficient context-free parsing algorithm. CACM, 13(2):94-102.
15. Elman, Jeffrey L. 1991. Distributed representations, simple recurrent networks, and grammatical structure. Machine Learning, 7:195-225.
16. Ericsson, K. Anders and Walter Kintsch. 1995. Long-term working memory. Psychological Review, 102:211-245.
17. Frege, Gottlob. 1892. Uber sinn und bedeutung. Zeitschrift fur Philosophie und Philosophischekritik, 100:25-50.
18. Gibson, Edward. 1991. A computational theory of human linguistic processing: Memory limitations and processing breakdown. Ph.D. thesis, Carnegie Mellon University.
19. Godfrey, John J., Edward C. Holliman, and Jane McDaniel. 1992. Switchboard: Telephone speech corpus for research and development. In Proceedings of ICASSP, pages 517-520, San Francisco, CA.
20. Gordon, N. J., D. J. Salmond, and A. F. M. Smith. 1993. Novel approach to nonlinear/ non-gaussian bayesian state estimation. IEE Proceedings F (Radar and Signal Processing), 140(2):107-113.
21. Gorrell, Paul. 1995. Syntax and Parsing. Cambridge University Press, Cambridge.
22. Hale, John. 2001. A probabilistic earley parser as a psycholinguistic model. In Proceedings of the Second Meeting of the North American Chapter of the Association for Computational Linguistics, pages 159-166, Pittsburgh, PA.
23. Hale, John. 2006. Uncertainty about the rest of the sentence. Cognitive Science, 30(4):609-642.
24. Helasvuo, Marja-Liisa. 2004. Shared syntax: the grammar of co-constructions. Journal of Pragmatics, 36:1315-1336.
25. Henderson, James. 2004. Lookahead in deterministic left-corner parsing. In Proceedings Workshop on Incremental Parsing: Bringing Engineering and Cognition Together, pages 26-33, Barcelona.
26. Hobbs, Jerry R., Douglas E. Appelt, John Bear, David Israel, Megumi Kameyama, Mark Stickel, and Mabry Tyson. 1996. Fastus: A cascaded finite-state transducer for extracting information from natural-language text. In Yves Schabes, editor, Finite State Devices for Natural Language Processing. MIT Press, Cambridge, MA, pages 383-406.
27. Jarvella, Robert J. 1971. Syntactic processing of connected speech. Journal of Verbal Learning and Verbal Behavior, 10:409-416.
28. Jelinek, Frederick, Lalit R. Bahl, and Robert L. Mercer. 1975. Design of a linguistic statistical decoder for the recognition of continuous speech. IEEE Transactions on Information Theory, 21:250-256.
29. Johnson, Mark. 1998a. Finite state approximation of constraint-based grammars using left-corner grammar transforms. In Proceedings of COLING/ACL, pages 619-623, Montreal.
30. Johnson, Mark. 1998b. PCFG models of linguistic tree representation. Computational Linguistics, 24:613-632.
31. Johnson-Laird, P. N. 1983. Mental Models: Towards a Cognitive Science of Language, Inference and Consciousness. Harvard University Press, Cambridge, MA.
32. Just, Marcel Adam and Patricia A. Carpenter. 1992. A capacity theory of comprehension: Individual differences in working memory. Psychological Review, 99:122-149.
33. Just, Marcel Adam and Sashank Varma. 2007. The organization of thinking: What functional brain imaging reveals about the neuroarchitecture of complex cognition. Cognitive, Affective, & Behavioral Neuroscience, 7:153-191.
34. Kamide, Yuki and Don C. Mitchell. 1999. Incremental pre-head attachment in Japanese parsing. Language and Cognitive Processes, 14:631-662.
35. Klein, Dan and Christopher D. Manning. 2003. Accurate unlexicalized parsing. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pages 423-430, Sapporo.
36. Lerner, Gene H. 1991. On the syntax of sentences in progress. Language in Society, 20:441-458.
37. Levy, Roger. 2008. Modeling the effects of memory on human online sentence processing with particle filters. In Proceedings of NIPS, pages 937-944, Vancouver.
38. Lewis, Richard L. and Shravan Vasishth. 2005. An activation-based model of sentence processing as skilled memory retrieval. Cognitive Science, 29(3):375-419.
39. Magerman, David. 1995. Statistical decision-tree models for parsing. In Proceedings of the 33rd Annual Meeting of the Association for Computational Linguistics (ACL'95), pages 276-283, Cambridge, MA.
40. Marcus, Mitch. 1980. Theory of Syntactic Recognition for Natural Language. MIT Press, Cambridge, MA.
41. Marcus, Mitchell P., Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993. Building a large annotated corpus of English: the Penn Treebank. Computational Linguistics, 19(2):313-330.
42. Mayberry, III, Marshall R. and Risto Miikkulainen. 2003. Incremental nonmonotonic parsing through semantic self-organization. In Proceedings of the 25th Annual Conference of the Cognitive Science Society, pages 798-803, Boston, MA.
43. Miller, George A. 1956. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63:81-97.
44. Murphy, Kevin P. and Mark A. Paskin. 2001. Linear time inference in hierarchical HMMs. In Proceedings of NIPS, pages 833-840, Vancouver.
45. Pollard, Carl and Ivan A. Sag. 1994. Head-Driven Phrase Structure Grammar. Chicago: University of Chicago Press and Stanford: CSLI Publications.
46. Pritchett, Bradley L. 1991. Head position and parsing ambiguity. Journal of Psycholinguistic Research, 20:251-270.
47. Resnik, Philip. 1992. Left-corner parsing and psychological plausibility. In Proceedings of COLING, pages 191-197,
48. Nantes. Roark, Brian. 2001. Probabilistic top-down parsing and language modeling. Computational Linguistics, 27(2):249-276.
49. Rohde, Douglas L. T. 2002. A connectionist model of sentence comprehension and production. Ph.D. thesis, Computer Science Department, Carnegie Mellon University.
50. Sachs, Jacqueline. 1967. Recognition memory for syntactic and semantic aspects of connected discourse. Perception and Psychophysics, 2:437-442.
51. Schuler, William. 2009. Parsing with a bounded stack using a model-based right-corner transform. In Proceedings of the North American Association for Computational Linguistics (NAACL'09), pages 344-352, Boulder, CO.
52. Schuler, William, Stephen Wu, and Lane Schwartz. 2009. A framework for fast incremental interpretation during speech decoding. Computational Linguistics, 35(3):313-343.
53. Shieber, Stuart. 1985. Evidence against the context-freeness of natural language. Linguistics and Philosophy, 8:333-343.
54. Smolensky, P. and G. Legendre. 2006. The Harmonic Mind: From Neural Computation to Optimality-Theoretic Grammar. MIT Press, Cambridge, MA.
55. Steedman, Mark. 2000. The Syntactic Process. MIT Press/Bradford Books, Cambridge, MA.
56. Stevenson, Suzanne. 1998. Parsing as incremental restructuring. In J. D. Fodor and F. Ferreira, editors, Reanalysis in Sentence Processing. Kluwer Academic, Boston, MA, pages 327-363.
57. Tanenhaus, Michael K., Michael J. Spivey-Knowlton, Kathy M. Eberhard, and Julie E. Sedivy. 1995. Integration of visual and linguistic information in spoken language comprehension. Science, 268:1632-1634.