What a rational parser would do

Cognitive Science

Volumn 35, Issue 3, 2011, Pages 399-443

  Hale, John T ^a  

^a Department of Obstetrics Gynecology   (United States)

Author keywords

Comprehension; Entropy reduction; Heuristic; Rationality; Sentence processing; Syntax

Indexed keywords

EID: 79953055632     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1551-6709.2010.01145.x     Document Type: Article

References (108)

1. Abney, S., & Johnson, M. (1991). Memory requirements and local ambiguities of parsing strategies. Journal of Psycholinguistic Research, 20(3), 233-249.
2. Anderson, J. R. (1990). The adaptive character of thought. Hilldale, NJ: Lawrence Erlbaum Associates.
3. Bach, E. (1976). An extension of classical transformational grammar. In Problems of linguistic metatheory (pp. 183-224). Available at: Accessed on October 21, 2010.
4. Bailey, K. G., & Ferreira, F. (2003). Disfluencies affect the parsing of garden-path sentences. Journal of Memory and Language, 49(2), 183-200.
5. Berwick, R. C., & Weinberg, A. S. (1984). The grammatical basis of linguistic performance. Cambridge, MA: MIT Press.
6. Bever, T. G. (1970). The cognitive basis for linguistic structures. In J. Hayes (Ed.), Cognition and the development of language (pp. 279-362). New York, NY: Wiley.
7. Bicknell, K., Levy, R., & Demberg, V. (2009). Correcting the incorrect: Local coherence effects modeled with prior belief update. In I. Kwon, H. Pritchett & J. Spence (Eds.), Proceedings of the 35th annual meeting of the Berkeley linguistics society (pp. 13-24). Berkeley, CA: Berkeley Linguistics Society.
8. Boland, J. E. (1993). The role of verb argument structure in sentence processing: Distinguishing between syntactic and semantic effects. Journal of Psycholinguistic Research, 22(2), 133-152.
9. Boston, M. F., Hale, J. T., Patil, U., Kliegl, R., & Vasishth, S. (2008). Parsing costs as predictors of reading difficulty: An evaluation using the Potsdam Sentence Corpus. Journal of Eye Movement Research, 2(1), 1-12.
10. Boston, M. F., Hale, J. T., Vasishth, S., & Kliegl, R. (2011). Parallel processing and sentence comprehension difficulty. Language and Cognitive Processes.
11. Brants, T., & Crocker, M. (2000). Probabilistic parsing and psychological plausibility. In Proceedings of 18th international conference on Computational Linguistics COLING-2000. Saarbrücken/Luxembourg/Nancy: The Association for Computational Linguistics.
12. Brants, S., Dipper, S., Eisenberg, P., Hansen-Schirra, S., König, E., Lezius, W., Rohrer, C., Smith, G., & Uszkoreit, H. (2004). TIGER Linguistic interpretation of a German corpus. Research on Language and Computation, 2, 597-619.
13. Bresnan, J. (1982). Introduction: Grammars as mental representations of language. In J. Bresnan (Ed.), The mental representation of grammatical relations (pp. xvii, lii). Cambridge, MA: MIT Press.
14. Bresnan, J. (2001). Lexical-functional syntax. Malden, MA: Blackwell.
15. Carroll, P. J., & Slowiaczek, M. L. (1991). Modes and modules: Multiple pathways to the language processor. In J. L. Garfield (Ed.), Modularity in knowledge representation and natural language understanding (pp. 221-247). Cambridge, MA: MIT Press.
16. Chambers, C. G., Magnuson, J. S., & Tanenhaus, M. K. (2004). Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology: Learning, Memory and Cognition, 30(3), 687-696.
17. Chater, N., Crocker, M. W., & Pickering, M. J. (1998). The rational analysis of inquiry: The case of parsing. In M. Oaksford & N. Chater (Eds.), Rational models of cognition (pp. 441-468). New York: Oxford University Press.
18. Chomsky, N. (1965). Aspects of the theory of syntax. Cambridge, MA: MIT Press.
19. Chomsky, N. (1995). Some notes on economy of derivation and representation. In The Minimalist Program (chap. 2) (pp. 129-166). Cambridge, MA: MIT Press.
20. Clifton, C., Speer, S., & Abney, S. P. (1991). Parsing arguments: Phrase structure and argument structure as determinants of initial parsing decisions. Journal of Memory and Language, 30(2), 251-271.
21. Crain, S., & Fodor, J. D. (1985). How can grammars help parsers? In D. R. Dowty, L. Karttunen, & A. M. Zwicky (Eds.), Natural language parsing: Psychological, computational and theoretical perspectives (pp. 94-127). Cambridge, England: Cambridge University Press.
22. Crain, S., & Steedman, M. (1985). On not being led up the garden path: the use of context by the psychological syntax processor. In D. Dowty, L. Karttunen, & A. Zwicky (Eds.), Natural language parsing: Psychological, computational and theoretical perspectives (pp. 320-538). New York: Cambridge University Press.
23. Crocker, M. W. (2005). Rational models of comprehension: Addressing the performance paradox. In A. Cutler (Ed.), Twenty-first century psycholinguistics: Four cornerstones (pp. 363-380). Mahwah, NJ: Erlbaum.
24. Demberg, V., & Keller, F. (2008). Data from eye-tracking corpora as evidence for theories of syntactic processing complexity. Cognition, 109(2), 193-210.
25. Demberg, V., & Keller, F. (2009). A computational model of prediction in human parsing: Unifying locality and surprisal effects. In N. Taatgen, & H. van Rijn (Eds.), Proceedings of the 29th meeting of the Cognitive Science Society (pp. 1888-1893).
26. Demers, A. J. (1977). Generalized left corner parsing. In Conference report of the 4th annual association for computing machinery symposium on principles of programming languages (pp. 170-181). New York: Association for Computing Machinery.
27. Earley, J. (1970). An efficient context-free parsing algorithm. Communications of the Association for Computing Machinery, 13(2), 94-102.
28. Eisner, J. (2002). Discovering syntactic deep structure via Bayesian statistics. Cognitive Science, 26(3), 255-268.
29. Elman, J. L. (1995). Language as a dynamical system. In R. F. Port & T. van Gelder (Eds.), Mind as motion: Explorations in the dynamics of cognition (pp. 195-225). Cambridge, MA: MIT Press.
30. Everett, C. J., & Ulam, S. M. (1948). Multiplicative systems in several variables I (Tech. Rep. No. LA-683). In A. R. Bednarek & F. Ulam (Eds.), Analogies between analogies: The mathematical reports of S. M. Ulam and his Los Alamos collaborators. Available at: Accessed on October 21, 2010.
31. Fodor, J. A. (1983). The modularity of mind: An essay on faculty psychology. Cambridge, MA: MIT Press.
32. Ford, M., Bresnan, J., & Kaplan, R. M. (1982). A competence-based theory of syntactic closure. In J. Bresnan (Ed.), The mental representation of grammatical relations (pp. 727-796). Cambridge, MA: MIT Press.
33. Frank, S. (2010). Uncertainty reduction as a measure of cognitive processing effort. In Proceedings of the 2010 workshop on cognitive modeling and computational linguistics (pp. 81-89). Uppsala, Sweden: Association for Computational Linguistics. Available at: Accessed on October 26, 2010.
34. Frazier, L. (1979). On comprehending sentences: Syntactic parsing strategies. Unpublished doctoral dissertation, University of Connecticut.
35. Frazier, L., & Clifton, C. Jr. (1996). Construal. Cambridge, MA: MIT Press.
36. Frazier, L., & Fodor, J. D. (1978). The sausage machine: A new two-stage parsing model. Cognition, 6, 291-325.
37. Gazdar, G., Klein, E., Pullum, G., & Sag, I. (1985). Generalized phrase structure grammar. Cambridge, MA: Harvard University Press.
38. van Gelder, T. (1998). The dynamical hypothesis in cognitive science. Behavioral and Brain Sciences, 21, 615-628.
39. Gibson, E. (1991). A computational theory of human linguistic processing: Memory limitations and processing breakdown. Unpublished doctoral dissertation, Carnegie Mellon University.
40. Gibson, E. (2006). The interaction of top-down and bottom-up statistics in the resolution of syntactic category ambiguity. Journal of Memory and Language, 54, 363-388.
41. Grice, H. P. (1975). Logic and conversation. In P. Cole & J. Morgan (Eds.), Syntax and semantics 3: Speech acts (pp. 41-58). New York: Academic Press.
42. Grodner, D., Gibson, E., Argaman, V., & Babyonyshev, M. (2003). Against repair-based reanalysis in sentence comprehension. Journal of Psycholinguistic Research, 32(2), 141-166.
43. Grune, D., & Jacobs, C. J. H. (2008). Parsing techniques: A practical guide. (2nd ed.) New York: Springer.
44. Hale, J. (2001). A probabilistic Earley parser as a psycholinguistic model. In Proceedings of the second meeting of the North American chapter of the Association for Computational Linguistics Available at: Accessed on October 26, 2010.
45. Hale, J. (2003). The information conveyed by words in sentences. Journal of Psycholinguistic Research, 32(2), 101-123.
46. Hale, J. (2006). Uncertainty about the rest of the sentence. Cognitive Science, 30(4), 609-642.
47. Hart, P. E., Nilsson, N. J., & Raphael, B. (1968). A formal basis for the heuristic determination of minimum cost paths. IEEE Transactions of systems science and cybernetics, ssc-4(2), 100-107.
48. Hemforth, B., Konieczny, L., & Strube, G. (1993). Incremental syntax processing and parsing strategies. In Proceedings of the 15th annual conference of the Cognitive Science Society (pp. 539-544). Hillsdale, NJ: Erlbaum.
49. Johnson-Laird, P. N. (1983). Mental models: Towards a cognitive science of language, inference, and consciousness. Cambridge, England: Cambridge University Press.
50. Kamide, Y. (2008). Anticipatory processes in sentence processing. Language and Linguistics Compass, 2/4, 647-670.
51. Kaplan, R. M. (1972). Augmented transition networks as psychological models of sentence comprehension. Artificial Intelligence, 3, 77-100.
52. Kimball, J. P. (1973). Seven principles of surface structure parsing in natural language. Cognition, 2, 15-48.
53. Konieczny, L. (2005). The psychological reality of local coherences in sentence processing. In B. G. Bara, L. Barsalou, & M. Bucciarelli (Eds.), Proceedings of the 27th annual meeting of the Cognitive Science Society (pp. 1178-1183). Mahwah, NJ: Erlbaum.
54. Konieczny, L., & Müller, D. (2006). Local coherence interpretation in spoken language: Evidence from a visual-world-experiment. (Architectures and Mechanisms of Language Processing)
55. Konieczny, L., & Müller, D. (2007). Local syntactic coherence interpretation in written and spoken language. (Talk delivered at the 20th annual CUNY conference on human sentence processing)
56. Korf, R. E. (1995). Space-efficient search algorithms. ACM Computing Surveys, 27(3), 337-339.
57. Kučera, H., & Francis, W. N. (1967). Computational analysis of present-day American English. Providence, RI: Brown University Press.
58. Laird, J. E., & Newell, A. (1983). A universal weak method. In P. S. Rosenbloom, J. E. Laird, & A. Newell (Eds.), The Soar papers: Research on integrated intelligence (chap. 6) (pp. 245-292), Cambridge, MA: MIT Press.
59. Levine, R., & Hukari, T. E. (2004). The unity of unbounded dependency constructions (Vol. no. 160). Stanford, CA: Center for the Study of Language and Information.
60. Levy, R. (2008). Expectation-based syntactic comprehension. Cognition, 106(3), 1126-1177.
61. Lewis, R. L. (1993). An architecturally-based theory of human sentence comprehension. Unpublished doctoral dissertation, Pittsburgh, PA: Carnegie Mellon University.
62. Lewis, R. L., & Vasishth, S. (2005). An activation-based model of sentence processing as skilled memory retrieval. Cognitive Science, 29(3), 375-419.
63. MacDonald, M. C., Pearlmutter, N. J., & Seidenberg, M. S. (1994). Lexical nature of syntactic ambiguity resolution. Psychological Review, 101(4), 676-703.
64. Marcus, M. P. (1980). A theory of syntactic recognition for natural language. Cambridge, MA: MIT Press.
65. Marcus, M. P., Santorini, B., & Marcinkiewicz, M. A. (1993). Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19, 313-330.
66. Marr, D. (1982). Vision: A computational investigation into the human representation and processing of visual information. San Francisco: W.H. Freeman and Company.
67. Marslen-Wilson, W. (1973). Linguistic structure and speech shadowing at very short latencies. Nature, 244, 522-523.
68. McRae, K., Ferretti, T. R., & Amyote, L. (1997). Thematic roles as verb-specific concepts. Language and Cognitive Processes, 12(2/3), 137-176.
69. Miller, G. A. (1962). Some psychological studies of grammar. American Psychologist, 17(10), 748-762.
70. Mitchell, D. C. (1987). Lexical guidance in human parsing: Locus and processing characteristics. In M. Coltheart (Ed.), Attention and performance XII: The psychology of reading (pp. 601-681). Hillsdale, NJ: Erlbaum.
71. Mitchell, D. C., Cuetos, F., Corley, M. M., & Brysbaert, M. (1995). Exposure-based models of human parsing: Evidence for the use of coarse-grained (nonlexical) statistical records. Journal of Psycholinguistic Research, 24(6), 469-488.
72. Narayanan, S., & Jurafsky, D. (1998). Bayesian models of human sentence processing. In Proceedings of the 20th annual conference of the Cognitive Science Society. Madison, WI: University of Wisconsin-Madison.
73. Narayanan, S., & Jurafsky, D. (2002). Bayesian model predicts human parse preference and reading time in sentence processing. In S. B. Thomas G. Dietterich & Z. Ghahramani (Eds.), Advances in neural information processing systems 14: Proceedings of the 2001 conference (pp. 59-65). Cambridge, MA: MIT Press.
74. Newell, A. (1968). On the analysis of human problem-solving protocols. In J.-C. Gardin & B. Jauilin (Eds.), Calcul et formalisation dans les sciences de l'homme (pp. 146-185). Paris: Editions du Central National de la Recherche Scientifique.
75. Newell, A. (1980). The knowledge level. In P. S. Rosenbloom, J. E. Laird, & A. Newell (Eds.), The Soar papers: Research on integrated intelligence (pp. 136-176). Cambridge, MA: MIT Press.
76. Newell, A., & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice-Hall.
77. Port, R. F. (2003). Dynamical systems hypothesis in cognitive science. In L. Nadel (Ed.), Encyclopedia of cognitive science (pp. 1027-1032). New York: Nature Publishing Group. doi:.
78. Price, P., Ostendorf, M., Shattuck-Hufnagel, S., & Fong, C. (1991). The use of prosody in syntactic disambiguation. Journal of the Acoustic Society of America, 90(6), 2956-2970.
79. Pritchett, B. (1988). The grammatical basis of language processing. Language, 64(3), 539-576.
80. Pritchett, B. (1992). Grammatical competence and parsing performance. Chicago: University of Chicago Press.
81. Pylyshyn, Z. W. (1999). What's in your mind? In E. LePore & Z. W. Pylyshyn (Eds.), What is Cognitive Science? (pp. 1-20). Malden, MA: Blackwell.
82. Resnik, P. (1992). Left-corner parsing and psychological plausibility. In Proceedings of the fourteenth international conference on computational linguistics. Nantes, France.
83. Roark, B., & Johnson, M. (1999). Broad coverage predictive parsing. Presented at the 12th Annual CUNY Conference on Human Sentence Processing.
84. Roark, B., Bachrach, A., Cardenas, C., & Pallier, C. (2009). Deriving lexical and syntactic expectation-based measures for psycholinguistic modeling via incremental top-down parsing. In Proceedings of the 2009 conference on empirical methods in natural language processing (pp. 324-333). Singapore: Association for Computational Linguistics. Available at: Accessed on October 26, 2010.
85. Rosenkrantz, D. J., & Lewis, P. M. (1970). Deterministic left corner parsing. In IEEE conference record of the 11th annual symposium on switching and automata (pp. 139-152). New York: IEEE. DOI: .
86. Russell, S. J. (1992). Efficient memory-bounded search methods. In B. Neumann (Ed.), Proceedings of the Tenth European Conference on Artificial Intelligence (pp. 1-5). Chichester, NY: Wiley.
87. Schabes, Y. (1990). Mathematical and computational aspects of lexicalized grammars. Unpublished doctoral dissertation, University of Pennsylvania.
88. Schuler, W., Miller, T., AbdelRahman, S., & Schwartz, L. (2010). Broad-coverage parsing using human-like memory constraints. Computational Linguistics, 36(1), 1-30.
89. Shieber, S., & Johnson, M. (1993). Variations on incremental interpretation. Journal of Psycholinguistic Research, 22(2), 287-318.
90. Speer, S. R., Kjelgaard, M. M., & Dobroth, K. M. (1996). The influence of prosodic structure on the resolution of temporary syntactic closure ambiguities. Journal of Psycholinguistic Research, 25(2), 249-271.
91. Srinivas, B., Kim, A., & Trueswell, J. (2002). The convergence of lexicalist perspectives in psycholinguistics and computational linguistics. In P. Merlo & S. Stevenson (Eds.), The lexical basis of sentence processing (pp. 109-135). Amsterdam: John Benjamins.
92. Stabler, E. (1991). Avoid the pedestrian's paradox. In R. C. Berwick, S. P. Abney, & C. Tenny (Eds.), Principle-based parsing: Computation and psycholinguistics (pp. 199-237). Dordrecht, The Netherlands: Kluwer.
93. Steedman, M. (1989). Grammar, interpretation and processing from the lexicon. In W. Marslen-Wilson (Ed.), Lexical representation and process (pp. 463-504). Cambridge, MA: MIT Press.
94. Steedman, M. (2000). The syntactic process. Cambridge, MA: MIT Press.
95. Stolcke, A. (1995). An efficient probabilistic context-free parsing algorithm that computes prefix probabilities. Computational Linguistics, 21(2), 165-201.
96. Stowe, L. A. (1989). Thematic structures and sentence comprehension. In G. N. Carlson, & M. K. Tanenhaus (Eds.), Linguistic structure in language processing (pp. 319-357). Boston: Kluwer.
97. Sturt, P., & Crocker, M. (1996). Monotonic syntactic processing: A cross-linguistic study of attachment and reanalysis. Language and Cognitive Processes, 11(5), 449-494.
98. Sturt, P., Pickering, M. J., & Crocker, M. W. (1999). Structural change and reanalysis difficulty in language comprehension. Journal of Memory and Language, 40, 136-150.
99. Sturt, P., Costa, F., Lombardo, V., & Frasconi, P. (2003). Learning first-pass structural attachment preferences with dynamic grammars and recursive neural networks. Cognition, 88(2), 133-169.
100. Tabor, W., Galantucci, B., & Richardson, D. (2004). Effects of merely local syntactic coherence on sentence processing. Journal of Memory and Language, 50(4), 355-370.
101. Tanenhaus, M., Spivey-Knowlton, M., Eberhard, K., & Sedivy, J. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268, 1632-1634.
102. Thorne, J. P. (1968). A computer model for the perception of syntactic structure. Proceedings of the Royal Society of London. Series B, Biological Sciences, 171(1024), 377-386. Available at: Accessed on October 26, 2010.
103. Tutunjian, D., & Boland, J. (2008). Do we need a distinction between arguments and adjuncts? Evidence from psycholinguistic studies of comprehension. Language and Linguistics Compass, 2(4), 631-646.
104. Weinberg, A. (1993). Parameters in the theory of sentence processing: Minimal commitment theory goes east. Journal of Psycholinguistic Research, 22(3), 339-364.
105. Wetherell, C. (1980). Probabilistic languages: A review and some open questions. Computing Surveys, 12(4), 361-379.
106. Wilson, K., & Carroll, J. B. (1954). Applications of entropy measures to problems of sequential structure. In C. E. Osgood & T. A. Sebeok (Eds.), Psycholinguistics: A survey of theory and research (pp. 103-110). Bloomington, IN: Indiana University Press.
107. Yun, J., Whitman, J., & Hale, J. (2010). Subject-object asymmetries in Korean sentence comprehension. In S. Ohlsson & R. Catrambone (Eds.), Proceedings of the 32nd Annual Meeting of the Cognitive Science Society (pp. 2152-2157). Austin, TX: Cognitive Science Society.
108. Zhou, R., & Hansen, E. A. (2002). Memory-bounded A* graph search. In S. Haller, & G. Simmons (Eds.), Proceedings of the fifteenth international FLAIRS conference (pp. 203-209). Menlo Park, CA: AAAI Press.