Deriving lexical and syntactic expectation-based measures for psycholinguistic modeling via incremental top-down parsing

EMNLP 2009 - Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: A Meeting of SIGDAT, a Special Interest Group of ACL, Held in Conjunction with ACL-IJCNLP 2009

Volumn , Issue , 2009, Pages 324-333

  Roark, Brian ^a   Bachrach, Asaf ^b   Cardenas, Carlos ^c   Pallier, Christophe ^b  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^b Cognitive Neuroimaging Unit ^*  (France)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; STOCHASTIC SYSTEMS;

ENTROPY MEASURE; NOVEL METHODS; PSYCHOLINGUISTIC MODELS; STOCHASTIC PARSERS; TOP-DOWN PARSING;

SYNTACTICS;

EID: 79952712634     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3115/1699510.1699553     Document Type: Conference Paper

References (38)

1. J.R. Anderson and L.J. Schooler. 1991. Reflections of the environment in memory. Psychological Science, 2(6):396-408.
2. A. Bachrach, B. Roark, A. Marantz, S. Whitfield-Gabrieli, C. Cardenas, and J.D.E. Gabrieli. 2009. Incremental prediction in naturalistic language processing: An fMRI study. In preparation.
3. D. Bates, M. Maechler, and B. Dai, 2008. lme4: Linear mixed-effects models using S4 classes. R package version 0.999375-20.
4. S. Bestmann, L.M. Harrison, F. Blankenburg, R.B. Mars, P. Haggard, and K.J. Friston. 2008. Influence of uncertainty and surprise on human corticospinal excitability during preparation for action. Current Biology, 18:775-780.
5. M. Ferrara Boston, J.T. Hale, R. Kliegl, U. Patil, and S. Vasishth. 2008a. Parsing costs as predictors of reading ifficulty: An evaluation using the Potsdam sentence corpus. Journal of Eye Movement Research, 2(1):1-12.
6. M. Ferrara Boston, J.T. Hale, R. Kliegl, and S. Vasishth. 2008b. Surprising parser actions and reading difficulty. In Proceedings of ACL-08:HLT, Short Papers, pages 5-8.
7. D.C. Bradley. 1983. Computational Distinctions of Vocabulary Type. Indiana University Linguistics Club, Bloomington.
8. C. Chelba and F. Jelinek. 1998. Exploiting syntactic structure for language modeling. In Proceedings of ACL-COLING, pages 225-231.
9. M.J. Collins and B. Roark. 2004. Incremental parsing with the perceptron algorithm. In Proceedings of ACL, pages 111-118.
10. K.A. DeLong, T.P. Urbach, and M. Kutas. 2005. Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nature Neuroscience, 8(8):1117-1121.
11. V. Demberg and F. Keller. 2008. Data from eyetracking corpora as evidence for theories of syntactic processing complexity. Cognition, 109(2):193-210.
12. J. Earley. 1970. An efficient context-free parsing algorithm. Communications of the ACM, 6(8):451-455.
13. L. Frazier. 1985. Syntactic complexity. In D.R. Dowty, L. Karttunen, and A.M. Zwicky, editors, Natural Language Parsing. Cambridge University Press, Cambridge, UK.
14. K. Gabani, M. Sherman, T. Solorio, and Y. Liu. 2009. A corpus-based approach for the prediction of language impairment in monolingual English and Spanish-English bilingual children. In Proceedings of NAACL-HLT.
15. S.M. Garnsey, N.J. Pearlmutter, E. Myers, and M.A. Lotocky. 1997. The contributions of verb bias and plausibility to the comprehension of temporarily ambiguous sentences. Journal of Memory and Language, 37(1):58-93.
16. E. Gibson. 1998. Linguistic complexity: locality of syntactic dependencies. Cognition, 68(1):1-76.
17. E. Gibson. 2006. The interaction of top-down and bottom-up statistics in the resolution of syntactic category ambiguity. Journal of Memory and Language, 54(3):363-388.
18. J.T. Hale. 2001. A probabilistic Earley parser as a psycholinguistic model. In Proceedings of the 2nd meeting of NAACL.
19. J.T. Hale. 2003. The information conveyed by words in sentences. Journal of Psycholinguistic Research, 32(2):101-123.
20. J.T. Hale. 2006. Uncertainty about the rest of the sentence. Cognitive Science, 30(4):643-672.
21. J. Henderson. 2003. Inducing history representations for broad coverage statistical parsing. In Proceedings of HLT-NAACL, pages 24-31.
22. R. Hyman. 1953. Stimulus information as a determinant of reaction time. Journal of Experimental Psychology: General, 45(3):188-96.
23. F. Jelinek and J. Lafferty. 1991. Computation of the probability of initial substring generation by stochastic context-free grammars. Computational Linguistics, 17(3):315-323.
24. M. Johnson and B. Roark. 2000. Compact non-leftrecursive grammars using the selective left-corner transform and factoring. In Proceedings of COLING, pages 355-361.
25. T. Klee and M.D. Fitzgerald. 1985. The relation between grammatical development and mean length of utterance in morphemes. Journal of Child Language, 12:251-269.
26. R. Levy. 2008. Expectation-based syntactic comprehension. Cognition, 106(3):1126-1177.
27. K. Lund and C. Burgess. 1996. Producing high-dimensional semantic spaces from lexical cooccurrence. Behavior Research Methods, Instruments, & Computers, 28:203-208.
28. M.P. Marcus, B. Santorini, and M.A. Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19(2):313-330.
29. J. Nivre, J. Hall, J. Nilsson, A. Chanev, G. Eryigit, S. Köbler, S. Marinov, and E. Marsi. 2007. Maltparser: A language-independent system for datadriven dependency parsing. Natural Language Engineering, 13(2):95-135.
30. B. Roark, M. Mitchell, and K. Hollingshead. 2007. Syntactic complexity measures for detecting mild cognitive impairment. In Proceedings of BioNLP Workshop at ACL, pages 1-8.
31. B. Roark. 2001. Probabilistic top-down parsing and language modeling. Computational Linguistics, 27(2):249-276.
32. B. Roark. 2004. Robust garden path parsing. Natural Language Engineering, 10(1):1-24.
33. K. Sagae, A. Lavie, and B. MacWhinney. 2005. Automatic measurement of syntactic development in child langugage. In Proceedings of ACL, pages 197-204.
34. T. Solorio and Y. Liu. 2008. Using language models to identify language impairment in Spanish-English bilingual children. In Proceedings of BioNLP Workshop at ACL, pages 116-117.
35. A. Stolcke. 1995. An efficient probabilistic contextfree parsing algorithm that computes prefix probabilities. Computational Linguistics, 21(2):165-202.
36. W.L. Taylor. 1953. Cloze procedure: A new tool for measuring readability. Journalism Quarterly, 30:415-433.
37. J.J.A. Van Berkum, C.M. Brown, P. Zwitserlood, V.Kooijman, and P. Hagoort. 2005. Anticipating upcoming words in discourse: Evidence from ERPs and reading times. Learning and Memory, 31(3):443-467.
38. V.H. Yngve. 1960. A model and an hypothesis for language structure. Proceedings of the American Philosophical Society, 104:444-466.