Evaluating state-of-the-art Treebank-style parsers for Coh-Metrix and other learning technology environments

Natural Language Engineering

Volumn 12, Issue 2, 2006, Pages 131-144

  Hempelmann, Christian F ^a   Rus, Vasile ^a   Graesser, Arthur C ^a   McNamara, Danielle S ^a  

^a University of Memphis   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EVALUATION; LEARNING SYSTEMS; STANDARDS; SYNTACTICS; TEXT PROCESSING;

COH-METRIX; LEARNING TECHNOLOGY; TEXT COHESION; TREEBANK-STYLE PARSERS;

COMPUTER PROGRAM LISTINGS;

EID: 33646895420     PISSN: 13513249     EISSN: 14698110     Source Type: Journal    
DOI: 10.1017/S1351324906004207     Document Type: Article

References (26)

1. Abney, S., Schapire, R. E. and Singer, Y. (1999) Boosting applied to tagging and PP attachment. Proceedings of the 1999 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pp. 38-45.
2. Brill, E. and Resnik, P. (1995) A rule-based approach to prepositional phrase attachment disambiguation. Proceedings of the 15th International Conference on Computational Linguistics, Kyoto, Japan.
3. Carroll, J., Briscoe, E. and Sanfilippo, A. (1999) Parser evaluation: current practice. Evaluation of Natural Language Processing Systems: Final Report, pp. 140-150. EC DG-XIII LRE EAGLES Document EAG-II-EWG-PR.1.
4. Charniak, E. (1997) Statistical parsing with a context-free grammar and word statistics. Proceedings of the 14th National Conference on Artificial Intelligence, Menlo Park: AAAI/MIT Press.
5. Charniak, E. (2000) A Maximum-Entropy-inspired parser. Proceedings of the North-American Chapter of Association for Computational Linguistics, Seattle, WA.
6. Charniak, E. and Johnson, M. (2005) Coarse-to-fine n-best parsing and MaxEnt discriminative reranking. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics, pp. 173-180. Ann Arbor, MI.
7. Collins, M. (1996) A new statistical parser based on Bigram lexical dependencies. Proceedings of the 34th Annual Meeting of the ACL, Santa Cruz, CA.
8. Collins, M. (1997) Three generative, lexicalised models for statistical parsing. Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics, Madrid, Spain.
9. Collins, M. and Brooks, J. (1995) Prepositional phrase attachment through a backed-off model. Proceedings of the Third Workshop on Very Large Corpora, Cambridge, UK.
10. Cremers, C. (1993) On Parsing Coordination Categorially. Leiden University.
11. Dufty, D., Hempelmann, C. F., Graesser, A. C. and McNamara, D. S. (2005) Automatic assessment of causal and intentional cohesion in Coh-Metrix. Technical Report, Institute for Intelligent Systems, University of Memphis.
12. Graesser, A. C., McNamara, D. S., Louwerse, M. M. and Cai, Z. (2004) Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, and Computers 36(2): 193-202.
13. Grishman, R., MacLeod, C. and Sterling, J. (1992) Evaluating parsing strategies using standardized parse files. Proceedings of the Third Conference on Applied Natural Language Processing, pp. 156-161.
14. Grootveld, M. (1994) Parsing Coordination Generatively. Leiden University.
15. Hempelmann, C. F., Crossley, S., Graesser, A. C., Louwerse, M. M. and McNamara, D. S. (2005) Automatic assessment of temporal cohesion in Coh-Metrix. Technical Report, Institute for Intelligent Systems, University of Memphis.
16. Hobbs, J. (1978) Resolving pronoun references. Lingua 44: 144-151.
17. Klein, D. and Manning, C. (2003) Accurate unlexicalized parsing. Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, Sapporo, Japan.
18. Lappin, S. and Leass, H. J. (1994) An algorithm for pronominal anaphora resolution. Computational Linguistics 20(4): 535-561.
19. Lin, D. (1995) A dependency-based method for evaluating broad-coverage parsers. Proceedings of International Joint Conference on Artificial Intelligence, pp. 1420-1427.
20. Marcus, M. P., Santorini, B. and Marcinkiewicz, M. A. (1993) Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics 19(2): 313-330.
21. Ratnaparkhi, A., Renyar, J. and Roukos, S. (1994) A maximum entropy model for prepositional phrase attachment. Proceedings of the ARPA Workshop on Human Language Technology.
22. Rus, V. and Hempelmann, C. F. (2005) Across-genres and empirical evaluation of state-of-the-art treebank-style parsers. Proceedings of the 2nd Language and Technology Conference, Poznan, Poland.
23. Rus, V., Dufty, D., Hempelmann, C. F., Graesser, A. C. and McNamara, D. S. (2005) Implementing Anaphora Resolution in Coh-Metrix. Technical Report, Institute for Intelligent Systems, University of Memphis.
24. Sekine, S. and Grishman, R. (1995) A corpus-based probabilistic grammar with only two non-terminals. Proceedings of the International Workshop on Parsing Technologies, pp. 216-223.
25. Sekine, S. and Collins, M. (1997) EvalB: A bracket scoring program. URL: http://www.cs.nyu.edu/cs/projects/proteus/evalb/
26. Voorhees, E. (2002) Overview of the TREC 2002 question answering track. Proceedings of the 11th Text Retrieval Conference (TREC 2002).