Automatic multi-layer corpus annotation for evaluating question answering methods: CBC4Kids

LINC@EACL 2003 - Proceedings of 4th International Workshop on Linguistically Interpreted Corpora at the 10th Conference of the European Chapter

Volumn , Issue , 2003, Pages 39-46

  Leidner, Jochen L ^a   Dalmas, Tiphaine ^a   Webber, Bonnie ^a   Bos, Johan ^a   Grover, Claire ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS;

CONTROLLED TESTS; CORPUS ANNOTATIONS; MULTI-LAYERS; QUESTION ANSWERING; READING COMPREHENSION TESTS; SEMANTIC TAGS; SYNTACTIC PARSERS; TEST BED; TOKENIZER;

SYNTACTICS;

EID: 85039904507     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. J. Aberdeen, D. Day, L. Hirschman, P. Robinson, and M. Vilain. 1995. MITRE: Description of the Alembic system used for MUC-6. Proceedings of the Sixth Message Understanding Conference (MUC-6), pages 141-155.
2. S. Abney. 1996. Partial parsing via finite-state cascades. Journal of Natural Language Engineering, 2(4):337-344.
3. V. Benzaken, G. Castagna, and A. Frisch. 2002. CDuce: A white paper. In PLAN-X: Workshop on Programming Language Technologies for XML.
4. E. Breck, M. Light, G. Mann, E. Riloff, B. Brown, R Anand, M. Rooth, and M. Thelen. 2001. Looking under the hood: tools for diagnosing your question answering engine. In ACL-2001 Workshop on Open-Domain Question Answering.
5. M. J. Collins. 1997. Three generative, lexicalised models for statistical parsing. In Proceedings of the 35th Annual Meeting ofthe ACL, Madrid. Association for Computational Linguistics.
6. S. Cotton and S. Bird. 2002. An integrated framework for treebanks and multilayer annotations. In Proceedings ofthe Third International Conference on Language Resources and Evaluation.
7. T. Dalmas, J. L. Leidner, B. Webber, C. Grover, and J. Bos. 2003a. Annotating CBC4Kids: A Corpus for Reading Comprehension and Question Answering Evaluation. (Technical Report). School of Informatics, University of Edinburgh.
8. T. Dalmas, J. L. Leidner, B. Webber, C. Grover, and J. Bos. 2003b. Generating annotated corpora for reading comprehension and question answering evaluation. In EACL-2003 Workshop on Natural Language Processing (NLP) for Question-Answering.
9. C. Grover, C. Matheson, A. Mikheev, and M. Moens. 2000. LT TTT-a flexible tokenisation tool. In Proceedings of Second International Conference on Language Resources and Evaluation (LREC 2000).
10. C. Grover, M. Lapata, and A. Lascarides. submitted. A comparison of parsing technology for the biomedical domain. In Journal ofNatural Language Engineering.
11. L. Hirschman, M. Light, E. Breck, and J. D. Burger. 1999. Deep Read: A reading comprehension system. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics.
12. K. A. Krupnikov. submitted. STnG: a streaming transformation and glue engine for XML. In Proceedings of XML Europe 2003.
13. D. Lin. 1995. A dependency-based method for evaluating broad-coverage parsers. In Proceedings oflJCAT 95.
14. D. Lin. 1998. Dependency-based evaluation of MINI-PAR. In Workshop on the Evaluation ofParsing Systems.
15. A. Mikheev, C. Grover, and M. Moens. 1999. X M L tools and architecture for named entity recognition. Journal of Markup Languages: Theory and Practice, 3:89-113.
16. G. Minnen, J. Carroll, and D. Pearce. 2001. Applied morphological processing of English. Journal ofNatural Language Engineering, 7(3):207-223.
17. NIST. online. TIPSTER Text Architecture Concept. http://www-nlpir.nist.gov/related_projects/tipster/.
18. M.F.Porter. 1980. An algorithm for suffix stripping. Program, 14(3): 130-137.
19. A. Ratnaparkhi. 1996. A maximum entropy part-of-speech tagger. In Proceedings of the Empirical Methods in Natural Language Processing Conference.
20. H. Schmid. 1994. Probabilistic pait-of-speech tagging using decision trees. International Conference on New Methods in Language Processing.
21. S. Sekine and R. Grishman. 1995. A corpus-based probabifistic grammar with only two non-terminals. In Proceedings Fourth International Workshop on Parsing Technologies.
22. S.Thompson. 1999. Haskell: The Craft of Functional Programming. Addison-Wesley, Reading, MA, 2nd edition.
23. B. L. Webber, C. Gardent, and J. Bos. 2002. Position statement: Inference in question answering. In Proceedings of the LREC Workshop on Question Answering: Strategy and Resources, Las Palmas, Gran Canaria, Spain.