The need for accurate alignment in natural language system evaluation

Computational Linguistics

Volumn 27, Issue 2, 2001, Pages 230-248

  Kehler, Andrew ^a   Appelt, Douglas ^b   Bear, John ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Artificial Intelligence Center   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LINGUISTICS;

INFORMATION EXTRACTION TECHNOLOGY; NATURAL LANGUAGE SYSTEMS; NATURAL LANGUAGES; SYSTEM RESPONSE; TECHNOLOGY DEVELOPMENT; TECHNOLOGY PROGRESS;

ALIGNMENT;

EID: 0039892017     PISSN: 08912017     EISSN: None     Source Type: Journal    
DOI: 10.1162/089120101750300517     Document Type: Article

References (8)

1. Aberdeen, John, John Burger, David Day, Lynette Hirschman, Patricia Robinson, and Marc Vilain. 1995. MITRE: Description of the Alembic system used for MUC-6. In Proceedings of the Sixth Message Understanding Conference (MUC-6), pages 141-155, Columbia, MD, November. Morgan Kaufmann.
2. Appelt, Douglas E., Jerry R. Hobbs, John Bear, David Israel, Megumi Kameyama, Andy Kehler, David Martin, Karen Myers, and Mabry Tyson. 1995. SRI International FASTUS system MUC-6 test results and analysis. In Proceedings of the Sixth Message Understanding Conference (MUC-6), pages 237-248, Columbia, MD, November. Morgan Kaufmann.
3. Chinchor, Nancy and Gary Dungca. 1995. Four scorers and seven years ago: The scoring method for MUC-6. In Proceedings of the Sixth Message Understanding Conference (MUC-6), pages 33-38, Columbia, MD, November. Morgan Kaufmann.
4. CSL Special Issue. 1998. Special Issue on Evaluation in Language and Speech Technology. Computer Speech and Language, 12(4).
5. Grishman, Ralph and Beth Sundheim. 1995. Design of the MUC-6 evaluation, In Proceedings of the Sixth Message Understanding Conference (MUC-6), pages 1-11, Columbia, MD, November. Morgan Kaufmann.
6. Hirschman, L. 1998. The evolution of evaluation: Lessons from the message understanding conferences. Computer Speech and Language, 12(4):281-305.
7. Sparck-Jones, Karen and Julia Rose Galliers. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Lecture notes in computer science, 1083. Springer.
8. van Rijsbergen, C. J. 1979. Information Retrieval. Butterworths, London.