Statistical evaluation of information distillation systems

Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008

Volumn , Issue , 2008, Pages 3598-3604

  White, J V ^a   Hunter, D ^a   Goldstein, J D ^a  

^a BAE SYSTEMS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISTILLATION; EQUIVALENCE CLASSES; INFORMATION RETRIEVAL; INFORMATION THEORY;

AUTOMATED SEARCHES; DISTILLATION SYSTEMS; EVALUATION METHODOLOGIES; PERFORMANCE METRICS; RECALL AND PRECISION; STATISTICAL EVALUATION; STATISTICAL PERFORMANCE; WRITTEN DOCUMENTS;

DISTILLATION EQUIPMENT;

EID: 85037350491     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (8)

1. O. Babko-Malaya. 2008. "Annotation of Nuggets and Relevance in GALE Distillation Evaluation. " Proceedings LREC 2008. Marrakech, Morocco.
2. D. Dumitrescu, B. Lazzerini, and L. C. Jain. 2000. Fuzzy Sets and their Application to Clustering and Training. CRC Press, Boca Raton.
3. A. Nenkova and R. Passonneau. 2003. Evaluating Content Selection in Summarization: The Pyramid Method. Technical Report CUCS025-03. Columbia University. http://citeseer.ist.psu.edu/passonneau03evaluating.html.
4. TREC 2005. http://trec.nist.gov/.
5. E. M. Voorhees and H. T. Dang. 2005. "Overview of the TREC 2005 Question Answering Track." Proceedings of the Fourteenth Text Retrieval Conference (TREC 2005).
6. J. V. White, S. Steingold, and C. G. Fournelle. 2004. "Performance Metrics for Group-Detection Algorithms." Proceedings of Interface 2004. Baltimore, MD, May.
7. L. Zhou and E. H. Hovy. 2006. "A Semi-automatic Evaluation Scheme." Proceedings of the DARPA GALE PI workshop. San Francisco, CA. http://www.isi.edu/naturallanguage/people/hovy/papers/07DARPA-ParaEval.pdf.
8. L. Zhou and E. H. Hovy. 2007. "A Semi-Automated Evaluation Scheme: Automated Nuggetization for ManualAnnotation. " Proceedings of the Human Language Technology/North American Association of Computational Linguistics conference (HLT-NAACL 2007). Rochester, NY.