Modular approach to error analysis and evaluation for multilingual question answering

Proceedings of the 5th International Conference on Language Resources and Evaluation, LREC 2006

Volumn , Issue , 2006, Pages 1143-1146

  Shima, Hideki ^a   Wang, Mengqiu ^a   Lin, Frank ^a   Mitamura, Teruko ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS AND EVALUATION; EXISTING PROBLEMS; GOLD STANDARDS; MODULAR APPROACH; MULTILINGUAL QUESTION ANSWERING SYSTEM; PRECISION AND RECALL; QUESTION ANSWERING; UPPER BOUND;

ERROR ANALYSIS;

EID: 84863654228     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (5)

1. Buckley C., E. M. Voorhees (2000). Evaluating Evaluation Measure Stability. In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 33-40.
2. Hiyakumoto, L.S. (2004). Planning in the JAVELIN QA System. Carnegie Mellon Computer Science Technical Report CMU-CS-04-132.
3. Lin, F., H. Shima, M. Wang, and T. Mitamura (2005). "CMU JAVELIN System for NTCIR CLQA1," In Proceedings of the Fifth NTCIR Workshop, Tokyo, Japan, December.
4. Nyberg, E., R. Frederking, T. Mitamura, J. M. Bilotti, K. Hannan, L. Hiyakumoto, J. Ko, F. Lin, L. Lita, V. Pedro, A. Schlaikjer (2005). JAVELIN I and II Systems at TREC 2005. In Proceedings of The Fourteenth Text REtrieval Conference.
5. Nyberg, E., T. Mitamura. (2002). Evaluating QA Systems on Multiple Dimensions. In Proceedings of LREC 2002 Workshop on QA Strategy and Resources.