Inside the evaluation process of the cross-language evaluation forum (CLEF): Issues of multilingual topic creation and multilingual relevance assessment

Proceedings of the 3rd International Conference on Language Resources and Evaluation, LREC 2002

Volumn , Issue , 2002, Pages 573-576

  Kluck, Michael ^a   Womser Hacker, Christa ^b  

^a GESIS LEIBNIZ INSTITUTE FOR THE SOCIAL SCIENCES   (Germany)

^b UNIVERSITY OF HILDESHEIM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CROSS-LANGUAGE EVALUATION FORUMS; IR SYSTEMS; RELEVANCE ASSESSMENTS;

LINGUISTICS;

EID: 85003913416     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. Braschler, M., 2002 CLEF 2001 - Overview of Results. In M. Braschler, J. Gonzalo, M. Kluck, C. Peters (eds.), Cross Language Information Retrieval and Evaluation, Workshop of the Cross-Language Evaluation Forum, CLEF 2001, Darmstadt, Germany, September 2001, Revised Papers. Berlin et al.: Springer (in print).
2. Braschler, M., 2001 CLEF 2000 - Overview of Results. In C. Peters (ed.), Cross Language Information Retrieval and Evaluation, Workshop of the Cross-Language Evaluation Forum, CLEF 2000, Lisbon, Portugal, September 2000, Revised Papers. Berlin et al.: Springer (LNCS 2069), 89-101.
3. Harman, D., M. Braschler, M. Hess, M. Kluck, C. Peters, P. Schäuble, and P. Sheridan, 2001. CLIR Evaluation at TREC. In C. Peters (ed.), Cross Language Information Retrieval and Evaluation, Workshop of the Cross- Language Evaluation Forum, CLEF 2000, Lisbon, Portugal, September 2000, Revised Papers. Berlin et al.: Springer (LNCS 2069), 7-23.
4. Hiemstra, D. 2001. The CLEF Relevance Assessment in Practice. Talk at the CLEF 2001 Workshop, 3 September, Darmstadt, Germany.
5. Kluck, M., T. Mandl and C. Womser-Hacker 2002. Cross- Language Evaluation Forum (CLEF) - Europäische Initiative zur Bewertung sprachübergreifender Retrievalverfahren. In Information Wissenschaft & Praxis 53:82-89.
6. Sparck Jones, K., 2000. Further Reflections on TREC. Information Processing & Management 36:37-88.
7. Voorhees, E., 2001. Philosophy of IR Evaluation. In C. Peters (ed.): Results of the CLEF 2001 Cross-Language System Evaluation Campaign, Working Notes for the CLEF 2001 Workshop, 3 September, Darmstadt, Germany, Sophia-Antipolis: ERCIM, 257-260.
8. Voorhees, E., 2000. Variations in Relevance Judgements and the Measurement of Retrieval Effectiveness. Information Processing & Management 36:679-716.
9. Voorhees, E. and D. Harman, 2001. Overview of the Ninth Text Retrieval Conference (TREC-9). In E. Voorhees and D. Harman (eds.) The Ninth Text REtrieval Conference (TREC 9). Gaithersburg: NIST, 1-14, http://trec.nist.gov/pubs/trec9/t9-proceedings.html.
10. Zobel, J., 1998. How Reliable Are the Results of Large- Scale Information Retrieval Experiments? In W. Bruce, A. Moffat, C.J. van Rijsbergen, R. Wilkinson and J. Zobel (eds.), Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York: ACM Press, 307-314.