How robust are multilingual information retrieval systems?

Proceedings of the ACM Symposium on Applied Computing

Volumn , Issue , 2008, Pages 1132-1136

  Mandl, Thomas ^a   Womser Hacker, Christa ^a   Nunzio, Giorgio Di ^b   Ferro, Nicola ^b  

^a UNIVERSITY OF HILDESHEIM   (Germany)

^b UNIVERSITY OF PADOVA   (Italy)

Author keywords

Cross language evaluation forum (CLEF); Evaluation issues; Geometric mean

Indexed keywords

COMPUTATIONAL FLUID DYNAMICS; INFORMATION RETRIEVAL; INFORMATION RETRIEVAL SYSTEMS; INFORMATION SERVICES; LINGUISTICS; MANAGEMENT INFORMATION SYSTEMS;

CROSS LANGUAGE EVALUATION FORUM (CLEF); EVALUATION EXPERIMENTS; EVALUATION ISSUES; GEOMETRIC MEAN; MULTILINGUAL INFORMATION RETRIEVAL SYSTEMS; RESEARCH RESULTS; RETRIEVAL SYSTEMS;

COMPUTATIONAL GEOMETRY;

EID: 44649128628     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1363686.1363949     Document Type: Conference Paper

References (15)

1. Buckley C. Why current IR engines fail. Proc Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR 2004) ACM Press, 584-585.
2. Buckley, C.; Voorhees, E. The Effect of Topic Set Size on Retrieval Experiment Error. Proc Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '02) (Tampere, Finland, Aug. 11-15, 2002). ACM Press, 2002, 316-323.
3. Buckley, C.; Voorhees, E. M. Retrieval Evaluation with Incomplete Information, Proc Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR 2004) 25-32.
4. Buckley, C.; Voorhees, E. Retrieval System Evaluation. In: TREC: Experiment and Evaluation in Information Retrieval. Cambridge & London: MIT Press. (2005) 53-75.
5. th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR) Seattle. ACM Press, New York. (2006) 33-40.
6. Eguchi, K.; Kando, N.; Kuriyama, K. Sensitivity of IR Systems Evaluation to Topic Difficulty. Proceedings of the Third International Conference on Language Resources and Evaluation (LREC 2002) (Las Palmas de Gran Canaria, Spain, May 29-31, 2002). ELRA, Paris, 585-589.
7. th annual international conference on Research and development in information retrieval (SIGIR 2004). 528-529.
8. th Annual International ACM Conference on Research and Development in Information Retrieval 2005. http://www.haifa.il.ibm.com/sigir05-qp
9. Mandl, T.; Womser-Hacker, C. The Effect of Named Entities on Effectiveness in Cross-Language Information Retrieval Evaluation. Proc ACM Symposium on Applied Computing (SAC). Santa Fe, New Mexico, USA. March 13.-17. 2005. 1059-1064.
10. th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR) Amsterdam. 2007. 375-382.
11. th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain, Revised Selected Papers. Berlin et al.: Springer [Lecture Notes in Computer Science 4730] 2007. 21-34. preprint at: http://www.clef-campaign.org/
12. th ACM International Conference on Information and Knowledge Management (CIKM) Arlington, Virginia, USA 2006. 872-877.
13. th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR) Salvador, Brazil. 2005. 162-169.
14. Savoy, J. Why do successful search systems fail for some topics? In: Proc ACM Symposium on Applied Computing (SAC) Seoul, Korea. 2007. 872-877
15. Voorhees, E. The TREC robust retrieval track. ACM SIGIR Forum 39 (1) 2005. 11-20.