Providing consistent and exhaustive relevance assessments for XML retrieval evaluation

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2004, Pages 361-370

  Piwowarski, Benjamin ^a,c   Lalmas, Mounia ^b  

^a UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

^b QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^c UNIVERSITY OF CHILE   (Chile)

Author keywords

Evaluation; INEX; Relevance assessment process; XML

Indexed keywords

COMPUTER PROGRAMMING LANGUAGES; DATA ACQUISITION; DIGITAL LIBRARIES; EVALUATION; INTERFACES (COMPUTER); MATHEMATICAL MODELS; STATISTICS;

INEX; RELEVANCE ASSESSMENT PROCESS; RELEVANCE ASSESSMENTS; RETRIEVAL SYSTEMS;

XML;

EID: 18744406320     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1031171.1031246     Document Type: Conference Paper

References (12)

1. R. Baeza-Yates, N. Fuhr, and Y. S. Maarek, editors. ACM SIGIR 2002 Workshop on XML, Aug. 2002.
2. H. M. Blanken, T. Grabs, H.-J. S. andRalf Schenkel, and G. Weikum, editors. Intelligent Search on XML Data, Applications, Languages, Models, Implementations, and Benchmarks, volume 2818 of Lecture Notes in Computer Science. Springer, 2003.
3. D. Carmel, Y. Maarek, and A. Soffer, editors. ACM SIGIR 2000 Workshop on XML, July 2000.
4. Y. Chiaramella. Browsing and Querying: two complementary approaches for Multimedia Information Retrieval. In HIM'97 International Conference, Dortmund, Germany, 1997.
5. N. Fuhr, S. Malik, and M. Lalmas. Overview of the initiative for the evaluation of xml retrieval (inex) 2003. In Proceedings of the Second INEX Workshop, March 2004.
6. G. Kazai. Report of the inex 2003 metrics working group. In N. Fuhr, M. Lalmas, and S. Malik, editors, Proceedings of the 2nd Workshop of the INitiative for the Evaluation of XML retrieval (INEX), Dagstuhl, germany, December 2003, pages 184-190, April 2004.
7. G. Kazai, S. Masood, and M. Lalmas. A study of the assessment of relevance for the INEX'02 test collection. In S. McDonald and J. Tait, editors, Advances in Information Retrieval, 26th European Conference on IR Research, ECIR 2004, volume 2997 of Lecture Notes in Computer Science, Sunderland, UK, Apr. 2004. Springer.
8. J. Kekäläinen and K. Järvelin. Using graded relevance assessments in IR evaluation. Journal of the American Society for Information Science (JASIS), 53(13): 1120-1129, 2002.
9. R. Luk, H. Leong, T. Dillon, A. Chan, W. B. Croft, and J. Allan. A Survey in Indexing and Searching XML Documents. JASIS, 6(53):415-437, Mar. 2002.
10. B. Piwowarski and M. Lalmas. Interface pour l'évaluation de systèmes de recherche sur des documents XML. In Premiere Conference en Recherche d'Information et Applications (CORIA'04), Toulouse, France, Mar. 2004. Hermès.
11. K. Sparck Jones and C. J. Van Rijsbergen. Report on the need for and provision of an ideal information retrieval test collection. Technical Report 5266, Computer Laboratory, University of Cambridge, Cambridge, England, 1975.
12. E. M. Voorhees and D. K. Harman, editors. The Tenth Text Retrieval Conference (TREC 2001), Gaithersburg, MD, USA, 2002. NIST.