Here or there preference judgments for relevance

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4956 LNCS, Issue , 2008, Pages 16-27

  Carterette, Ben ^a   Bennett, Paul N ^b   Chickering, David Maxwell ^c   Dumais, Susan T ^b  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

^b MICROSOFT RESEARCH   (United States)

^c MICROSOFT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EVALUATION METHODS; HYPOTHESIS;

DATA ACQUISITION; NUMERICAL ANALYSIS; SEARCH ENGINES;

INFORMATION RETRIEVAL SYSTEMS;

EID: 41849104667     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-78646-7_5     Document Type: Conference Paper

References (14)

1. Voorhees, E.M., Harman, D. (eds.): TREC The MIT Press, Cambridge (2005)
2. Järvelin, K., Kekäläinen, J.: IR evaluation methods for retrieving highly relevant documents. In: Proceedings of SIGIR, pp. 41-48 (2000)
3. Voorhees, E.: Variations in relevance judgments and the measurement of retrieval effectiveness. In: Proceedings of SIGIR, pp. 315-323 (1998)
4. Kendall, M.: Rank Correlation Methods, 4th edn., Griffin, London, UK (1970)
5. Surges, C., Shaked, T., Renshaw, E., Lazier, A., Deeds, M., Hamilton, N., Hullender, G.: Learning to rank using gradient descent. In: Proceedings of ICML, pp. 89-96 (2005)
6. Joachims, T.: Optimizing search engines using clickthrough data. In: Proceedings of KDD, pp. 133-142 (2002)
7. Bartell, B., Cottrell, G., Belew, R.: Learning to retrieve information. In: Proceedings of the Swedish Conference on Connectionism (1995)
8. Frei, H.P., Schäuble, P.: Determining the effectiveness of retrieval algorithms. Information Processing and Management 27(2-3), 153-164 (1991)
9. Joachims, T., Granka, L., Pang, B., Hembrooke, IL, Gay, G.: Accurately interpreting clickthrough data as implicit feedback. In: Proceedings of SIGIR, pp. 154-161 (2005)
10. Buckley, C., Voorhees, E.M.: Retrieval evaluation with incomplete information. In: Proceedings of SIGIR, pp. 25-32 (2004)
11. Mizzaro, S.: Measuring the agreement among relevance judges. In: Proceedings of MIRA (1999)
12. Rorvig, M.E.: The simple scalability of documents. JASIS 41(8), 590-598 (1990)
13. Carterette, B., Allan, J., Sitaraman, R.: Minimal test collections for retrieval evaluation. In: Proceedings of SIGIR, pp. 268-275 (2006)
14. Carterette, B., Petkova, D.: Learning a ranking from pairwise preferences. In: Proceedings of SIGIR, pp. 629-630 (2006)