Model-based inference about IR systems

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6931 LNCS, Issue , 2011, Pages 101-112

  Carterette, Ben ^a  

^a University of Delaware   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN MODELING; NULL HYPOTHESIS; STATISTICAL HYPOTHESIS TESTING; USER NEED;

INFORMATION RETRIEVAL; STATISTICAL TESTS;

SEARCH ENGINES;

EID: 80053037341     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-23318-0_11     Document Type: Conference Paper

References (18)

1. Agrawal, R., Gollapudi, S., Halverson, H., Ieong, S.: Diversifying search results. In: Proceedings of WSDM 2009, pp. 5-14 (2009)
2. Carterette, B.: System effectiveness, user models, and user utility: A conceptual framework for investigation. In: Proceedings of SIGIR (to appear, 2011)
3. Chapelle, O., Metzler, D., Zhang, Y., Grinspan, P.: Expceted reciprocal rank for graded relevance. In: Proceedings of the Annual International ACM Conference on Knowledge and Information Management, CIKM (2009)
4. Clarke, C.L.A., Kolla, M., Cormack, G.V., Vechtomova, O., Ashkan, A., Büttcher, S., MacKinnon, I.: Novelty and diversity in information retrieval evaluation. In: Proceedings of SIGIR 2008, pp. 659-666 (2008)
5. Cormack, G.V., Palmer, C.R., Clarke, C.L.A.: Efficient construction of large test collections. In: Proceedings of SIGIR, pp. 282-289 (1998)
6. Gelman, A., Carlin, J.B., Stern, H.S., Rubin, D.B.: Bayesian Data Analysis. Chapman & Hall/CRC, Boca Raton (2004)
7. Jarvelin, K., Kekalainen, J.: Cumulated gain-based evaluation of ir techniques. ACM Trans. Inf. Syst. 20(4), 422-446 (2002)
8. Kanoulas, E., Carterette, B., Clough, P.D., Sanderson, M.: Evaluation over multiquery sessions. In: Proceedings of SIGIR (to appear, 2011)
9. Moffat, A., Zobel, J.: Rank-biased precision for measurement of retrieval effectiveness. ACM Trans. Info. Sys. 27(1), 1-27 (2008)
10. Monahan, J.F.: A Primer on Linear Models, 1st edn. Chapman and Hall/CRC, Boca Raton (2008)
11. Robertson, S.E.: A new interpretation of average precision. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 689-690 (2008)
12. Robertson, S.E., Kanoulas, E., Yilmaz, E.: Extending average precision to graded relevance judgments. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 603-610 (2010)
13. Smucker, M., Allan, J., Carterette, B.: A comparison of statistical significance tests for information retrieval evaluation. In: Proceedings of CIKM, pp. 623-632 (2007)
14. Venables, W.N., Ripley, B.D.: Modern Applied Statistics with S, 4th edn. Springer, Heidelberg (2002)
15. Voorhees, E.: Variations in relevance judgments and the measurement of retrieval effectiveness. In: Proceedings of SIGIR, pp. 315-323 (1998)
16. Yilmaz, E., Shokouhi, M., Craswell, N., Robertson, S.: Expected browsing utility for web search evaluation. In: Proceedings of the ACM International Conference on Knowledge and Information Management (to appear, 2010)
17. Zhang, Y., Park, L.A., Moffat, A.: Click-based evidence for decaying weight distributions in search effectiveness metrics. Inf. Retr. 13, 46-69 (2010)
18. Zobel, J.: How reliable are the results of large-scale information retrieval experiments? In: Proceedings of SIGIR, pp. 307-314 (1998)