On the contributions of topics to system evaluation

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6611 LNCS, Issue , 2011, Pages 129-140

  Robertson, Stephen ^a  

^a MICROSOFT RESEARCH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION RETRIEVAL;

GENERALISATION; RANDOM SUBSETS; SYSTEM EFFECTIVENESS; SYSTEM EVALUATION;

SET THEORY;

EID: 84979746476     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-20161-5_14     Document Type: Conference Paper

References (9)

1. Cattelan, M., Mizzaro, S.: IR evaluation without a common set of topics. In: Azzopardi, L., Kazai, G., Robertson, S., Rüger, S., Shokouhi, M., Song, D., Yilmaz, E. (eds.) ICTIR 2009. LNCS, vol. 5766, pp. 342–345. Springer, Heidelberg (2009)
2. Cormack, G.V., Lynam, T.R.: Statistical precision of information retrieval evaluation. In: SIGIR 2006, pp. 533–540. ACM Press, New York (2006)
3. Guiver, J., Mizzaro, S., Robertson, S.: A few good topics: Experiments in topic set reduction for retrieval evaluation. Transactions on Information Systems 27(4) (2009)
4. Hauff, C., Hiemstra, D., de Jong, F., Azzopardi, L.: Relying on topic subsets for system ranking estimation. In: CIKM 2009, pp. 1859–1862. ACM, New York (2009), http://doi.acm.org/10.1145/1645953.1646249
5. Kanoulas, E., Pavlu, V., Dai, K., Aslam, J.A.: Modeling the score distributions of relevant and non-relevant documents. In: Azzopardi, L., Kazai, G., Robertson, S., Rüger, S., Shokouhi, M., Song, D., Yilmaz, E. (eds.) ICTIR 2009. LNCS, vol. 5766, pp. 152–163. Springer, Heidelberg (2009)
6. Kleinberg, J.: Authoritative sources in a hyperlinked environment. Journal of the Association for Computing Machinery 46(5), 604–632 (1999)
7. Mizzaro, S., Robertson, S.: HITS hits TREC — exploring IR evaluation results with network analysis. In: SIGIR 2007, pp. 479–486. ACM Press, New York (2007)
8. Robertson, S.: On GMAP – and other transformations. In: CIKM 2006, pp. 78–83. ACM Press, New York (2006)
9. Voorhees, E., Buckley, C.: The effect of topic set size on retrieval experiment error. In: SIGIR 2002, pp. 316–323. ACM Press, New York (2002)