A signal-to-noise approach to score normalization

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2009, Pages 797-806

  Arampatzis, Avi ^a   Kamps, Jaap ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Distributed retrieval; Filtering; Fusion; Meta search; Power law; Query length distribution; Query model; Resource selection; Score distribution; Score normalization; Zipf's law

Indexed keywords

DISTRIBUTED RETRIEVAL; METASEARCH; POWER-LAW; QUERY LENGTHS; QUERY MODEL; RESOURCE SELECTION; SCORE NORMALIZATION; ZIPF'S LAW;

BINARY MIXTURES; KNOWLEDGE MANAGEMENT; PARAMETER ESTIMATION; SIGNAL TO NOISE RATIO;

NORMAL DISTRIBUTION;

EID: 74549126066     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1645953.1646055     Document Type: Conference Paper

References (30)

1. L. Adamic and B. Huberman. Zipf's law and the internet. Glottometrics, 3(1):143-150, 2002.
2. A. Arampatzis. Unbiased s-d threshold optimization, initial query degradation, decay, and incrementality, for adaptive document filtering. In TREC, 2001.
3. A. Arampatzis, J. Beney, C. H. A. Koster, and T. P. van der Weide. Incrementality, half-life, and threshold optimization for adaptive document filtering. In TREC, 2000.
4. A. Arampatzis and J. Kamps. A study of query length. In Proceedings SIGIR'08, pages 811-812. ACM, 2008.
5. A. Arampatzis, J. Kamps, and S. Robertson. Where to stop reading a ranked list? Threshold optimization using truncated score distributions. In Proceedings SIGIR'09, pages 524-531. ACM, 2009.
6. A. Arampatzis, S. Robertson, and J. Kamps. Score distributions in information retrieval. In Proceedings of the 2nd International Conference on Theory of Information Retrieval (ICTIR'09), pages 139-151, Microsoft Research, Cambridge, UK, September 2009.
7. A. Arampatzis and A. van Hameren. The score-distributional threshold optimization for adaptive binary classification tasks. In Proceedings SIGIR'01, pages 285-293. ACM, 2001.
8. L. Azzopardi, M. de Rijke, and K. Balog. Building simulated queries for known-item topics: an analysis using six european languages. In Proceedings SIGIR'07, pages 455-462. ACM, 2007.
9. J. P. Callan. Distributed Information Retrieval, chapter 5, pages 127-150. Kluwer Academic Publishers, 2000.
10. J. P. Callan and M. E. Connell. Query-based sampling of text databases. ACM Transactions on Information Systems, 19(2):97-130, 2001.
11. K. Collins-Thompson, P. Ogilvie, Y. Zhang, and J. Callan. Information filtering, novelty detection, and named-page finding. In TREC, 2002.
12. M. Fernández, D. Vallet, and P. Castells. Probabilistic score normalization for rank aggregation. In ECIR'06, volume 3936 of Lecture Notes in Computer Science, pages 553-556. Springer, 2006.
13. M. Fernández, D. Vallet, and P. Castells. Using historical data to enhance rank aggregation. In Proceedings SIGIR'06, pages 643-644. ACM, 2006.
14. L. Q. Ha, E. I. Sicilia-Garcia, J. Ming, and F. J. Smith. Extension of Zipf's law to words and phrases. In Proceedings of the 19th International Conference on Computational Linguistics, pages 1-6. ACL, 2002.
15. D. Hawking and S. Robertson. On collection size and retrieval effectiveness. Inf. Retr., 6(1):99-105, 2003.
16. J. Kamps, M. de Rijke, and B. Sigurbjörnsson. Combination methods for crosslingual web retrieval. In CLEF'05, volume 4022 of Lecture Notes in Computer Science, pages 856-864. Springer, 2006.
17. J. H. Lee. Combining multiple evidence from different properties of weighting schemes. In Proceedings SIGIR'95, pages 180-188. ACM, 1995.
18. J. H. Lee. Analyses of multiple evidence combination. In Proceedings SIGIR'97, pages 267-276. ACM, 1997.
19. D. D. Lewis. Evaluating and optimizing autonomous text classification systems. In Proceedings SIGIR'95, pages 246-254. ACM, 1995.
20. R. Manmatha, T. M. Rath, and F. Feng. Modeling score distributions for combining the outputs of search engines. In Proceedings SIGIR'01, pages 267-275. ACM, 2001.
21. H. Nottelmann and N. Fuhr. From uncertain inference to probability of relevance for advanced IR applications. In Proceedings of the 25th European Conference on Information Retrieval Research (ECIR'03), LNCS 2633, pages 235-250, 2003.
22. D. W. Oard, B. Hedin, S. Tomlinson, and J. R. Baron. Overview of the TREC 2008 legal track. In TREC, 2008.
23. A. Papoulis. Probability, Random Variables, and Stochastic Processes. McGraw-Hill, 2nd edition, 1984.
24. B. D. Ripley and N. L. Hjort. Pattern Recognition and Neural Networks. Cambridge University Press, New York, NY, USA, 1995.
25. S. Robertson. On score distributions and relevance. In Proceedings of 29th European Conference on IR Research (ECIR'07), pages 40-51. Springer, 2007.
26. J. Savoy. Report on CLEF-2003 multilingual tracks. In CLEF'03, volume 3237 of Lecture Notes in Computer Science, pages 64-73. Springer, 2004.
27. S. Sharma, L. T. Nguyen, and D. Jia. Ir-wire: A research tool for p2p information retrieval. In SIGIR Open Source Workshop, Seattle, 2006. ACM.
28. L. Wasserman. All of Statistics: A Concise Course in Statistical Inference (Springer Texts in Statistics). Springer, September 2004.
29. Y. Zhang and J. Callan. Maximum likelihood estimation for filtering thresholds. In Proceedings SIGIR'01, pages 294-302. ACM, 2001.
30. I. Zukerman and E. Horvitz. Using machine learning techniques to interpret wh-questions. In ACL'01: Proceedings of the 39th Annual Meeting on Association for Computational Linguistics, pages 547-554. ACL, 2001.