Adaptive term frequency normalization for BM25

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2011, Pages 1985-1988

  Lv, Yuanhua ^a   Zhai, ChengXiang ^a  

^a University of Illinois at Urbana Champaign   (United States)

Author keywords

adaptation; bm25; information gain; term frequency

Indexed keywords

ADAPTATION; BM25; INFORMATION GAIN; KEY COMPONENT; LINEAR TERMS; NORMALIZATION FORMULA; RETRIEVAL PERFORMANCE; TERM FREQUENCY; TERM FREQUENCY NORMALIZATION; TERM OCCURRENCES; TRAINING DATA;

KNOWLEDGE MANAGEMENT;

EID: 83055179306     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063576.2063871     Document Type: Conference Paper

References (12)

1. Gianni Amati and Cornelis Joost Van Rijsbergen. Probabilistic models of information retrieval based on measuring the divergence from randomness. ACM Trans. Inf. Syst., 20:357-389, October 2002.
2. Kenneth W. Church and William A. Gale. Poisson mixtures. Natural Language Engineering, 1:163-190, 1995.
3. Hui Fang, Tao Tao, and ChengXiang Zhai. A formal study of information retrieval heuristics. In SIGIR '04, pages 49-56, 2004.
4. Ben He and Iadh Ounis. On setting the hyper-parameters of term frequency normalization for information retrieval. ACM Trans. Inf. Syst., 25, July 2007.
5. Jaakko Hintikka. On Semantic Information. In J. Hintikka and P. Suppes, editors, Information and Inference, pages 3-27. D. Reidel Pub., 1970.
6. K. Sparck Jones, S. Walker, and S. E. Robertson. A probabilistic model of information retrieval: development and comparative experiments. In Information Processing and Management, pages 779-840, 2000.
7. Yuanhua Lv and ChengXiang Zhai. Lower-bounding term frequency normalization. In CIKM '11, 2011.
8. Yuanhua Lv and ChengXiang Zhai. When documents are very long, bm25 fails! In SIGIR '11, pages 1103-1104, 2011.
9. S. E. Robertson and S. Walker. Some simple effective approximations to the 2-poisson model for probabilistic weighted retrieval. In SIGIR '94, pages 232-241, 1994.
10. Stephen Robertson, Hugo Zaragoza, and Michael Taylor. Simple bm25 extension to multiple weighted fields. In CIKM '04, pages 42-49, 2004.
11. Stephen E. Robertson, Steve Walker, Susan Jones, Micheline Hancock-Beaulieu, and Mike Gatford. Okapi at trec-3. In TREC '94, pages 109-126, 1994.
12. Amit Singhal, Chris Buckley, and Mandar Mitra. Pivoted document length normalization. In SIGIR '96, pages 21-29, 1996.