The probabilistic relevance framework: BM25 and beyond

Foundations and Trends in Information Retrieval

Volumn 3, Issue 4, 2009, Pages 333-389

  Robertson, Stephen ^a   Zaragoza, Hugo ^b  

^a MICROSOFT RESEARCH   (United Kingdom)

^b YAHOO RESEARCH   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

BINARY INDEPENDENCE MODEL; DOCUMENT RETRIEVAL; FORMAL FRAMEWORK; FREE PARAMETERS; GRAPH INFORMATION; PARAMETER OPTIMISATION; PROBABILISTIC MODELLING; RANKING ALGORITHM; RELEVANCE FEEDBACK; RETRIEVAL ALGORITHMS; RETRIEVAL MODELS; SEARCH ALGORITHMS; STATISTICAL MODELS;

FEEDBACK; LEARNING ALGORITHMS; PARAMETER ESTIMATION; WORLD WIDE WEB;

INFORMATION RETRIEVAL;

EID: 74549177601     PISSN: 15540669     EISSN: 15540677     Source Type: Journal    
DOI: 10.1561/1500000019     Document Type: Article

References (63)

1. S. Agarwal, C. Cortes, and R. Herbrich, eds., Proceedings of the NIPS 2005 Workshop on Learning to Rank, 2005.
2. G. Amati, C. J. van Rijsbergen, and C. Joost, "Probabilistic models of information retrieval based on measuring the divergence from randomness," ACM Transactions on Information Systems, vol.20, no.4, pp. 357-389, 2002.
3. M. M. Beaulieu, M. Gatford, X. Huang, S. E. Robertson, S. Walker, and P. Williams, "Okapi at TREC-5," The Fifth Text Retrieval Conference (TREC5). NIST Special Publication 500-238, pp. 143-165, 1997.
4. F. V. Berghen, "Trust Region Algorithms," WebPage, http://www.lemurproject.org.
5. F. V. Berghen, "CONDOR: A constrained, non-linear, derivative-free parallel optimizer for continuous, high computing load, noisy objective functions," PhD thesis, Universit́e Libre de Bruxelles, 2004.
6. C. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics). Springer, 2006.
7. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent dirichlet allocation," Journal of Machine Learning Research, vol.3, pp. 993-1022, 2003.
8. D. Bodoff and S. E. Robertson, "A new unified probabilistic model," Journal of the American Society for Information Science and Technology, vol.55, pp. 471-487, 2004.
9. P. Boldi and S. Vigna, "MG4J at TREC 2005," in The Fourteenth Text Retrieval Conference (TREC 2005) Proceedings, NIST Special Publication 500-1266, 2005. http://mg4j.dsi.unimi.it/.
10. C. Burges, T. Shaked, E. Renshaw, A. Lazier, M. Deeds, N. Hamilton, and G. Hullender, "Learning to rank using gradient descent," in Proceedings of the International Conference on Machine Learning (ICML), vol.22, p. 89, 2005.
11. W. Cooper, "Some inconsistencies and misidentified modelling assumptions in probabilistic information retrieval," ACM Transactions on Information Systems, vol.13, pp. 110-111, 1995.
12. N. Craswell, S. E. Robertson, H. Zaragoza, and M. Taylor, "Relevance weighting for query independent evidence," in Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 472-479, ACM, 2005.
13. N. Craswell, H. Zaragoza, and S. E. Robertson, "Microsoft Cambridge at TREC-14: Enterprise track," in The Fourteenth Text Retrieval Conference (TREC 2005), 2005.
14. F. Crestani, M. Lalmas, C. J. van Rijsbergen, and I. Campbell, "Is this document relevant? ⋯ probably": A survey of probabilistic models in information retrieval," ACM Computing Surveys, vol. 30, no. 4, 1998.
15. W. B. Croft and D. J. Harper, "Using probabilistic models of document retrieval without relevance information," Journal of Documentation, vol.35, pp. 285-295, 1979.
16. W. Feller, An Introduction to Probability Theory and Its Applications, vol.1. Wiley, 1968.
17. N. Fuhr, "Probabilistic Models in Information Retrieval," The Computer Journal, vol.35, no.3, 1992.
18. G. W. Furnas, S. Deerwester, S. T. Dumais, T. K. Landauer, R. A. Harshman, L. A. Streeter, and K. E. Lochbaum, "Information retrieval using a singular value decomposition model of latent semantic structure," in Proceedings of the 11th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 465-480, ACM, 1988.
19. S. P. Harter, "A probabilistic approach to automatic keyword indexing (parts 1 and 2)," Journal of the American Society for Information Science, vol.26, pp. 197-206 and 280-289, 1975.
20. D. Hiemstra, S. E. Robertson, and H. Zaragoza, "Parsimonious language models for information retrieval," in Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 178-185, ACM, 2004.
21. T. Hofmann, "Probabilistic latent semantic indexing," in Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 50-57, ACM, 1999.
22. Indri. HomePage. http://www.lemurproject.org/indri.
23. T. Joachims, H. Li, T. Y. Liu, and C. Zhai, "Learning to rank for information retrieval (LR4IR 2007)," SIGIR Forum, vol.41, no.2, pp. 58-62, 2007.
24. J. Lafferty and C. Zhai, "Document language models, query models, and risk minimization for information retrieval," in Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, 2001.
25. J. Lafferty and C. Zhai, "Probabilistic relevance models based on document and query generation," in Language Modelling for Information Retrieval, (W. B. Croft and J. Lafferty, eds.), pp. 1-10, Kluwer, 2003.
26. V. Lavrenko and W. B. Croft, "Relevance based language models," in Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 120-127, ACM, 2001.
27. Lemur Toolkit. HomePage. http://www.lemurproject.org.
28. H. Li, T. Y. Liu, and C. Zhai, "Learning to rank for information retrieval (LR4IR 2008)," SIGIR Forum, vol.42, no.2, pp. 76-79, 2008.
29. Lucene. HomePage. http://lucene.apache.org/.
30. M. E. Maron and J. L. Kuhns, "On relevance, probabilistic indexing and information retrieval," Journal of the ACM, vol.7, no.3, pp. 216-244, 1960.
31. D. Metzler, "Automatic feature selection in the Markov random field model for information retrieval," in Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, pp. 253-262, ACM New York, NY, USA, 2007.
32. D. Metzler and W. B. Croft, "A Markov random field model for term dependencies," in Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 472-479, ACM, 2005.
33. D. Metzler, T. Strohman, and B. Croft, Information Retrieval in Practice. Pearson Education (US), 2009.
34. MG4J: Managing gigabytes for java. HomePage. http://mg4j.dsi.unimi.it/.
35. Okapi-Pack. HomePage. http://www.soi.city.ac.uk/andym/OKAPI-PACK.
36. J. R. Ṕerez-Agüera and H. Zaragoza, "UCM-Y!R at CLEF 2008 Robust and WSD tasks," CLEF 2008 Workshop, 2008.
37. J. R. Ṕerez-Agüera, H. Zaragoza, and L. Araujo, "Exploiting morphological query structure using genetic optimization," in NLDB 2008 13th International Conference on Applications of Natural Language to Information Systems, Lecture Notes in Computer Science (LNCS), Springer Verlag, 2008.
38. J. Ṕerez-Iglesias, "BM25 and BM25F Implementation for Lucene," WebPage, http://nlp.uned.es/~jperezi/Lucene-BM25.
39. PF-Tijah. HomePage. http://dbappl.cs.utwente.nl/pftijah.
40. S. E. Robertson, "The probability ranking principle in information retrieval," Journal of Documentation, vol.33, pp. 294-304, 1977.
41. S. E. Robertson, "On term selection for query expansion," Journal of Documentation, vol.46, pp. 359-364, 1990.
42. S. E. Robertson, "Threshold setting and performance optimization in adaptive filtering," Information Retrieval, vol.5, pp. 239-256, 2002.
43. S. E. Robertson, M. E. Maron, and W. S. Cooper, "The unified probabilistic model for IR," in Proceedings of Research and Development in Information Retrieval, (G. Salton and H.-J. Schneider, eds.), pp. 108-117, Berlin: SpringerVerlag, 1983.
44. S. E. Robertson and K. Sparck Jones, "Relevance weighting of search terms," Journal of the American Society for Information Science, 1977.
45. S. E. Robertson, C. J. van Rijsbergen, and M. F. Porter, "Probabilistic models of indexing and searching," in Information Retrieval Research (Proceedings of Research and Development in Information Retrieval, Cambridge, 1980), (R. N. Oddy, S. E. Robertson, C. J. van Rijsbergen, and P. W. Williams, eds.), pp. 35-56, London: Butterworths, 1981.
46. S. E. Robertson and S. Walker, "Some Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval," in Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 232-241, ACM/Springer, 1994.
47. S. E. Robertson and S. Walker, "On relevance weights with little relevance information," in Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 16-24, ACM, 2007.
48. S. E. Robertson, S. Walker, M. Hancock-Beaulieu, A. Gull, and M. Lau, "Okapi at TREC," in The First Text Retrieval Conference (TREC-1), NIST Special Publication 500-207, pp. 21-30, 1992.
49. S. E. Robertson and H. Zaragoza, "On rank-based effectiveness measures and optimization," Information Retrieval, vol.10, no.3, pp. 321-339, 2007.
50. S. E. Robertson, H. Zaragoza, and M. Taylor, "Simple BM25 extension to multiple weighted fields," in Proceedings of the 2004 ACM CIKM International Conference on Information and Knowledge Management, pp. 42-49, ACM, 2004.
51. R. Song, M. J. Taylor, J. R. Wen, H. W. Hon, and Y. Yu, "Viewing term proximity from a different perspective," Advances in Information Retrieval (ECIR 2008), Springer LNCS 4956, pp. 346-357, 2008.
52. K. Sparck Jones, S. Walker, and S. E. Robertson, "A probabilistic model of information retrieval: Development and comparative experiments. Part 1," in Information Processing and Management, pp. 779-808, 2000. (Pubitemid 30934190)
53. K. Sparck Jones, S. Walker, and S. E. Robertson, "A probabilistic model of information retrieval: Development and comparative experiments. Part 2," in Information Processing and Management, pp. 809-840, 2000. (Pubitemid 30934191)
54. T. Tao and C. Zhai, "An exploration of proximity measures in information retrieval," in Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 295-302, ACM, 2007.
55. M. Taylor, H. Zaragoza, N. Craswell, S. E. Robertson, and C. Burges, "Optimisation methods for ranking functions with multiple parameters," in Fifteenth Conference on Information and Knowledge Management (ACM CIKM), 2006.
56. Terrier. HomePage. http://ir.dcs.gla.ac.uk/terrier.
57. R. van Os D. Hiemstra, H. Rode, and J. Flokstra, "PF/Tijah: Text search in an XML database system," Proceedings of the 2nd International Workshop on Open Source Information Retrieval (OSIR), pp. 12-17, http://dbappl.cs.utwente.nl/pftijah, 2006.
58. C. J. van Rijsbergen, Information Retrieval. Butterworth, 1979.
59. E. M. Voorhees and D. K. Harman, "Overview of the eighth text retrieval conference (TREC-8)," The Eighth Text Retrieval Conference (TREC-8), NIST Special Publication 500-246, pp. 1-24, 2000.
60. Wumpus. HomePage. http://www.wumpus-search.org/.
61. Xapian. http://xapian.org.
62. H. Zaragoza, N. Craswell, M. Taylor, S. Saria, and S. E. Robertson, "Microsoft Cambridge at TREC 2004: Web and HARD track," in The Thirteenth Text Retrieval Conference (TREC 2004), NIST Special Publication, 500-1261, 2005.
63. Zettair. HomePage. http://www.seg.rmit.edu.au/zettair.