A probabilistic justification for using tf × idf term weighting in information retrieval

International Journal on Digital Libraries

Volumn 3, Issue 2, 2000, Pages 131-139

  Hiemstra, Djoerd ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Information retrieval theory; Statistical information retrieval; Statistical natural language processing

Indexed keywords

EID: 0000600049     PISSN: 14325012     EISSN: 14321300     Source Type: Journal    
DOI: 10.1007/s007999900025     Document Type: Article

References (21)

1. Clarke, C.L.A., Cormack, G.V., Tudhope, E.A.: Relevance ranking for one to three term queries. In: Proc. RIAO '97, 1997, pp. 388-400
2. Cooper, W.S.: Some inconsistencies and misidentifled modeling assumptions in probabilistic information retrieval. ACM Trans. Information Systems 13:100-111, 1995
3. Croft, W.B., Turtle, H.R.: Text retrieval and inference. In: Jacobs, P. (ed.): Text-based Intelligent Systems. Lawrence Erl-baum, 1992, pp. 127-156
4. Hawking, D., Thistlewaite, P.: Relevance weighting using distance between term occurrences. Technical Report TR-CS-96-08, The Australian National University, 1996 http://cs.anu.edu.au/techreports
5. Hiemstra, D.: A linguistically motivated probabilistic model of information retrieval. In: Nicolaou, C, Stephanidis, C. (eds.): Proc. 2nd European Conference on Research and Advanced Technology for Digital Libraries (ECDL-2), 1998, pp. 569-584
6. Hiemstra, D., de Jong, F.M.G.: Cross-language retrieval in Twenty-One: using one, some or all possible translations? In: Proc. 14th Twente Workshop on Language Technology (TWLT-14), 1998, pp. 19-26
7. Hiemstra, D., Kraaij, W.: Twenty-One at TREC-7: Ad-hoc and cross-language track. In: Proc. 7th Text Retrieval Conference (TREC-7). NIST Special Publications, 1999
8. Manning, O, Schiitze, H. (eds.): Statistical Natural Language Processing: Theory and Practice (draft). 1998. http://www. sultry.arts.su.edu.au/manning/courses/statnlp
9. Miller, D.R.H., Leek, T., Schwartz, R.M.: BBN at TREC-7: using Hidden Markov Models for information retrieval. In: Proc. 7th Text Retrieval Conference, TREC-7. NIST Special Publications, 1999
10. Mood, A.M., Graybill, F.A. (eds.): Introduction to the Theory of Statistics. Second edition. McGraw-Hill, 1963
11. Ponte, J.M., Croft, W.B.: A language modeling approach to information retrieval. In: Proc. 21st ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98), 1998
12. Robertson, S.E., Sparck Jones, K.: Relevance weighting of search terms. J. American Society Information Science 27:129-146, 1976
13. Robertson, S.E., Walker, S.: Some simple effective approximations to the 2-poisson model for probabilistic weighted retrieval. In: Proc. 17th ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '94), 1994, pp.232-241
14. Rose, D.E., Stevens, O: V-twin: A lightweight engine for interactive use. In: Voorhees, E.M., Harman, D.K. (eds.): Proc. 5th Text Retrieval Conference TREC-5, NIST Special Publication 500-238, 1997, pp. 279-290
15. Salton, G, Buckley, O: Term-weighting approaches in automatic text retrieval. Information Processing & Management 24(5):513-523, 1988
16. Salton, G, McGill, M.J. (eds.): Introduction to Modern Information Retrieval. McGraw-Hill, 1983
17. Salton, G, Yang, OS.: On the specification of term values in automatic indexing. J. Documentation 29(4):351-372, 1973
18. Singhal, A., Salton, G, Mitra, M., Buckley, O: Document length normalization. Technical Report TR95-1529, Cornell University, 1995. http://cs-tr.cs.cornell.edu/
19. Strzalkowski, T., Sparck Jones, K.: NLP track at TREC-5. In: Voorhees, E.M., Harman, D.K. (eds): Proc. 5th Text Retrieval Conference TREC-5, NIST Special Publication 500-238, 1997, pp. 97-101
20. Voorhees, E.M., Harman, D.K.: Overview of the 6th text retrieval conference. In: Proc. 6th Text Retrieval Conference TREC-6, NIST Special Publication 500-240, 1998, pp. 1-24
21. Wilkinson, R., Zobel, J., Sacks-Davis, R.: Similarity measures for short queries. In: Harman, D.K. (ed.): Proc. 4th Text Retrieval Conference TREC-4, NIST Special Publication 500-236, 1996, pp. 277-286