Two-stage language models for information retrieval

SIGIR Forum (ACM Special Interest Group on Information Retrieval)

Volumn , Issue , 2002, Pages 49-56

  Zhai, ChengXiang ^a   Lafferty, John ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Dirichlet prior; Interpolation; Leave one out; Mixture model; Parameter estimation; Risk minimization; Two stage language models; Two stage smoothing

Indexed keywords

COMPUTATIONAL METHODS; DATABASE SYSTEMS; DECISION THEORY; INFORMATION RETRIEVAL; INTERPOLATION; MATHEMATICAL MODELS; PARAMETER ESTIMATION; STATISTICAL METHODS;

DIRICHLET PRIOR; LANGUAGE MODELS; SMOOTHING METHOD;

QUERY LANGUAGES;

EID: 0036989427     PISSN: 01635840     EISSN: None     Source Type: Journal    
DOI: 10.1145/564384.564387     Document Type: Conference Paper

References (17)

1. Berger, A. and Lafferty, J. (1999). Information retrieval as statistical translation. In Proceedings of the 1999 ACM SIGIR Conference on Research and Development in Information Retrieval, 222-229.
2. Hiemstra, D. and Kraaij, W. (1998). Twenty-one at TREC-7: Ad-hoc and cross-language track. In Proc. of Seventh Text Retrieval Conference (TREC-7).
3. Kwok, K. and Chan, M. (98). Improving two-stage ad-hoc retrieval for short queries. In Proceedings of SIGIR'98, pages 250-256.
4. Lafferty, J. and Zhai, C. (2001a). Document language models, query models, and risk minimization for information retrieval. In Proceedings of SIGIR'2001.
5. Lafferty, J. and Zhai, C. (2001b). Probabilistic IR models based on query and document generation. In Proceedings of the Language Modeling and IR workshop. Extended abstract.
6. Lavrenko, V. and Croft, B. (2001). Relevance-based language models. In Proceedings of SIGIR'2001.
7. Miller, D. H., Leek, T., and Schwartz, R. (1999). A hidden Markov model information retrieval system. In Proceedings of the 1999 ACM SIGIR Conference on Research and Development in Information Retrieval, pages 214-221.
8. Ney, H., Essen, U., and Kneser, R. (1995). On the estimation of 'small' probabilities by leaving-one-out. IEEE Transactions on Pattern Analysis and Machine Intelligence, (12) 1202-1212.
9. Ponte, J. and Croft, W. B. (1998). A language modeling approach to information retrieval. In Proceedings of the ACM SIGIR, pages 275-281.
10. Robertson, S. and Sparck Jones, K. (1976). Relevance weighting of search terms. Journal of the American Society for Information Science, 27: 129-146.
11. Robertson, S. E., Walker, S., Jones, S., M.Hancock-Beaulieu, M., and Gatford M. (1995). Okapi at TREC-3. In Harman, D. K., The Third Text Retrieval Conference (TREC-3).
12. Salton, G., Wong, A., and Yang, C. S. (1975a). A vector space model for automatic indexing. Communications of the ACM, (11): 613-620.
13. Salton, G. and Buckley, C. (1988). Term-weighting approaches in automatic text retrieval. Information Processing and Management, 24: 513-523.
14. Singhal, A., Buckley, C., and Mitra, M. (1996). Pivoted document length normalization. In Proceedings of the 1996 ACM SIGIR Conference on Research and Development in Information Retrieval, pages 21-29.
15. Voorhees, E. and Harman, D., editors (2001). Proceedings of Text Retrieval Conference (TREC1-9). NIST Special Publications. http://trec.nist.gov/pubs.html.
16. Zhai, C. and Lafferty, J. (2001a). Model-based feedback in the KL-divergence retrieval model. In Tenth International Conference on Information and Knowledge Management (CIKM 2001).
17. Zhai, C. and Lafferty, J. (2001b). A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of SIGIR'2001.