Probabilistic co-relevance for query-sensitive similarity measurement in information retrieval

Information Processing and Management

Volumn 49, Issue 2, 2013, Pages 558-575

  Na, Seung Hoon ^a  

^a Natural Language Processing Research Term   (South Korea)

Author keywords

Cluster hypothesis; Cluster based retrieval; Inter document similarity; Probabilistic co relevance; Query sensitive similarity

Indexed keywords

INFORMATION RETRIEVAL; VECTOR SPACES;

CLUSTER HYPOTHESIS; CLUSTER-BASED RETRIEVAL; DOCUMENT SIMILARITY; PROBABILISTIC CO-RELEVANCE; QUERY-SENSITIVE SIMILARITIES;

MODELING LANGUAGES;

EID: 84886428132     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2012.10.002     Document Type: Article

References (47)

1. Abdul-jaleel, N., Allan, J., Croft, W. B., Diaz, O., Larkey, L. & Li, X. (2004). Umass at trec 2004: Novelty and hard. In Proceedings of the 13th text retrieval conference, TREC '04.
2. Allan, J., Connell, M. E., Croft, W. B., Feng, F., Fisher, D. & Li X. (2000). Inquery and trec-9. In Proceedings of the 9th text retrieval conference, TREC '00.
3. Blanco, R. & Barreiro, A. (2008). Probabilistic document length priors for language models. In Proceedings of the IR research, 30th European conference on Advances in information retrieval, ECIR'08 (pp. 394-405). (Pubitemid 351499085)
4. Buckley, C., Salton, G., Allan, J. & Singhal, A. (1994). Automatic query expansion using smart. In Proceedings of the 3rd text retrieval conference, TREC-3.
5. Cartright, M.A., Allan, J., Lavrenko, V. & McGregor, A. (2010). Fast query expansion using approximations of relevance models. In Proceedings of the 19th ACM international conference on Information and knowledge management, CIKM '10 (pp. 1573-1576).
6. Croft, W. B. (1980). A model of cluster searching based on classification. Information Systems, 5, 189-195. (Pubitemid 11473495)
7. El-Hamdouchi, A. & Willett, P. (1986). Hierarchic document classification using ward's clustering method. In Proceedings of the 9th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '86 (pp. 149-156).
8. Fuhr, N., Lechtenfeld, M., Stein, B., & Gollub, T. (2011). The optimum clustering framework: Implementing the cluster hypothesis. Information Retrieval, 15(2), 93-115.
9. Goffman, W. (1968). An indirect method of information retrieval. Information Storage and Retrieval, 4, 361-373.
10. Griffiths, A., Robinson, L., & Willett, P. (1984). Hierarchic agglomerative clustering methods for automatic document classification. Journal of Documentation, 40(3), 175-205. (Pubitemid 15565578)
11. Hearst, M. A. & Pedersen, J. O. (1996). Reexamining the cluster hypothesis: Scatter/gather on retrieval results. In Proceedings of the 19th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '96 (pp. 76-84).
12. Hiemstra, D. (1998). A linguistically motivated probabilistic model of information retrieval. In Proceedings of the second European conference on research and advanced technology for digital libraries, ECDL '98 (pp. 569-584). (Pubitemid 128145547)
13. Hiemstra, D. (2001). Using language models for information retrieval. PhD thesis, University of Twente.
14. Jardine, N., & Rijsbergen, C. J. V. (1971). The use of hierarchic clustering in information retrieval. Information Storage and Retrieval, 7, 210-240.
15. Kurland, O. & Lee, L. (2004). Corpus structure, language models, and ad hoc information retrieval. In Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '04 (pp. 194-201).
16. Kurland, O. & Lee, L. (2005). Pagerank without hyperlinks: Structural re-ranking using links induced by language models. In Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '05 (pp. 306-313).
17. Lafferty, J. & Zhai, C. (2001). Document language models, query models, and risk minimization for information retrieval. In Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '01 (pp. 111-119). (Pubitemid 32951063)
18. Lafferty, J., & Zhai, C. (2003). Probabilistic relevance models based on document and query generation. Kluwer International Series on Information Retrieval - Language Modeling and Information Retrieval, 13, 258.
19. Lavrenko, V. (2010). A generative theory of relevance. Incorporated: Springer Publishing Company.
20. Lavrenko, V. & Croft, W. B. (2001). Relevance based language models. In Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '01 (pp. 120-127).
21. Lavrenko, V., Allan, J., DeGuzman, E., Daniel, L., Pollard, V. & Thomas, S. (2002). Relevance models for topic detection and tracking. In Proceedings of the second international conference on human language technology research, HLT '02 (pp. 115-121).
22. Liu, X. & Croft, W. B. (2004). Cluster-based retrieval using language models. In Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '04 (pp. 186-193).
23. Losada, D. E. & Azzopardi, L. (2008). An analysis on document length retrieval trends in language modeling smoothing. Information Retrieval, 11.
24. Lv, Y. & Zhai, C. (2009). A comparative study of methods for estimating query language models with pseudo feedback. In Proceeding of the 18th ACM conference on information and knowledge management, CIKM '09 (pp. 1895-1898).
25. Miller, D. R. H., Leek, T. & Schwartz, R. M. (1999). A hidden markov model information retrieval system. In Proceedings of the 22nd annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '99 (pp 214-221).
26. Na, S. H., Kang, I. S., Roh, J. E., & Lee, J. H. (2007). An empirical study of query expansion and cluster-based retrieval in language modeling approach. Information Processing and Management, 43(2), 302-314.
27. Ponte, J. M. & Croft, W. B. (1998). A language modeling approach to information retrieval. In Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '98 (pp. 275-281).
28. Rijsbergen, C. J. V. (1979). Information retrieval. Butterworths.
29. Rijsbergen, C. J. V., & Croft, W. B. (1975). Document clustering: An evaluation of some experiments with the cranfield 1400 collection. Information Processing and Management, 171-182.
30. Robertson, S. E. (1977). The probabilistic ranking principle in IR. Journal of Documentation, 33, 294-304.
31. Robertson, S. E. & Walker, S. (1994). Some simple effective approximations to the 2-poisson model for probabilistic weighted retrieval. In Proceedings of the 17th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '94 (pp. 232-241).
32. Robertson, S. E., & Jones, K. S. (1976). Relevance weighting of search terms. Journal of the American Society for Information Science, 27(3), 129-146.
33. Roelleke, T. & Wang, J. (2006). A parallel derivation of probabilistic information retrieval models. In Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '06 (pp. 107-114).
34. Salton, G., Wong, A., & Yang, C. S. (1975). A vector space model for automatic indexing. Communications of ACM, 18(11), 613-620.
35. Singhal, A. (2001). Modern information retrieval: A brief overview. IEEE Data Engineering Bulletin, 24(4), 35-43.
36. Singhal, A., Buckley, C. & Mitra, M. (1996). Pivoted document length normalization. In Proceedings of the 19th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '96 (pp. 21-29).
37. Smucker, M.D. & Allan, J. (2005). An investigation of dirichlet prior smoothings performance advantage. Tech. rep., CIIR Technical Report IR-548. University of Massachusetts, Amherst.
38. Smucker, M. D. & Allan, J. (2009). A new measure of the cluster hypothesis. In Proceedings of the 2nd international conference on theory of information retrieval: advances in information retrieval theory, ICTIR '09 (pp. 281-288).
39. Tao, T., Wang, X., Mei, Q. & Zhai, C. (2006). Language model information retrieval with document expansion. In HLT-NAACL '06 (pp. 407-414).
40. Tombros, A. & Rijsbergen, C. J. V. (2001). Query-sensitive similarity measures for the calculation of interdocument relationships. In Proceedings of the tenth international conference on Information and knowledge management, CIKM '01 (pp. 17-24). (Pubitemid 34974609)
41. Tombros, A., & Rijsbergen, C. J. V. (2004). Query-sensitive similarity measures for information retrieval. Knowledge and Information Systems, 6, 617-642.
42. Tombros, A., Villa, R., & Rijsbergen, C. J. V. (2002). The effectiveness of query-specific hierarchic clustering in information retrieval. Information Processing and Management, 38, 559-582. (Pubitemid 34232116)
43. Voorhees, E. M. (1985). The cluster hypothesis revisited. In Proceedings of the 8th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '85 (pp. 188-196).
44. Wei, F., Li, W., Lu, Q. & He, Y. (2008). Query-sensitive mutual reinforcement chain and its application in query-oriented multi-document summarization. In Proceedings of the 31st annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '08 (pp. 283-290).
45. Willett, P. (1985). Query specific automatic document classification. International Forum on Information and Documentation, 10(2), 28-32.
46. Zhai, C. & Lafferty, J. (2001). A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR '01 (pp. 334-342). (Pubitemid 32957519)
47. Zhou, Z. H. & Dai, H. B. (2006). Query-sensitive similarity measure for content-based image retrieval. In Proceedings of the sixth international conference on data mining, ICDM '06 (pp. 1211-1215).