PageRank without hyperlinks: Structural reranking using links induced by language models

ACM Transactions on Information Systems

Volumn 28, Issue 4, 2010, Pages

  Technion, Oren Kurland ^a   Lee, Lillian ^a  

^a Department of Obstetrics Gynecology   (United States)

Author keywords

Authorities; Graph based retrieval; High accuracy retrieval; HITS; Hubs; Language modeling; PageRank; Social networks; Structural reranking

Indexed keywords

AUTHORITIES; GRAPH-BASED; HIGH-ACCURACY RETRIEVAL; HITS; HUBS; LANGUAGE MODELING; PAGERANK; RE-RANKING; SOCIAL NETWORKS;

COMPUTATIONAL LINGUISTICS; HYPERTEXT SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; STATE FEEDBACK; USER INTERFACES; VECTOR SPACES; WORLD WIDE WEB;

INFORMATION RETRIEVAL;

EID: 80051496466     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1852102.1852104     Document Type: Article

References (100)

1. ABDUL-JALEEL, N., ALLAN, J., CROFT, W. B., DIAZ, F., LARKEY, L., LI, X., SMUCKER, M. D., AND WADE, C. 2004. UMASS at TREC 2004-novelty and hard. In Proceedings of the 13th Text Retrieval Conference (TREC-13). 715-725.
2. AMATI, G., CARPINETO, C., AND ROMANO, G. 2004. Query difficulty, robustness, and selective application of query expansion. In Proceedings of European Conference on IR Research (ECIR). 127-137.
3. AZZOPARDI, L., GIROLAMI, M., AND VAN RIJSBERGEN, K. 2003. Investigating the relationship between language model preplexity and IR precision-recall measures. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 369-370. Poster.
4. BALIŃSKI, J. AND DANILOWICZ, C. 2005. Re-ranking method based on inter-document distances. Inform. Process. Manag. 41, 4, 759-775. (Pubitemid 40049175)
5. BARZILAY, R. AND LAPATA, M. 2005. Collective content selection for concept-to-text generation. In Proceedings of the Human Language Technology/Empirical Methods in Natural Language Processing Conference (HLT/EMNLP). 331-338.
6. BENDERSKY, M. AND KURLAND, O. 2008. Utilizing passage-based language models for document retrieval. In Proceedings of European Conference on IR Research (ECIR). 162-174. (Pubitemid 351499067)
7. BRIN, S. AND PAGE, L. 1998. The anatomy of a large-scale hypertextual Web search engine. In Proceedings of the 7th International World Wide Web Conference. 107-117.
8. BUCKLEY, C., SALTON, G., ALLAN, J., AND SINGHAL, A. 1994. Automatic query expansion using SMART: TREC3. In Proceedings of the 3rd Text Retrieval Conference (TREC-3). 69-80.
9. CALLAN, J. P. 1994. Passage-level evidence in document retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 302-310.
10. COLLINS-THOMPSON, K. AND CALLAN, J. 2005. Query expansion using random walk models. In Proceedings of the 14th International Conference on Information and Knowledge Management (CIKM). 704-711. (Pubitemid 44022248)
11. COLLINS-THOMPSON, K. AND CALLAN, J. 2007. Estimation and use of uncertainty in pseudorelevance feedback. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 303-310. (Pubitemid 350164974)
12. CONNELL, M., FENG, A., KUMARAN, G., RAGHAVAN, H., SHAH, C., AND ALLAN, J. 2004. UMass at TDT. TDT2004 System Description.
13. CROFT, W. B. 1980. A model of cluster searching based on classification. Inform. Syst. 5, 189-195. (Pubitemid 11473495)
14. CROFT, W. B. AND LAFFERTY, J., Eds. 2003. Language Modeling for Information Retrieval. Number 13 in Information Retrieval Book Series. Kluwer.
15. CRONEN-TOWNSEND, S., ZHOU, Y., AND CROFT, W. B. 2002. Predicting query performance. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 299-306.
16. CRONEN-TOWNSEND, S., ZHOU, Y., AND CROFT, W. B. 2004. A language modeling framework for selective query expansion. Tech. rep. IR-338, Center for Intelligent Information Retrieval, University of Massachusetts.
17. DANILOWICZ, C. AND BALIŃSKI, J. 2000. Document ranking based upon Markov chains. Inform. Proc. Manag. 41, 4, 759-775.
18. DHILLON, I. 2001. Co-clustering documents and words using bipartite spectral graph partitioning. In Proceedings of the 17th ACM Special Interest Group on Knowledge Discovery and Data Mining (SIGKDD) Conference. 269-274.
19. DIAZ, F. 2005. Regularizing ad hoc retrieval scores. In Proceedings of the 14th International Conference on Information and Knowledge Management (CIKM). 672-679. (Pubitemid 44022244)
20. DIAZ, F. AND METZLER, D. 2006. Improving the estimation of relevance models using large external corpora. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 154-161.
21. ERKAN, G. 2006a. Language model based document clustering using random walks. In Proceedings of the Human Language Technology/North American Chapter of the Association for Computational Linguistics (HLT/NAACL).
22. ERKAN, G. 2006b. Using biased random walks for focused summarization. In Proceedings of Document Understanding Conference (DUC).
23. ERKAN, G. AND RADEV, D. R. 2004. LexRank: Graph-based lexical centrality as salience in text summarization. J. Artif. Intell. Res. 22, 457-479. (Pubitemid 41525893)
24. GARFIELD, E. 1972. Citation analysis as a tool in journal evaluation. Science 178, 471-479.
25. GOLUB, G. H. AND VAN LOAN, C. F. 1996. Matrix Computations, Third ed. The Johns Hopkins University Press.
26. GRASSMANN, W. K., TAKSAR, M. I., AND HEYMAN, D. P. 1985. Regenerative analysis and steady state distributions for Markov chains. Oper. Res. 33, 5, 1107-1116.
27. GRIMMETT, G. R. AND STIRZAKER, D. R. 2001. Probability and Random Processes, Third ed. Oxford Science Publications.
28. HATZIVASSILOGLOU, V. AND MCKEOWN, K. 1997. Predicting the semantic orientation of adjectives. In Proceedings of the 35th Association for Computational Linguistics (ACL)/8th European Association for Computational Linguistics (EACL). 174-181.
29. HEARST, M. A. AND PEDERSEN, J. O. 1996. Reexamining the cluster hypothesis: Scatter/Gather on retrieval results. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 76-84.
30. HIEMSTRA, D. AND KRAAIJ, W. 1999. Twenty-One at TREC7: Ad hoc and cross-language track. In Proceedings of the 7th Text Retrieval Conference (TREC-7). 227-238.
31. HU, X., BANDHAKAVI, S., AND ZHAI, C. 2003. Error analysis of difficult TREC topics. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 407-408. Poster.
32. JARDINE, N. AND VAN RIJSBERGEN, C. J. 1971. The use of hierarchic clustering in information retrieval. Inform. Storage Retrieval 7, 5, 217-240.
33. JEFFREYS, H. 1946. An invariant form for the prior probability in estimation problems. Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences 186, 1007, (Sept.) 453-461.
34. JOACHIMS, T. 2003. Transductive learning via spectral graph partitioning. In Proceedings of the International Conference on Machine Learning (ICML). 290-297.
35. KLEINBERG, J. 1997. Authoritative sources in a hyperlinked environment. Tech. rep. Research Report RJ 10076, IBM. May.
36. KLEINBERG, J. 1999. Authoritative sources in a hyperlinked environment. J. ACM 46, 604-632.
37. KRAAIJ, W. AND WESTERVELD, T. 2001. TNO-UT at TREC9: How different are Web documents? In Proceedings of the 9th Text Retrieval Conference (TREC-9). 665-671.
38. KRAAIJ, W., WESTERVELD, T., AND HIEMSTRA, D. 2002. The importance of prior probabilities for entry page search. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 27-34.
39. KURLAND, O. 2006. Inter-document similarities, language models, and ad hoc retrieval. Ph. D. thesis, Cornell University.
40. KURLAND, O. AND LEE, L. 2004. Corpus structure, language models, and ad hoc information retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 194-201.
41. KURLAND, O. AND LEE, L. 2005. PageRank without hyperlinks: Structural re-ranking using links induced by language models. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 306-313.
42. KURLAND, O. AND LEE, L. 2006. Respect my authority! HITS without hyperlinks utilizing clusterbased language models. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 83-90.
43. KURLAND, O., LEE, L., AND DOMSHLAK, C. 2005. Better than the real thing? Iterative pseudo-query processing using cluster-based language models. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 19-26.
44. LAFFERTY, J. D. AND ZHAI, C. 2001. Document language models, query models, and risk minimization for information retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 111-119. (Pubitemid 32951063)
45. LAVRENKO, V. 2004. A generative theory of relevance. Ph. D. thesis, University of Massachusetts Amherst.
46. LAVRENKO, V., ALLAN, J., DEGUZMAN, E., LAFLAMME, D., POLLARD, V., AND THOMAS, S. 2002. Relevance models for topic detection and tracking. In Proceedings of the Human Language Technology Conference (HLT). 104-110.
47. LAVRENKO, V. AND CROFT, W. B. 2001. Relevance-based language models. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 120-127. (Pubitemid 32951064)
48. LAVRENKO, V. AND CROFT, W. B. 2003. Relevance models in information retrieval. In W. B. Croft and J. Lafferty (Eds)., Language Modeling for Information Retrieval, Number 13 in Information Retrieval BookSeries, Kluwer. 11-56.
49. LEE, K.-S., CROFT, W. B., AND ALLAN, J. 2008. A cluster-based resampling method for pseudorelevance feedback. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 235-242.
50. LEUSKI, A. 2001. Evaluating document clustering for interactive information retrieval. In Proceedings of the 10th International Conference on Information and Knowledge Management (CIKM). 33-40. (Pubitemid 34974611)
51. LEUSKI, A. AND ALLAN, J. 1998. Evaluating a visual navigation system for a digital library. In Proceedings of the 2nd European Conference on Research and Advanced Technology for Digital Libraries (ECDL). 535-554. (Pubitemid 128145545)
52. LI, X. AND CROFT, W. B. 2003. Time-based language models. In Proceedings of the 12th International Conference on Information and Knowledge Management (CIKM). 469-475. (Pubitemid 40673576)
53. LIU, X. AND CROFT, W. B. 2002. Passage retrieval based on language models. In Proceedings of the 11th International Conference on Information and Knowledge Management (CIKM). 375-382.
54. LIU, X. AND CROFT, W. B. 2004. Cluster-based retrieval using language models. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 186-193.
55. LIU, X. AND CROFT, W. B. 2006a. Experiments on retrieval of optimal clusters. Tech. Rep. IR-478, Center for Intelligent Information Retrieval (CIIR), University of Massachusetts.
56. LIU, X. AND CROFT, W. B. 2006b. Representing clusters for retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 671-672. Poster.
57. METZLER, D. AND CROFT, W. B. 2005. A Markov random field model for term dependencies. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 472-479.
58. METZLER, D., DIAZ, F., STROHMAN, T., AND CROFT, W. B. 2005. Using mixtures of relevance models for query expansion. In Proceedings of the 14th Text Retrieval Conference (TREC).
59. MIHALCEA, R. 2004. Graph-based ranking algorithms for sentence extraction, applied to text summarization. In The Companion Volume to the Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics. 170-173.
60. MIHALCEA, R. AND TARAU, P. 2004. TextRank: Bringing order into texts. In Proceedings of the Empirical Methods of Natural Language Processing (EMNLP). 404-411. Poster.
61. MILLER, D. R. H., LEEK, T., AND SCHWARTZ, R. M. 1999. A hidden Markov model information retrieval system. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 214-221.
62. MITRA, M., SINGHAL, A., AND BUCKLEY, C. 1998. Improving automatic query expansion. In Proceedings of Special Interest Group on Information Retrieval (SIGIR). 206-214.
63. MORGAN, W., GREIFF, W., AND HENDERSON, J. 2004. Direct maximization of average precision by hillclimbing, with a comparison to a maximum entropy approach. Tech. rep. 04-0367, The MITRE Corporation.
64. NG, A. Y., ZHENG, A. X., AND JORDAN, M. I. 2001. Stable algorithms for link analysis. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 258-266. (Pubitemid 32951079)
65. NG, K. 2000. A maximum likelihood ratio information retrieval model. In Proceedings of the 8th Text Retrieval Conference (TREC-8). 483-492.
66. OTTERBACHER, J., ERKAN, G., AND RADEV, D. R. 2005. Using random walks for question-focused sentence retrieval. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP). 915-922.
67. PANG, B. AND LEE, L. 2004. A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In Proceedings of the Association for Computational Linguistics (ACL). 271-278.
68. PINSKI, G. AND NARIN, F. 1976. Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics. Inform. Proc. Manag. 12, 297-312.
69. PONTE, J. M. AND CROFT, W. B. 1998. A language modeling approach to information retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 275-281.
70. PORTER, M. F. 1980. An algorithm for suffix stripping. Program 14, 3, 130-137.
71. PREECE, S. E. 1973. Clustering as an output option. In Proceedings of the American Society for Information Science. 189-190.
72. ROCCHIO, J. J. 1971. Relevance feedback in information retrieval. In The SMART Retrieval System: Experiments in Automatic Document Processing, G. Salton, Ed. Prentice Hall, 313-323.
73. RUTHVEN, I. AND LALMAS, M. 2003. A survey on the use of relevance feedback for information access systems. Knowl. Eng. Rev. 18, 2, 95-145.
74. SALTON, G. AND BUCKLEY, C. 1988. On the use of spreading activation methods in automatic information retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 147-160.
75. SALTON, J., WONG, A., AND YANG, C. S. 1975. A vector space model for automatic indexing. Commun. ACM 18, 11, 613-620.
76. SHAH, C. AND CROFT, W. B. 2004. Evaluating high accuracy retrieval techniques. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 2-9.
77. SINGHAL, A., BUCKLEY, C., AND MITRA, M. 1996. Pivoted document length normalization. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 21-29.
78. STEWART, W. J. 1994. Introduction to the Numerical Solution of Markov chains. Princeton University Press.
79. TAO, T. AND ZHAI, C. 2006. Regularized esitmation of mixture models for robust pseudo-relevance feedback. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 162-169.
80. TISHBY, N. AND SLONIM, N. 2000. Data clustering by Markovian relaxation and the information bottleneck method. In Advances in Neural Information Processing Systems (NIPS) 14. 640-646.
81. TOMBROS, A. 2002. The effectiveness of hierarchic query-based clustering of documents for information retrieval. Ph. D. thesis, Department of Computing Science, University of Glasgow.
82. TOMBROS, A., VILLA, R., AND VAN RIJSBERGEN, C. 2002. The effectiveness of query-specific hierarchic clustering in information retrieval. Inform. Proc. Manag. 38, 4, 559-582. (Pubitemid 34232116)
83. TOUTANOVA, K., MANNING, C. D., AND NG, A. Y. 2004. Learning random walk models for inducing word dependency distributions. In Proceedings of the International Conference on Machine Learning (TCML).
84. VAN RIJSBERGEN, C. J. 1979. Information Retrieval, second ed. Butterworths.
85. VOORHEES, E. M. 1985. The cluster hypothesis revisited. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 188-196.
86. VOORHEES, E. M. 1993. Using WordNet to disambiguate word senses for text retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 171-180.
87. VOORHEES, E. M. 2002. Overview of the TREC 2002 question answering track. In The 11th Text Retrieval Conference (TREC-11). 115-123.
88. VOORHEES, E. M. 2005. Overview of the TREC 2005 robust retrieval task. In Proceedings of the 14th Text Retrieval Conference (TREC).
89. VOORHEES, E. M. AND HARMAN, D. K. 2005. TREC: Experiments and Evaluation in Information Retrieval. The MIT Press.
90. WILLETT, P. 1985. Query specific automatic document classification. International Forum on Information and Documentation 10, 2, 28-32.
91. WINAVER, M., KURLAND, O., AND DOMSHLAK, C. 2007. Towards robust query expansion: Model selection in the language model framework to retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 729-730. (Pubitemid 350165041)
92. XU, J. AND CROFT, W. B. 1996. Query expansion using local and global document analysis. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 4-11.
93. YOM-TOV, E., FINE, S., CARMEL, D., AND DARLOW, A. 2005. Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 512-519.
94. ZAMIR, O. AND ETZIONI, O. 1998. Web document clustering: a feasibility demonstration. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 46-54.
95. ZHAI, C. AND LAFFERTY, J. 2002. Two-stage language models for information retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 49-56.
96. ZHAI, C. AND LAFFERTY, J. D. 2001a. Model-based feedback in the language modeling approach to information retrieval. In Proceedings of the Conference on Information and Knowledge Management (CIKM). 403-410. (Pubitemid 34974657)
97. ZHAI, C. AND LAFFERTY, J. D. 2001b. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 334-342. (Pubitemid 32957519)
98. ZHANG, B., LI, H., LIU, Y., JI, L., XI, W., FAN, W., CHEN, Z., AND MA, W.-Y. 2005. Improving Web search results using affinity graph. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 504-511.
99. ZHOU, Y. AND CROFT, B. 2007. Query performance prediction in Web search environments. In Proceedings of the ACM Special Interest Group on Information Retrieval (SIGIR). 543-550. (Pubitemid 350165002)
100. ZHU, X. J. 2005. Semi-supervised learning with graphs. Ph. D. thesis, Carnegie Mellon University.