DirichletRank: Solving the zero-one gap problem of PageRank

ACM Transactions on Information Systems

Volumn 26, Issue 2, 2008, Pages

  Wang, Xuanhui ^a,c   Tao, Tao ^a,d   Sun, Jian Tao ^b   Shakery, Azadeh ^a,c   Zhai, Chengxiang ^a,c  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b MICROSOFT RESEARCH ASIA   (China)

^c University of Illinois at Urbana Champaign   (United States)

^d MICROSOFT   (United States)

Author keywords

DirichletRank; Link analysis; PageRank; Spamming; Zero one gap

Indexed keywords

DIRICHLETRANK; LINK ANALYSIS; PAGERANK; ZERO-ONE GAP;

PERTURBATION TECHNIQUES; PROBABILITY; PROBLEM SOLVING; SEARCH ENGINES; SPAMMING; WEB SERVICES;

INFORMATION SYSTEMS;

EID: 42049114210     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1344411.1344416     Document Type: Article

References (45)

1. BAEZA-YATES, R. A., BOLDI, P., AND CASTILLO, C. 2006. Generalizing PageRank: Damping functions for link-based ranking algorithms. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 308-315.
2. BECCHETTI, L., CASTILLO, C., DONATO, D., LEONARDI, S., AND BAEZA-YATES, R. 2006. Link-Based characterization and detection of Web spam. In 2nd International Workshop on Adversarial Information Retrieval on the Web.
3. BENCZUR, A., CSALOGANY, K., SARLOS, T., AND UHER, M. 2005. SpamRank-Fully automatic link spam detection. In 1st International Workshop on Adversarial Information Retrieval on the Web.
4. BERKHIN, P. 2005. A survey on PageRank computing. Internet Math. 1, 3, 335-380.
5. BHARAT, K. AND HENZINGER, M. R. 1998. Improved algorithms for topic distillation in a hyperlinked environment. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 104-111.
6. BIANCHINI, M., GORI, M., AND SCARSELLI, F. 2005. Inside PageRank. ACM Trans. Internet Technol. B, 1, 92-128.
7. BOLDI, P., SANTINI, M., AND VIGNA, S. 2005. PageRank as a function of the damping factor. In Proceedings of the International World Wide Web Conference (WWW), 557-566.
8. BORODIN, A., ROBERTS, G. O., ROSENTHAL, J. S., AND TSAPARAS, P. 2005. Link analysis ranking: Algorithms, theory, and experiments. ACM Trans. Internet Technol. 5, 1, 231-297.
9. BORODIN, A., ROBERTS, G. O., ROSENTHAL, J. S., AND TSAPARAS, P. 2001. Finding authorities and hubs from link structures on the World Wide Web. In Proceedings of the International World Wide Web Conference (WWW), 415-429.
10. BRIN, S. AND PAGE, L. 1998. The anatomy of a large-scale hypertextual Web search engine. Comput. Netw. 30, 1-7, 107-117.
11. CAI, D., HE, X., WEN, J.-R., AND MA, W.-Y. 2004. Block-Level link analysis. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 440-447.
12. CHAKRABARTI, S., DOM, B., GIBSON, D., KLEINBERG, J., RAGHAVAN, P., AND RAJAGOPALAN, S. 1998. Automatic resource list compilation by analyzing hyperlink structure and associated text. In Proceedings of the International World Wide Web Conference (WWW), 65-74.
13. COHN, D. AND CHANG, H. 2000. Learning to probabilistically identify authoritative documents. In Proceedings of the International Conference on Machine Learning (ICML), 167-174.
14. COOPER, G. F. AND HERSKOVITS, E. 1992. A Bayesian method for the induction of probabilistic networks from data. Mach. Learn. 9, 309-347.
15. CRASWELL, N. AND HAWKING, D. 2003. Overview of the TREC 2003 Web track. In Proceedings of the 12th Text Retrieval Conference (TREC), 78-92.
16. DILIGENTI, M., GORI, M., AND MAGGINI, M. 2002. Web page scoring systems for horizontal and vertical search. In Proceedings of the International World Wide Web Conference (WWW). 508-516.
17. DING, C. H. Q., HE, X., HUSBANDS, P., ZHA, H., AND SIMON, H. D. 2002. PageRank: HITS and a unified framework for link analysis. Tech. Rep. 49372 LBNL.
18. EIRON, N., MCCURLEY, K. S., AND TOMLIN, J. A. 2004. Ranking the Web frontier. In Proceedings of the International World Wide Web Conference (WWW), 309-318.
19. FETTERLY, D., MANASSE, M., AND NAJORK, M. 2004. Spam, damn spam, and statistics: Using statistical analysis to locate spam Web pages. In Proceedings of the International Workshop on Web and Databases (WebDB), 1-6.
20. GOLUB, G. H. AND LOAN, C. F. V. 1996. Matrix Computations. Johns Hopkins University Press, Baltimore, MD.
21. GYONGYI, Z. AND GARCIA-MOLINA, H. 2005a. Link spam alliances. In Proceedings of the Very Large DataBase (VLDB), 517-528.
22. GYONGYI, Z. AND GARCIA-MOLINA, H. 2005b. Web spam taxonomy. In 1st International Workshop on Adversarial Information Retrieval on the Web.
23. GYONGYI, Z., GARCIA-MOLINA, H., AND PEDERSEN, J. 2004. Combating Web spam with TrustRank. In Proceedings of the International Conference on Very Large DataBase (VLDB), 576-587.
24. HAVELIWALA, T. H. 2002. Topic-Sensitive PageRank. In Proceedings of the International World Wide Web Conference (WWW), 517-526.
25. HAVELIWALA, T. H. AND KAMWAR, S. D. 2003. The second Eigenvalue of the Google matrix. Tech. Rep., Stanford University. March.
26. HECKERMAN, D., GEIGER, D., AND CHICKERING, D. M. 1995. Learning Bayesian networks: The combination of knowledge and statistical data. Mach. Learn. 20, 3, 197-243.
27. JEH, G. AND WIDOM, J. 2003. Scaling personalized Web search. In Proceedings of the International World Wide Web Conference (WWW), 271-279.
28. KAMVAR, S. D., HAVELIWALA, T. H., MANNING, C. D., AND GOLUB, G. H. 2003. Extrapolation methods for accelerating PageRank computations. In Proceedings of the International World Wide Web Conference (WWW), 261-270.
29. KLEINBERG, J. M. 1999. Authoritative sources in a hyperlinked environment. J. ACM 46, 5, 604-632.
30. LEMPEL, R. AND MORAN, S. 2005. Rank-Stability and rank-similarity of link-based Web ranking slgorithms in authority-connected graphs. Inf. Retriev. 8, 2, 245-264.
31. LI, L., SHANG, Y., AND ZHANG, W. 2002. Improvement of HITS-based algorithms on Web documents. In Proceedings of the International World Wide Web Conference (WWW), 527-535.
32. MCSHERRY, F. 2005. A uniform approach to accelerated PageRank computation. In Proceedings of the International World Wide Web Conference (WWW), 575-582.
33. MOTWANI, R. AND RAGHAVAN, P. 1995. Randomized Algorithms. Cambridge University Press, UK.
34. NG, A. Y., ZHENG, A. X., AND JORDAN, M. I. 2001. Stable algorithms for link analysis. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 258-266.
35. NTOULAS, A., NAJORK, M., MANASSE, M., AND FETTERLY, D. 2006. Detecting spam Web pages through content analysis. In Proceedings of the International World Wide Web Conference (WWW), 83-92.
36. PAGE, L., BRIN, S., MOTWANI, R., AND WINOGRAD, T. 1999. The PageRank citation ranking: Bringing order to the Web. Tech. Rep., Stanford University. November.
37. RICHARDSON, M. AND DOMINGOS, P. 2002. The intelligent surfer: Probabilistic combination of link and content information in PageRank. In Proceedings of the Conference on Advances Neural Information Proving Systems (NIPS), 1441-1448.
38. STECK, H. AND JAAKKOLA, T. 2002. On the Dirichlet prior and Bayesian regularization. In Proceedings of the Conference on Advances Neural Information Proving Systems (NIPS), 697-704.
39. WANG, X., SHAKERY, A., AND TAO, T. 2005. Dirichlet PageRank. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 661-662.
40. WU, B. AND DAVISON, B. D. 2005. Identifying link farm spam pages. In Proceedings of the International World Wide Web Conference (WWW) - Special Interest Tracks and Posters, 820-829.
41. WU, B., GOEL, V., AND DAVISON, B. D. 2006. Topical TrustRank: Using topicality to combat Web spam. In Proceedings of the International World Wide Web Conference (WWW), 63-72.
42. XUE, G.-R., YANG, Q., ZENG, H.-J., YU, Y., AND CHEN, Z. 2005. Exploiting the hierarchical structure for link analysis. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 186-193.
43. ZHAI, C. AND LAPPERTY, J. 2002. Two-Stage language models for information retrieval. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 49-56.
44. ZHAI, C. AND LAFFERTY, J. 2001. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 334-342.
45. ZHANG, H., GOEL, A., GOVINDAN, R., MASON, K., AND ROY, B. V. 2004. Improving Eigenvector-Based reputation systems against collusions. In Workshop on Algorithms and Models for the Web Graph.