RankMass crawler: A crawler with high personalized PageRank coverage guarantee

33rd International Conference on Very Large Data Bases, VLDB 2007 - Conference Proceedings

Volumn , Issue , 2007, Pages 375-386

  Cho, Junghoo ^a   Schonfeld, Uri ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

OPTIMIZATION; SEARCH ENGINES;

ENGINE OPERATORS; PERSONALIZED PAGERANK; SIMPLE ALGORITHM; THEORETICAL GUARANTEES;

WEB CRAWLER;

EID: 85011105564     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Sqlite database engine. http://www.sqlite.org/.
2. S. Abiteboul, M. Preda, and G. Cobena. Adaptive on-line page importance computation. In Proc. 12th www, pages 280-290, 2003.
3. R. Baeza-Yates and C. Castillo. Crawling the infinite Web: five levels are enough. In Proc. 3rd WAW, Rome, Italy, October 2004. Springer LNCS.
4. R. Baeza-Yates, C. Castillo, M. Marin, and A. Rodriguez. Crawling a country: better strategies than breadth-first for web page ordering. In Proc. 14th www, pages 864-872. ACM Press New York, NY, USA, 2005.
5. Z. Bar-Yossef and M. Gurevich. Random sampling from a search engine's index. In Proc. 15th www, pages 367-376, 2006.
6. L. Becchetti and C. Castillo. The distribution of pagerank follows a power-law only for particular values of the damping factor. In Proc. 15th www, pages 941-942, 2006.
7. M. Bianchini, M. Gori, and F. Scarselli. Inside PageRank. ACM TOIT, 5(1):92-128, 2005.
8. S. Brin and L. Page. The Anatomy of a Large-Scale Hypertextual Web Search Engine. Proc. 7th www, 30(1-7):107-117, 1998.
9. M. Brinkmeier. PageRank revisited. ACM TOIT, 6(3):282-301, 2006.
10. S. Chakrabarti, M. van den Berg, and B. Dom. Focused Crawling: A New Approach for Topic-Specific Resource Discovery. In Proc. 8th WWW, 1999.
11. Soumen Chakrabarti, Kunal Punera, and Mallela Subramanyam. Accelerated focused crawling through online relevance feedback. In Proc. 11th www, pages 148-159, 2002.
12. J. Cho, H. Garcia-Molina, and L. Page. Efficient Crawling Through URL Ordering. Proc. 7th www, 30(1-7):161-172, 1998.
13. Junghoo Cho and Hector Garcia-Molina. Parallel crawlers. In Proc. 11th www, pages 124-135, 2002.
14. M. Diligenti, F. Coetzee, S. Lawrence, C.L. Giles, and M. Gori. Focused crawling using context graphs. In Proc. 26th VLDB, pages 527-534. September, 2000.
15. Martin Ester, Hans-Peter Kriegel, and Matthias Schubert. Accurate and efficient crawling for relevant websites. In Proc. 30th VLDB, pages 396-407, 2004.
16. Z. Gyongyi, H. Garcia-Molina, and J. Pedersen. Combating web spam with TrustRank. 2004.
17. Taher H. Haveliwala. Topic-sensitive pagerank. In Proc. 11th www, Honolulu, Hawaii, May 2002.
18. T.H. Haveliwala. Topic-sensitive pagerank: A context-sensitive ranking algorithm for web search. IEEE TKDE, 15(4):784-796, 2003.
19. M.R. Henzinger, A. Heydon, M. Mitzenmacher, and M. Najork. Measuring index quality using random walks on the Web. Proc. 8th www, 31(11-16):1291-1303, 1999.
20. G. Jeh and J. Widom. Scaling personalized web search. Technical report, Stanford University, 2002.
21. G. Jeh and J. Widom. Scaling personalized web search. In Proc. 12th www, pages 271-279, 2003.
22. S. D. Kamvar, T. H. Haveliwala, C. D. Manning, and G. H. Golub. Extrapolation methods for accelerating pagerank computations. In Proc. 12th www, pages 261-270, 2003.
23. A. N. Langville and C. D. Meyer. Deeper Inside PageRank. Internet Mathematics, 1(3):335-380, 2005.
24. M. Najork and J. L. Wiener. Breadth-first crawling yields high-quality pages. Proc. 10th www, pages 114-118, 2001.
25. S. Pandey and C. Olston. User-centric web crawling. In Proc. 14th www, pages 401-411, 2005.
26. J. X. Parreira, D. Donato, S. Michel, and G. Weikum. Efficient and decentralized pagerank approximation in a peer-to-peer web search network. In Proc. 32nd VLDB, pages 415-426, 2006.
27. S. Raghavan and H. Garcia-Molina. Crawling the Hidden Web. Proc. 27th VLDB, pages 129-138, 2001.
28. Y. Wang and D. J. DeWitt. Computing pagerank in a distributed internet search engine system. In Proc. 30th VLDB, pages 420-431, 2004.
29. J. L. Wolf, M. S. Squillante, P. S. Yu, J. Sethuraman, and L. Ozsen. Optimal crawling strategies for web search engines. In Proc. 11th www, pages 136-147, 2002.
30. B. Wu, V. Goel, and B. D. Davison. Topical trustrank: using topicality to combat web spam. In Proc. 15th www, pages 63-72, 2006.