On the peninsula phenomenon in web graph and its implications on web search

Computer Networks

Volumn 51, Issue 1, 2007, Pages 177-189

  Meng, Tao ^a   Yan, Hong Fei ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

Information coverage; Link extraction capability; Pagerank; Peninsula; Power law; Web graph; Web search

Indexed keywords

INFORMATION COVERAGE; LINK EXTRACTION CAPABILITY; PAGERANK VALUES; PENINSULA PHENOMENON; POWER LAW; WEB GRAPH; WEB SEARCH;

DATA ACQUISITION; GRAPH THEORY; SEARCH ENGINES; TELECOMMUNICATION LINKS; WEBSITES; WORLD WIDE WEB;

COMPUTER NETWORKS;

EID: 33749612582     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comnet.2006.04.016     Document Type: Article

References (24)

1. Andrei Broder, Ravi Kumar, Farzin Maghoul, Prabhakar Raghavan, Sridhar Rajagopalan, Raymie Stata, Andrew Tomkins, Janet Wiener, Graph structure in the web: experiments and models, in: Proceedings of the 9th WWW Conference, 2000.
2. Arvind Arasu, Jasmine Novak, Andrew S. Tomkins, John A. Tomlin, Pagerank computation and the structure of the web: experiments and algorithms, in: Poster Proc. WWW2002, Honolulu 2002.
3. Barabasi A., and Albert R. Wmergence of scaling in random networks. Science 286 509 (1999)
4. P. Boldi, S. Vigna, WebGraph framework i: compression techniques, in: Proceedings of the Thirteenth International WWW Conference, 2004.
5. Junghoo Cho, Hector Garcia-Molina, Parallel crawlers, in: The Proceedings of 11th World Wide Web Conference, Hawaii, USA, May 2002.
6. The China Internet Network Information Center, China's Internet Development and Usage Report. Available from: .
7. Cyveillance, Inc., White Papers. Sizing the Internet. Available from: , July 2000.
8. N. Eiron, K.S. McCurley, Locality, hierarchy, and bidirectionality on the web, in: The Workshop on Web Algorithms and Models, 2003.
9. J. Kleinberg, S.R. Kumar, P. Raphavan, S. Rajagopalan, A. Tomkins, The web as a graph: measurements, models and methods, in: The Proceedings of the International Conference on Combinatorics and Computing, July 26-28, 1999.
10. R. kumar, P. Raghavan, S. Rajagopalan, A. Tomkins. Trawling the web for cyber communities, in: The Proceedings of the 8th WWW Conference, April 1999.
11. Krapivsky P.L., and Redner S. A statistical physics perspective on web growth. Computer Networks 39 (2002) 261-276
12. Lianen Huang, Hongfei Yan, Xiaoming Li, Engineering of web Infomall: the Chinese web archive, in: The Proceedings of World Engineers Convention, 2004.
13. L. Page, S. Brin, R. Motwani, T. Winogard, The pagerank citation ranking: bring order to the web, Stanford Digital Libraries Working Paper, 1998.
14. Levene M., Fenner T., Loizou G., and Wheeldon R. A stochastic model for the evolution of the web. Computer Networks 39 (2002) 277-287
15. Meng T., Yan H., and Li X. An evaluation model on information coverage of search engines. Chinese Journal of Electronics 31 8 (2003) (in Chinese)
16. Tao Meng, Hongfei Yan, Jimin Wang, and Xiaoming Li, The evolution of link-attributes for pages and its implications on web crawling, in: The Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence, pp. 578-581.
17. Marc Najork, Janet L. Wiener, Breadth-first search crawling yields high-quality pages, in: Proceedings of the 10th World Wide Web Conference, May 2001.
18. Marc Najork, Allan Heydon, High-Performance Web Crawling, COMPAQ SRC Research Report 173, September 26, 2001.
19. Park and Miller, Random number generators: good ones are hard to find, Communications of the ACM, October 1988.
20. Sepandar D. Kamvar, Taher H. Haveliwala, Christopher D.Manning, Gene H. Golub, Exploiting the block structure of the web for computing pagerank, in: Proceedings of 12th World Wide Web Conference, 2003.
21. Tarjan R.E. Depth-first search and linear graph algorithms. SIAM Journal of Computing (1972) 146-160
22. Tianwang search engine, by the lab of computer networks and distributed system in Peking University since 1997. Available from: .
23. Web Infomall, a web archive based on Tianwang search engine, which has stored all the web pages in China since 1997, by the lab of computer networks and distributed system in Peking University. Available from: .
24. Yan H., Wang J., Li X., and Guo L. Architectural design and evaluation of an efficient web-crawling system. Journal of System and Software March (2002) 185-193