An efficient parallel crawler in grid environment

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3032, Issue , 2004, Pages 229-232

  Dong, Shoubin ^a   Lu, Xiaofeng ^a   Zhang, Ling ^a   He, Kejing ^a  

^a SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

GRID COMPUTING; MIDDLEWARE;

DYNAMIC PARTITION; EXPERIMENTAL SYSTEM; GRID ENVIRONMENTS; GRID MIDDLEWARE; REAL APPLICATIONS;

SEARCH ENGINES;

EID: 84957587248     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-24679-4_48     Document Type: Conference Paper

References (4)

1. V. Shkapenyuk and T. Suel. Design and implementation of a high-performance distributed Web crawler. In Proceedings of the 18th International Conference on Data Engineering (ICDE'02), San Jose, CA Feb. 26-March 1, pages 357-368, 2002.
2. P. Boldi, B. Codenotti, M. Santini, and S. Vigna. Ubicrawler: A scalable fully distributed web crawler. In Proc. Of 8th Australian World Wide Web Conference, 2002.
3. J. Cho and H. Garcia-Molina. Parallel crawlers. In Proc. of the 11th International World–Wide Web Conference, 2002.
4. Marc Najork and Janet L. Wiener. Breadth-first search crawling yields high quality pages. In Proc. of 10th International World Wide Web Conference, Hong Kong, China, 2001.