Efficient crawling through URL ordering

Computer Networks

Volumn 30, Issue 1-7, 1998, Pages 161-172

  Cho, Junghoo ^a   Garcia Molina, Hector ^a   Page, Lawrence ^a  

^a Stanford University   (United States)

Author keywords

Crawling; URL ordering

Indexed keywords

EID: 20444396637     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0169-7552(98)00108-1     Document Type: Article

References (7)

1. B. Kahle, Archiving the Internet, extended version of the article "Preserving the Internet" that appeared in Scientific American, March 1997. Extended version available at http://www.al exa.com/∼brewster/es.says/sciam_article.html (published version at http://www.sciam.com/0397issue/0397kahle.html)
2. M. Koster, Robots in the Web: threat or treat? ConneXions, 9(4), April 1995, http://info.webcrawler.com/mak/projects/ro bots/threat-or-treat.html
3. S. Brin and L. Page, The anatomy of a search engine, in: Proc. of the 7th International WWW Conference (\V\V\V9S), Brisbane, Australia, April 14-18, 1998;
4. also Coinpiit. Networks ISDN Systems, 30(1-7): 107-117 (this volume).
5. L. Page, S. Brin, R. Motwani and T. Winograd, The PageRank Citation Ranking: bringing order to the Web, manuscript in progress, http://google.stanford.edu/~backrub/ pageranksub.ps
6. B. Pinkerton, Finding what people want: experiences with the WebCrawIer, in: Proc. of the 2nd International WWW Conference, Chicago, USA, October 17-20, 1994.
7. G. Salton, Automatic Text Processing, Addison-Wesley, Reading, MA, 1989.