On near-uniform URL sampling

Computer Networks

Volumn 33, Issue 1, 2000, Pages 295-308

  Henzinger, Monika R ^a   Heydon, Allan ^b   Mitzenmacher, Michael ^c   Najork, Marc ^b  

^a GOOGLE INC   (United States)

^b HEWLETT PACKARD COMPANY   (United States)

^c HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HTML; MARKOV PROCESSES; PROBABILITY; RANDOM PROCESSES; RESOURCE ALLOCATION; SAMPLING; SEARCH ENGINES;

INTERNET DOMAIN DISTRIBUTION; RANDOM WALKS; UNIFORM RESOURCE LOCATOR; WEB GRAPH;

WORLD WIDE WEB;

EID: 0033705620     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1389-1286(00)00055-4     Document Type: Article

References (19)

1. AltaVista, http://www.altavista.com/.
2. K. Bharat and A. Broder, A technique for measuring the relative size and overlap of public Web search engines, in: Proc. of the 7th International World Wide Web Conference, Brisbane, Australia, Elsevier, Amsterdam, 1998, pp. 379-388.
3. T. Bray, Measuring the Web, World Wide Web J. 1 (3) (1996).
4. S. Brin and L. Page, The anatomy of a large-scale hypertextual Web search engine, in: Proc. of the 7th International World Wide Web Conference, Brisbane, Australia, Elsevier, Amsterdam, 1998, pp. 107-117.
5. A. Broder, R. Kumar, F. Maghoul, P. Raghavan, S. Rajagopalan, R. Stata, A. Tomkins and J. Wiener, Graph structure in the Web, Comput. Networks 32 (2000) 000-000, this volume.
6. Excite, http://www.excite.com/.
7. FAST Search, http://www.alltheweb.com/.
8. Google, http://www.google.com/.
9. M. Henzinger, A. Heydon, M. Mitzenmacher and M. Najork, Measuring search engine quality using random walks on the Web, in: Proc. of the Eighth International World Wide Web Conference, Elsevier, Amsterdam, 1999, pp. 213-225.
10. A. Heydon and M. Najork, Mercator: a scalable, extensible Web crawler, World Wide Web 2 (4) (1999) 219-229.
11. HotBot, http://www.hotbot.com/.
12. Infoseek, http://www.infoseek.com/.
13. S.R. Kumar, P. Raghavan, S. Rajagopalan and A. Tomkins, Extracting large scale knowledge bases from the Web, in: IEEE International Conference on Very Large Databases (VLDB), Edinburgh, Scotland, September 1999, pp. 639-650.
14. S. Lawrence and C.L. Giles, Searching the World Wide Web, Science 280 (536) (1998) 98.
15. S. Lawrence and C.L. Giles, Accessibility of information on the Web, Nature 400 (1999) 107-109.
16. Lycos, http://www.lycos.com/.
17. Mercator Home Page, http://www.research.digital.com/SRC/mercator/.
18. Northern Light, http://www.northernlight.com/.
19. Search Engine Watch, http://www.searchenginewatch.com/reports/sizes.html.