Methods for Sampling Pages Uniformly from the World Wide Web

AAAI Fall Symposium - Technical Report

Volumn FS-01-04, Issue , 2001, Pages 121-128

  Rusmevichientong, Paat ^a   Pennock, David M ^b   Lawrence, Steve ^b   Giles, C Lee ^c  

^a Stanford University   (United States)

^b NEC LABORATORIES AMERICA   (United States)

^c PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIRECTED GRAPHS; UNDIRECTED GRAPHS; WEBSITES;

ADDITIONAL KNOWLEDGE; ARBITRARY DIRECTED GRAPHS; EXPLICIT BOUNDS; INBOUND LINKS; RANDOM SAMPLE; RANDOM WALK; UNDIRECTED GRAPH; UNIFORM DISTRIBUTION; WEB DATA; WEB-PAGE;

SEARCH ENGINES;

EID: 77955757374     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Bar-Yossef,Z.; Berg,A.; Chien,S.; andFakcharoenphol, J. 2000. Approximatingaggregate queries about webpagesvia randomwalks.In Proceedings of the 26thInternationalConfer-enceon Very Large Data Bases.
2. Barabfisi, A., andAlbert, R. 1999.Emergence of scaling in randomnetworks.Science286:509-512.
3. Bharat,K., andBroder,A.1998.Atechniquefor measuringthe relative size andoverlapof publicwebsearchengines.In Proceedingsof the 7thInternationalWorldWideWebConference.
4. Brin, S., andPage,L. 1998.Theanatomy of a large-scalehypertextual websearchengine.In SeventhInternationalWorldWide WebConference.
5. Broder,A.; Kumar, R.; Maghoul, E; Raghavan, P.; Rajagopalan, S.; Stata, R.; andTomkins,A.2000.Graphstructure in the web.In Proceedingsof the 9th InternationalWorldWideWeb Conference.
6. Chakrabarti,S.; van denBerg,M.; andDom,B. 1999.Focused crawling:Anewapproachto topic-specific webresourcediscovery.In Proceedings of the 8th InternationalWorldWideWeb Conference.
7. Diaconis,P., andStroock,D. 1991.Geometric boundsfor eigenvaluesof Markov chains. Annalsof AppliedProbability1(1):36-61.
8. Diligenti, M.; Coetzee, F.; Lawrence, S.; Giles, C. L.; andGod, M.2000.Focusedcrawlingusing context graphs. In 26th International Conferenceon VeryLargeDatabases,VLDB2000, 527-534.
9. Henzinger,M.;Heydon,A.; Mitzenmacher, M.; andNajork, M. 2000. Onnear-uniformURLsampling. In Proceedingsof the 9th InternationalWorldWideWebConference,295-308.
10. Inktomi/NEC. January 19, 2000. Web surpassesonebillion documents. Inktomi/NEC press release, http: //www. inktomi, com/.
11. Kahle,B. 1997.Preservingthe Internet. Scientific American.
12. Lawrence, S., andGiles, C. L. 1998.Searchingthe WorldWide Web.Science 280(5360):98-100.
13. Lawrence, S., andGiles, C. L. 1999.Accessibilityof information on the web.Nature400(6740):107-109.
14. Pennock, D.; Flake,G.; Lawrence, S.; Giles, L.; andGlover,E. Winnersdon’t take all: Amodelof weblink accumulation,in preparation.