A comparison of techniques for sampling web pages

Leibniz International Proceedings in Informatics, LIPIcs

Volumn 3, Issue , 2009, Pages 13-30

  Baykan, Eda ^a   Henzinger, Monika ^a,b   Keller, Stefan F ^c   De Castelberg, Sebastian ^c   Kinzler, Markus ^c  

^a EPFL   (Switzerland)

^b GOOGLE   (Switzerland)

^c FHO Fachhochschule Ostschweiz   (Switzerland)

Author keywords

Random walks; Sampling web pages

Indexed keywords

RANDOM SAMPLE; RANDOM WALK; SAMPLING ALGORITHM; SPECIFIC LANGUAGES; TOP LEVEL DOMAINS;

ALGORITHMS; COMPUTER SCIENCE; RANDOM PROCESSES;

WEBSITES;

EID: 84880228514     PISSN: 18688969     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Z. Bar-Yossef, A. C. Berg, S. Chien, J. Fakcharoenphol, and D. Weitz. Approximating aggregate queries about web pages via random walks. In International Conference on Very Large Databases (VLDB), pages 535-544, 2000.
2. Z. Bar-Yossef, T. Kanungo, and R. Krauthgamer. Focused sampling: Computing topical web statistics. Technical report, IBM T.J Watson Research Center, 2005.
3. K. Bharat, B. Chang, M. R. Henzinger, and M. Ruhl. Who links to whom: Mining linkage between web sites. In International Conference on Data Mining (ICDM), pages 51-58, 2001.
4. S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. In Computer Networks and ISDN Systems, pages 107-117, 1998.
5. A. Broder, R. Kumar, F. Maghoul, P. Raghavan, S. Rajagopalan, R. Stata, A. Tomkins, and J. Wiener. Graph structure in the web. In International World Wide Web Conference (WWW), volume 33, pages 309-320, 2000.
6. S. Chakrabarti, M. M. Joshi, K. Punera, and D. M. Pennock. The structure of broad topics on the web. In International World Wide Web Conference (WWW), pages 251-262, 2002.
7. J. Cho and H. Garcia-Molina. The evolution of the web and implications for an incremental crawler. In International Conference on Very Large Databases (VLDB), pages 200-209, 2000.
8. D. Fetterly, M. Manasse, M. Najork, and J. L. Wiener. A large-scale study of the evolution of web pages. In International World Wide Web Conference (WWW), pages 669-678, 2003.
9. M. R. Henzinger, A. Heydon, M. Mitzenmacher, and M. Najork. Measuring index quality using random walks on the web. In International World Wide Web Conference (WWW), pages 213-225, 1999.
10. M. R. Henzinger, A. Heydon, M. Mitzenmacher, and M. Najork. On near-uniform url sampling. In International World Wide Web Conference (WWW), pages 295-308, 2000.
11. J. M. Kleinberg, R. Kumar, P. Raghavan, S. Rajagopalan, and A. S. Tomkins. The Web as a graph: Measurements, models and methods. Lecture Notes in Computer Science, 1627:1-17, 1999.
12. S. Lawrence and C. L. Giles. Accessibility of information on the web. In Nature, volume 400, 1999.
13. P. Rusmevichientong, D. M. Pennock, S. Lawrence, and C. L. Giles. Methods for sampling pages uniformly from the world wide web. In AAAI Fall Symposium on Using Uncertainty Within Computation, pages 121-128, 2001.