Efficient search engine measurements

16th International World Wide Web Conference, WWW2007

Volumn , Issue , 2007, Pages 401-410

  Bar Yossef, Ziv ^a,b   Gurevich, Maxim ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b GOOGLE INC   (United States)

Author keywords

Corpus size estimation; Evaluation; Search engines

Indexed keywords

APPROXIMATION THEORY; ESTIMATION; ONLINE SEARCHING; PROBLEM SOLVING; SAMPLING;

CORPUS SIZE ESTIMATION; ESTIMATORS;

SEARCH ENGINES;

EID: 35348840330     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1242572.1242627     Document Type: Conference Paper

References (24)

1. Z. Bar-Yossef, A. Berg, S. Chien, J. Fakcharoenphol, and D. Weitz. Approximating aggregate queries about Web pages via random walks. In Proc. 26th VLDB, pages 535-544, 2000.
2. Z. Bar-Yossef and M. Gurevich. Random sampling from a search engine's index. In Proc. 15th WWW, pages 367-376, 2006.
3. Z. Bar-Yossef and M. Gurevich. Efficient search engine measurements, 2007. Full version available at http://www.ee.technion.ac.il/people/zivby.
4. K. Bharat and A. Broder. A technique for measuring the relative size and overlap of public Web search engines. In Proc. 7th WWW, pages 379-388, 1998.
5. E. T. Bradlow and D. C. Schmittlein. The little engines that could: Modeling the performance of World Wide Web search engines. Marketing Science, 19:43-62, 2000.
6. A. Broder, M. Fontoura, V. Josifovski, R. Kumar, R. Motwani, S. Nabar, R. Panigrahy, A. Tomkins, and Y. Xu. Estimating corpus size via queries. Proc. 15th CIKM, 2006.
7. G. Casella and C. P. Robert. Rao-Blackwellisation of sampling schemes. Biometrika, 83(1):81-94, 1996.
8. M. Cheney and M. Perry. A comparison of the size of the Yahoo! and Google indices. Available at http://vburton.ncsa.uiuc.edu/indexsize.html, 2005.
9. dmoz. The open directory project. http://dmoz.org.
10. A. Dobra and S. E. Fienberg. How large is the World Wide Web? Web Dynamics, pages 23-44, 2004.
11. O. Goldreich. A sample of samplers - a computational perspective on sampling (survey). ECCC, 4(20), 1997.
12. A. Gulli and A. Signorini. The Indexable Web is more than 11.5 billion pages. In Proc. 14th WWW, pages 902-903, 2005.
13. W. K. Hastings. Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57(1):97-109, 1970.
14. M. R. Henzinger, A. Heydon, M. Mitzenmacher, and M. Najork. Measuring index quality using random walks on the Web. In Proc. 8th WWW, pages 213-225, 1999.
15. M. R. Henzinger, A. Heydon, M. Mitzenmacher, and M. Najork. On near-uniform URL sampling. In Proc. 9th WWW, pages 295-308, 2000.
16. T. C. Hesterberg. Advances in Importance Sampling. PhD thesis, Stanford University, 1988.
17. S. Lawrence and C. L. Giles. Searching the World Wide Web. Science, 5360(280):98, 1998.
18. S. Lawrence and C. L. Giles. Accessibility of information on the Web. Nature, 400:107-109, 1999.
19. S.-M. Lee and A. Chao. Estimating population size via sample coverage for closed capture-recapture models. Biometrics, 50(1):88-97, 1994.
20. J. S. Liu. Monte Carlo Strategies in Scientific Computing. Springer, 2001.
21. A. W. Marshal. The use of multi-stage sampling schemes In Monte Carlo computations. In Symposium on Monte Carlo Methods, pages 123-140, 1956.
22. N. Metropolis, A. Rosenbluth, M. Rosenbluth, A. Teller, and E. Teller. Equations of state calculations by fast computing machines. J. of Chemical Physics, 21:1087-1091, 1953.
23. P. Rusmevichientong, D. Pennock, S. Lawrence, and C. L. Giles. Methods for sampling pages uniformly from the World Wide Web. In Proc. AAAI Symp. on Using Uncertainty within Computation, 2001.
24. J. von Neumann. Various techniques used in connection with random digits. In John von Neumann, Collected Works, volume V. Oxford, 1963.