Evaluating sampling methods for uncooperative collections

Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR'07

Volumn , Issue , 2007, Pages 503-510

  Thomas, Paul ^a   Hawking, David ^b  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^b CSIRO   (Australia)

Author keywords

Distributed information retrieval; Random sampling

Indexed keywords

PARAMETER ESTIMATION; QUERY PROCESSING; SEARCH ENGINES; SERVERS; WEB SERVICES;

DISTRIBUTED INFORMATION RETRIEVAL; METASEARCH APPLICATION; RANDOM SAMPLING; UNCOOPERATIVE COLLECTIONS;

INFORMATION RETRIEVAL;

EID: 36448993278     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1277741.1277828     Document Type: Conference Paper

References (15)

1. Z. Bar-Yossef, A. Berg, S. Chien, J. Fackcharoenphol, and D. Weitz. Approximating aggregate queries about web pages via random walks. In Proc. VLDB, 2000.
2. Z. Bar-Yossef and M. Gurevich. Random sampling from a search engine's index. In Proc. WWW, 2006.
3. K. Bharat and A. Broder. A technique for measuring the relative size and overlap of public web search engines. In Proc. 7th WWW, 1998.
4. A. Broder, M. Fontura, V. Josifivski, R. Kumar, R. Motwani, S. Nabar, R. Panigrahy, A. Tomkins, and Y. Xu. Estimating corpus size via queries. In Proc.CIKM, 2006.
5. J. P. Callan, Z. Lu, and W. B. Croft. Searching distributed collections with inference networks. In Proc. SIGIR, 1995.
6. N. Craswell, D. Hawking, and P. Thistlewaite. Merging results from isolated search engines. In Proc. Australasian Database Conference, 1999.
7. A. Gulli and A. Signorini. The indexable web is more than 11.5 billion pages. In Proc. WWW, 2005. Poster.
8. M. R. Henzinger, A. Heydon, M. Mitzenmacher, and M. Najork. On near-uniform URL sampling. In Proc. 9th WWW, 2000.
9. K.-L. Liu, A. Santoso, C. Yu, W. Meng, and C. Zhang. Discovering the representative of a search engine. In Proc.CIKM, 2001. Poster.
10. Open directory project, http://dmoz.org/.
11. A. L. Powell, J. C. French, J. Callan, M. Connell, and C. L. Viles. The impact of database selection on distributed searching. In Proc. SIGIR, 2000.
12. P. Rusmevichientong, D. M. Pennock, S. Lawrence, and C. L. Giles. Methods for sampling pages uniformly from the world wide web. In Proc. AAAI Fall Symposium on Using Uncertainty Within Computation, 2001.
13. M. Shokouhi, J. Zobel, F. Scholer, and S. M. M. Tahaghoghi. Capturing collection size for distributed non-cooperative retrieval. In Proc. SIGIR, 2006.
14. L. Si and J. Callan. Relevant document distribution estimation method for resource selection. In Proc. SIGIR, 2003.
15. J. Xu and W. B. Croft. Cluster-based language models for distributed retrieval. In Proc. SIGIR, 1999.