Capturing collection size for distributed non-cooperative retrieval

Proceedings of the Twenty-Ninth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn 2006, Issue , 2006, Pages 316-323

  Shokouhi, Milad ^a   Zobel, Justin ^a   Scholer, Falk ^a   Tahaghoghi, S M M ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

Capture history; Capture recapture; Collection size estimation; Sample resample

Indexed keywords

DATA ACQUISITION; INFORMATION ANALYSIS; PARAMETER ESTIMATION; DATA REDUCTION; KNOWLEDGE ACQUISITION; STATISTICS;

CAPTURE-HISTORY; CAPTURE-RECAPTURE; COLLECTION SIZE ESTIMATION; SAMPLE-RESAMPLE;

INFORMATION RETRIEVAL;

CAPTURE HISTORY; COLLECTION SIZE ESTIMATION; ECOLOGICAL TECHNIQUES; NON COOPERATIVE ENVIRONMENTS;

EID: 33750285514     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1148170.1148227     Document Type: Conference Paper

References (26)

1. Agichtein, E., Ipeirotis, P. G., and Gravano, L. (2003). Modeling query-based access to text databases. In International Workshop on Web and Databases, pages 87-92, San Diego, California.
2. Anagnostopoulos, A., Broder, A. Z., and Carmel, D. (2005). Sampling search-engine results. In Proceedings of 14th International Conference on the World Wide Web, pages 245-256, Chiba, Japan.
3. Baeza-Yates, R. A. and Ribeiro-Neto, B. (1999). Modern Information Retrieval. Addison-Wesley Longman Publishing Co., Inc., Boston, MA.
4. Bailey, P., Craswell, N., and Hawking, D. (2003). Engineering a multi-purpose test collection for Web retrieval experiments. Information Processing and Management, 39(6):853-871.
5. Brin, S. and Page, L. (1998). The anatomy of a large-scale hypertextual Web search engine. In Proceedings of 7th International Conference on the World Wide Web, pages 107-117, Brisbane, Australia.
6. Callan, J. and Connell, M. (2001). Query-based sampling of text databases. ACM Transactions on Information Systems, 19(2):97-130.
7. Craswell, N. and Hawking, D. (2002). Overview of the TREC-2002 Web Track. In Proceedings of TREC-2002, Gaithersburg, Maryland.
8. Craswell, N., Hawking, D., and Robertson, S. (2001). Effective site finding using link anchor information. In Proceedings of 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 250-257, New Orleans, Louisiana.
9. D'Souza, D., Thom, J., and Zobel, J. (2004). Collection selection for managed distributed document databases. Information Processing and Management, 40(3):527-546.
10. Garcia, S., Williams, H. E., and Cannane, A. (2004). Access-ordered indexes. In Proceedings of 27th Australasian Computer Science Conference, pages 7-14, Darlinghurst, Australia.
11. Gravano, L., Ipeirotis, P. G., and Sahami, M. (2003). Qprober: A system for automatic classification of Hidden-Web databases. ACM Transactions on Information Systems, 21(1):1-41.
12. Hawking, D. and Thomas, P. (2005). Server selection methods in hybrid portal search. In Proceedings of 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 75-82, Salvador, Brazil.
13. Ipeirotis, P. G. and Gravano, L. (2002). Distributed search over the hidden Web: Hierarchical database sampling and selection. In Proceedings of 28th International Conference on Very Large Data Bases, pages 394-405, Hong Kong, China.
14. Ipeirotis, P. G. and Gravano, L. (2004). When one sample is not enough: improving text database selection using shrinkage. In Proceedings of ACM SIGMOD International Conference on Management of Data, pages 767-778, Paris, France.
15. Ipeirotis, P. G., Gravano, L., and Sahami, M. (2001). Probe, count, and classify: categorizing Hidden Web databases. ACM SIGMOD Record, 30(2):67-78.
16. Jansen, B. J., Spink, A., and Saracevic, T. (2000). Real life, real users, and real needs: a study and analysis of user queries on the Web. Information Processing and Management, 36(2):207-227.
17. Karnatapu, S., Ramachandran, K., Wu, Z., Shah, B., Raghavan, V., and Benton, R. (2004). Estimating size of search engines in an uncooperative environment. In Workshop on Web-based Support Systems, pages 81-87, Beijing, China.
18. Liu, K., Yu, C., and Meng, W. (2002). Discovering the representative of a search engine. In Proceedings of 11th ACM CIKM International Conference on Information and Knowledge Management, pages 652-654, McLean, Virginia.
19. Powell, A. L. and French, J. (2003). Comparing the performance of collection selection algorithms. ACM Transactions on Information Systems, 21(4):412-456.
20. Schumacher, F. X. and Eschmeyer, R. W. (1943). The estimation of fish populations in lakes and ponds. Journal of the Tennesse Academy of Science, 18:228-249.
21. Si, L. and Callan, J. (2003a). The effect of database size distribution on resource selection algorithms. In Proeedings of SIGIR 2003 Workshop on Distributed Information Retrieval, pages 31-42, Toronto, Canada.
22. Si, L. and Callan, J. (2003b). Relevant document distribution estimation method for resource selection. In Proceedings of 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 298-305, Toronto, Canada.
23. Si, L. and Callan, J. (2004). Unified utility maximization framework for resource selection. In Proceedings of 13th ACM CIKM Conference on Information and Knowledge Management, pages 32-41, Washington, D.C.
24. Si, L., Jin, R., Callan, J., and Ogilvie, P. (2002). A language modeling framework for resource selection and results merging. In Proceedings of 11th ACM CIKM International Conference on Information and Knowledge Management, pages 391-397, New York, NY.
25. Sutherland, W. J. (1996). Ecological Census Techniques. Cambridge University Press.
26. Voorhees, E. M. and Harman, D. (2000). Overview of the sixth Text REtrieval Conference (TREC-6). Information Processing and Management, 36(1):3-35.