Distributed query sampling: A quality-conscious approach

Proceedings of the Twenty-Ninth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn 2006, Issue , 2006, Pages 340-347

  Caverlee, James ^a   Liu, Ling ^a   Bae, Joonsoo ^b  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b Chonbuk National University   (South Korea)

Author keywords

Adaptive; Distributed IR; Quality; Sampling

Indexed keywords

DATABASE SYSTEMS; ITERATIVE METHODS; QUERY LANGUAGES; SAMPLING; SCHEDULING; INFORMATION RETRIEVAL SYSTEMS; LEARNING SYSTEMS; PARAMETER ESTIMATION; QUALITY CONTROL;

DISTRIBUTED IR; QUERY-BASED SAMPLING; SELF-CONFIGURING ABILITY; TEXT DATABASES; DATABASE SAMPLES; DATABASE SIZE; ITERATIVE SAMPLINGS; QUERY SAMPLINGS;

INFORMATION RETRIEVAL; QUERY LANGUAGES;

EID: 33750304244     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. E. Agichtein, P. Ipeirotis, and L. Gravano. Modeling query-based access to text databases. In WebDB, 2003.
2. R. A. Baeza-Yates and B. A. Ribeiro-Neto. Modern Information Retrieval. ACM Press / Addison-Wesley, 1999.
3. J. Callan and M. Connell. Query-based sampling of text databases. Information Systems, 19(2):97-130, 2001.
4. J. Callan, M. Connell, and A. Du. Automatic discovery of language models for text databases. In SIGMOD, 1999.
5. J. Callan et al. The effects of query-based sampling on automatic database selection algorithms. Technical Report CMU-LTI-00-162, CMU, 2000.
6. J. Callan, Z. Lu, and W. B. Croft. Searching distributed collections with inference networks. In SIGIR, 1995.
7. W. W. Cohen and Y. Singer. Learning to query the Web. In AAAI Workshop on Internet-Based Info. Systems. 1996.
8. N. Craswell, P. Bailey, and D. Hawking. Server selection on the World Wide Web. In Digital Libraries, 2000.
9. J. C. French et al. Comparing the performance of database selection algorithms. In SIGIR, 1999.
10. N. Fuhr. A decision-theoretic approach to database selection in networked IR. ACM TOIS, 17(3):229-229, 1999.
11. L. Gravano and H. García-Molina. Generalizing GlOSS to vector-space databases and broker hierarchies. In VLDB, 1995.
12. D. Hawking and P. Thomas. Server selection methods in hybrid portal search. In SIGIR, 2005.
13. P. Ipeirotis et al. Modeling and managing content changes in text databases. In ICDE, 2005.
14. P. Ipeirotis and L. Gravano. Improving text database selection using shrinkage. In SIGMOD, 2004.
15. P. Ipeirotis, L. Gravano, and M. Sahami. Probe, count, and classify: Categorizing hidden-web databases. In SIGMOD, 2001.
16. J. Lin. Divergence measures based on the shannon entropy. IEEE Trans. on Inf. Theory, 37(1):145-151, 1991.
17. K.-L. Liu, C. Yu, and W. Meng. Discovering the representative of a search engine. In CIKM, 2001.
18. J. Lu and J. Callan. Federated search of text-based digital libraries hierarchical peer-to-peer networks. In SIGIR Workshop on P2P Information Retrieval, 2004.
19. W. Meng, C. T. Yu, and K.-L. Liu. Detection of heterogeneities in a multiple text database environment. In CoopIS, 1999.
20. H. Nottelmann and N. Fuhr. Evaluating different methods of estimating retrieval quality for resource selection. In SIGIR, 2003.
21. A. Ntoulas, P. Zerfos, and J. Cho. Downloading textual hidden Web content through keyword queries. In JCDL, 2005.
22. M. F. Porter. An algorithm for suffix stripping. Program, 14(3):130-137, 1980.
23. A. L. Powell et al. The impact of database selection on distributed searching. In SIGIR, 2000.
24. S. Raghavan and H. Garcia-Molina. Crawling the hidden Web. In VLDB, 2001.
25. L. Si and J. Callan. Using sampled data and regression to merge search engine results. In SIGIR, 2002.
26. L. Si and J. Callan. Relevant document distribution estimation method for resource selection. In SIGIR, 2003.
27. W. Wang, W. Meng, and C. Yu. Concept hierarchy based text database categorization in a metasearch engine. In WISE '00.
28. J. Xu and J. Callan. Effective retrieval with distributed collections. In SIGIR, 1998.