Comparing the performance of collection selection algorithms

ACM Transactions on Information Systems

Volumn 21, Issue 4, 2003, Pages 412-456

  Powell, Allison L ^a,b   French, James C ^a,c  

^a UNIVERSITY OF VIRGINIA   (United States)

^b Founder and Director of the MEMS and Nanotechnology Exchange   (United States)

^c University of Virginia   (United States)

Author keywords

Collection selection; Database selection; Distributed information retrieval; Distributed text retrieval; Metasearch engine; Resource discovery; Resource ranking; Resource selection; Server ranking; Server selection; Text retrieval

Indexed keywords

COLLECTION SELECTION; DATABASE SELECTION; METASEARCH ENGINES; RESOURCE RANKING; SERVER SELECTION;

ALGORITHMS; DATABASE SYSTEMS; ONLINE SEARCHING; SEARCH ENGINES; SERVERS;

INFORMATION RETRIEVAL;

EID: 2442500342     PISSN: 10468188     EISSN: None     Source Type: Journal    
DOI: 10.1145/944012.944016     Document Type: Article

References (53)

1. ABDULLA, G., LIU, B., SAAD, R., AND Fox, E. A. 1997. Characterizing world wide web queries, Tech. Rep. TR-97-04, Department of Computer Science, Virginia Polytechnic Institute and State University.
2. ARAÚJO, M. D., NAVARRO, G., AND ZIVIANI, N. 1997. Large text searching allowing errors. In Proceedings of the 4th South American Workshop on String Processing (WSP '97). 2-20.
3. BAUMGARTEN, C. 1997. A probabilistic model for distributed information retrieval. In Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'97). ACM, New York, 258-266.
4. BAUMGARTEN, C. 1999. A probabilistic solution to the selection and fusion problem in distributed information retrieval. In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'99). ACM, New York, 246-253.
5. BUCKLEY, C. 1992. SMART version 11.0. ftp://ftp.cs.cornell.edu/pub/smart/ .
6. CALLAN, J., CONNELL, M., AND DU, A. 1999. Automatic discovery of language models for text databases. In Proceedings of the 1999 ACM SIGMOD International Conference on Management of Data. ACM, New York, 479-490.
7. CALLAN, J., POWELL, A. L., FRENCH, J. C., AND CONNELL, M. 2000. The effects of query-based sampling on automatic database selection algorithms. Tech. Rep. CMU-LTI-00-162, Language Technologies Institute, School of Computer Science, Carnegie Mellon University, Pittsburgh, Pa.
8. CALLAN, J. P., CROFT, W. B., AND HARDING, S. M. 1992. The INQUERY Retrieval System. In Proceedings of the 3rd International Conference on Database and Expert Systems Applications (DEXA'92). 78-83.
9. CALLAN, J. P., LU, Z., AND CROFT, W. B. 1995. Searching distributed collections with inference networks, In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'95). ACM, New York, 21-28.
10. CRASWELL, N., BAILEY, P., AND HAWKING, D. 2000. Server selection on the world wide web. In Proceedings of the 5th ACM Conference on Digital Libraries. ACM, New York, 37-46.
11. DOLIN, R., AGRAWAL, D., ABBADI, A. E., AND DILLON, L. 1997. Pharos: A scalable distributed architecture for locating heterogeneous information sources. In Proceedings of the 6th International Conference on Information and Knowledge Management (CIKM'97). 348-355.
12. DOLIN, R., AGRAWAL, D., AND ABBADI, E. E. 1999. Scalable collection summarization and Selection. In Proceedings of the 4th ACM Conference on Digital Libraries (DL'99). ACM, New York, 49-58.
13. DOLIN, R., AGRAWAL, D., ABBADI, E. E., AND PEARLMAN, J. 1998. Using Automated Classification for Summarizing and Selecting Heterogeneous Information Sources. D-Lib Mag. http://www.dlib.org/dlib/january98/dolin/01dolin.html.
14. DREILINGER, D. AND HOWE, A. E. 1997. Experiences with selecting search engines using MetaSearch. ACM Trans. Inf. Syst. 15, 3, 195-222.
15. FRENCH, J. C. 2002. Modeling web data. In Proceedings of the Joint Conference on Digital Libraries (JCDL'02).
16. FRENCH, J. C. AND POWELL, A. L. 2000. Metrics for evaluating database selection techniques. 3,3, 153-163.
17. FRENCH, J. C., POWELL, A. L., AND CALLAN, J. 1999a. Effective and efficient automatic database selection. Tech. Rep. CS-99-08, Department of Computer Science, University of Virginia.
18. FRENCH, J. C., POWELL, A. L., CALLAN, J., VILES, C. L., EMMITT, T., PREY, K. J., AND MOU, Y. 1999b. Comparing the performance of database selection algorithms. In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'99). ACM, New York, 238-245.
19. FRENCH, J. C., POWELL, A. L., VILES, C. L., EMMITT, T., AND PREY, K. J. 1998. Evaluating database selection techniques: A testbed and experiment. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'98). 121-129.
20. FUHR, N. 1999. A decision-theoretic approach to database selection in networked IR. ACM Trans. Inf. Syst. 17, 3, 229-249.
21. GAUCH, S., WANG, G., AND GOMEZ, M. 1996. ProFusion: Intelligent fusion from multiple, distributed search engines. J. Univ. Comput. 2, 9, 637-649.
22. GIBBONS, J. D. 1976. Nonparametric Methods for Quantative Analysis. Holt, Rinehart and Winston.
23. GRAVANO, L., CHANG, C.-C. K., GARCIA-MOLINA, H., AND PAEPCKE, A. 1997. STARTS: Stanford proposal for internet meta-searching. In Proceedings of the 1997 ACM SIGMOD International Conference on Management of Data (SIGMOD'97). ACM, New York, 207-218.
24. GRAVANO, L. AND GARCÍA-MOLINA, H. 1995. Generalizing GlOSS to vector-space databases and broker hierarchies. In Proceedings of the 21st International Conference on Very Large Data Bases (VLDB'95). 78-89.
25. GRAVANO, L., GARCÍA-MOLINA, H., AND TOMASIC, A. 1994. The effectiveness of GlOSS for the text database discovery problem. In Proceedings of the 1994 ACM SIIGMOD International Conference on Management of Data (SIGMOD'94). ACM, New York, 126-137.
26. GRAVANO, L., GARCÍA-MOLINA, H., AND TOMASIC, A. 1999. GlOSS: Text-source discovery over the internet. ACM Trans. Datab. Syst. 24, 2, 229-264.
27. HARMAN, D. K., Ed. 1995. Proceedings of the 4th Text Retrieval Conference (TREC-4). NIST Special Publication 500-236, Department of Commerce, National Institute of Standards and Technology, Gaithersburg, Md.
28. HAWKING, D. AND THISTLEWAITE, P. 1999. Methods for Information Server Selection. ACM Trans. Inf. Syst. 17, 1, 40-76.
29. IPEIROTIS, P. G. AND GRAVANO, L. 2002. Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection. In Proceedings of the 28th International Conference on Very Large Data Bases (VLDB 2002). 394-405.
30. JANSEN, M. B. J., SPINK, A., BATEMAN, J., AND SARACEVIC, T. 1998. Real life information retrieval: A study of user queries on the web. SIGIR Forum 32, 1, 5-17.
31. LIN, Y., XU, J., LIM, E.-P., AND NG, W.-K. 1999. ZBroker: A query routing broker for Z39.50 databases. In Proceedings of the 8th International Conference on Information and Knowledge Management (CIKM'99). 202-209.
32. LIU, K.-L., YU, C., MENG, W., WU, W., AND RISHE, N. 1999. A statistical method for estimating the usefulness of text databases. Tech. rep., Department of EECS, University of Illinois at Chicago, Chicago, Ill.
33. LU, Z., CALLAN, J. P., AND CROFT, W. B. 1996. Measures in collection ranking evaluation. Tech. Rep. TR-96-39, Computer Science Department, University of Massachusetts.
34. MENG, W., LIU, K.-L., YU, C., WANG, X., CHANG, Y., AND RISHE, N. 1998. Determining text databases to search in the internet. In Proceedings of the 24th International Conference on Very Large Data Bases (VLDB'98). 14-25.
35. MENG, W., LIU, K.-L., YU, C., WU, W., AND RISHE, N. 1999. Estimating the usefulness of search engines. In Proceedings of the 15th International Conference on Data Engineering. 146-153.
36. MOFFAT, A. AND ZOBEL, J. 1995. Information retrieval systems for large document collections. In Proceedings of the 3rd Text Retrieval Conference (TREC-3). 85-94.
37. POWELL, A. L. 2001. Database selection in distributed information retrieval: A study of multi-collection information retrieval. Ph.D. dissertation, Department of Computer Science, University of Virginia.
38. POWELL, A. L., FRENCH, J. C., CALLAN, J., CONNELL, M., AND VILES, C. L. 2000. The impact of database selection on distributed searching. In Proceedings of the 23rd International Conference on Research and Development in Information Retrieval (SIGIR'00). ACM, New York, 232-239.
39. POWELL, J. AND FOX, E. A. 1998. Multilingual federated searching across heterogeneous collections. D-Lib Mag. http://www.dlib.org/dlib/september98/ powell/09powell.html.
40. SILVERSTEIN, C., HENZINGER, M., MARAIS, H., AND MORICZ, M. 1999. Analysis of a very large Web Search Engine Query Log. SIGIR Forum 33, 1, 6-12.
41. SPINK, A. AND SARACEVIC, T. 1997. Interaction in information retrieval: Selection and effectiveness of search terms. J. ASIS 48, 8, 741-761.
42. TOMASIC, A., GRAVANO, L., LUE, C., SCHWARZ, P., AND HAAS, L. 1997. Data structures for efficient broker implementation. ACM Trans. Inf. Syst. 15, 3, 223-253.
43. VOORHEES, E., GUPTA, N. K., AND JOHNSON-LAIRD, B. 1994. The collection fusion problem. In Proceedings of the 3rd Text REtrieval Conference (TREC-3). 95-104.
44. VOORHEES, E., GUPTA, N. K., AND JOHNSON-LAIRD, B. 1995. Learning collection fusion strategies. In Proceedings of the 18th International Conference on Research and Development in Information Retrieval (SIGIR'95). ACM, New York, 172-179.
45. VOORHEES, E. M. 1995. Siemens TREC-4 Report: Further Experiments with Database Merging. In Proceedings of the 4th Text REtrieval Conference (TREC-4). 121-130.
46. VOORHEES, E. M. AND TONG, R. M. 1997. Multiple Search Engines in Database Merging. In Proceedings of the 2nd ACM International Conference on Digital Libraries (DL'97). 93-102.
47. XU, J. AND CALLAN, J. 1998. Effective Retrieval with Distributed Collections. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'98). ACM, New York, 112-120.
48. XU, J., CAO, Y., LIM, E.-P., AND NG, W.-K. 1998. Database selection techniques for routing bibliographic queries. In Proceedings of the 3rd ACM International Conference on Digital Libraries (DL'98). ACM, New York, 264-273.
49. XU, J. AND CROFT, W. B. 1999. Cluster-based language models for distributed retrieval. In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'99). ACM, New York, 254-261.
50. YU, C., LIU, K.-L., WU, W., MENG, W., AND RISHE, N. 1999a. Finding the most similar documents across multiple text databases. In Proceedings of the IEEE Conference on Advances in Digital Libraries (ADL'99). IEEE Computer Society Press, Los Alamitos, Calif., 150-162.
51. YU, C., MENG, W., LIU, K.-L., Wu, W., AND RISHE, N. 1999b. Efficient and effective metaSearch for a large number of text databases. In Proceedings of the 8th International Conference on Information and Knowledge Management (CIKM'99). 217-224.
52. YUWONO, B. AND LEE, D. L. 1997. Server ranking for distributed text retrieval systems on internet. In Proceedings of the 5th International Conference on Database Systems for Advanced Applications. 41-49.
53. ZOBEL, J. 1997. Collection selection via lexicon inspection. In Proceedings of the 2nd Australian Document Computing Symposium. 74-80.