Towards a Highly-Scalable and Effective Metasearch Engine

Proceedings of the 10th International Conference on World Wide Web, WWW 2001

Volumn , Issue , 2001, Pages 386-395

  Wu, Zonghuan ^a   Meng, Weiyi ^a   Yu, Clement ^b   Li, Zhuogang ^a  

^a STATE UNIVERSITY OF NEW YORK   (United States)

^b 1120 Science and Engineering Offices   (United States)

Author keywords

Database Selection; Distributed Text Database; Metasearch Engine; Resource Discovery

Indexed keywords

COMPUTATION THEORY; EFFICIENCY; METADATA; QUERY PROCESSING; WORLD WIDE WEB;

COMPUTATION EFFICIENCY; IN-BUILDINGS; LOCAL SEARCH ENGINES; META SEARCH ENGINES; OPERATIONAL PROTOTYPE; RESOURCE DISCOVERY; SELECTION METHODS; TEXT DATABASE;

SEARCH ENGINES;

EID: 84947713549     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/371920.372093     Document Type: Conference Paper

References (37)

1. C. Baumgarten. A Probabilistic Model for Distributed Information Retrieval. ACM SIGIR, 1997.
2. C. Baumgarten. A Probabilistic solution to the selection and fusion problem in distributed Information Retrieval, ACM SIGIR Conference, 1999.
3. K. Bharat, A. Broder. A Technique for Measuring the Relative Size and Overlap of Public Web Search Engines. 7th WWW Conference, April 1998.
4. J. Callan, Z. Lu, W. Croft. Searching Distributed Collections with Inference Networks. ACM SIGIR, 1995.
5. J. Callan, M. Connell, A. Du. Automatic Discovery of Language Models for Text Databases. ACM SIGMOD, 1999.
6. D. Dreilinger, A. Howe. Experiences with Selecting Search Engines Using Metasearch. ACM TOIS, 15(3), July 1997, pp. 195-222.
7. Y. Fan, S. Gauch. Adaptive Agents for Information Gathering from Multiple, Distributed Information Sources. 1999 AAAI Symposium on Intelligent Agents in Cyberspace.
8. L. Gravano, H. Garcia-Molina. Generalizing GlOSS to Vector-Space Databases and Broker Hierarchies. VLDB, 1995.
9. L. Gravano, H. Garcia-Molina. Merging Ranks from Heterogeneous Internet Sources. VLDB, 1997.
10. D. Hawking, P. Thistlewaite. Methods for Information Server Selection. ACM Transactions on Information Systems, 17(1), January 1999.
11. B. Jansen, A. Spink, J. Bateman, T. Saracevic. Real Life Information Retrieval: A Study of User Queries on the Web. ACM SIGIR Forum, 32:1, 1998.
12. T. Kirk, A. Levy, Y. Sagiv, D. Srivastava. The Information Manifold. AAAI Spring Symposium on Information Gathering in Distributed Heterogeneous Environments. 1995.
13. S. Kirsch. The Future of Internet Search: Infoseek's Experiences Searching the Internet. ACM SIGIR Forum, 32:2, pp. 3-7, 1998.
14. S. Lawrence, C. Lee Giles. Searching the World Wide Web. Science, 280, April 1998.
15. S. Lawrence, C. Lee Giles. Inquirus, the NECi Meta Search Engine. Seventh International World Wide Web Conference, 1998.
16. S. Lawrence, C. Lee Giles. Accessibility of Information on the Web. Nature, 400, July 1999.
17. K. Liu, C. Yu, W. Meng, W. Wu, N. Rishe. A Statistical Method for Estimating the Usefulness of Text Databases. IEEE TKDE (to appear).
18. K. Liu, C. Yu, W. Meng. Discovering the Representative of a Search Engine. Technical Report, DePaul University, 2000.
19. U. Manber, P. Bigot. The Search Broker. USENIX Symposium on Internet Technologies and Systems, 1997.
20. W. Meng, K. Liu, C. Yu, X. Wang, Y. Chang, N. Rishe. Determine Text Databases to Search in the Internet. VLDB, 1998.
21. W. Meng, K. Liu, C. Yu, W. Wu, N. Rishe. Estimating the Usefulness of Search Engines. ICDE, 1999.
22. W. Meng, C. Yu, K. Liu. Detection of Heterogeneities in a Multiple Text Database Environment. CoopIS, 1999.
23. W. Meng, C. Yu, K. Liu. Building Effective and Efficient Metasearch Engines. Submitted to ACM Computing Surveys (under revision).
24. Resource Discovery in a Globally-Distributed Digital Library. Working Group Report, 1999 (http://www.iei.pi.cnr.it/DELOS/NSF/resourcediscovery.htm)
25. G. Salton and M. McGill, Introduction to Modern Information Retrieval. New York: McGraw-Hill, 1983.
26. E. Selberg, O. Etzioni. The MetaCrawler Architecture for Resource Aggregation on the Web. IEEE Expert, 1997.
27. A. Sugiura, O. Etzioni. Query Routing for Web Search Engines: Architecture and Experiments. WWW9 Conference, 2000.
28. E. Voorhees, N. Gupta, B. Johnson-Laird. The Collection Fusion Problem. TREC-3, 1995.
29. Z. Wu, W. Meng, C. Yu, Z. Li. Towards a Highly-Scalable and Effective Metasearch Engine. Technical Report, Dept. of CS, SUNY at Binghamton, 2001.
30. J. Xu, J. Callan. Effective Retrieval with Distributed Collections. ACM SIGIR Conference, pp. 112-120, Melbourne, Australia, 1998.
31. J. Xu and B. Croft. Cluster-based Language Models for Distributed Retrieval, ACM SIGIR, 1999.
32. C. Yu, K. Liu, W. Wu, W. Meng, N. Rishe. Finding the Most Similar Documents across Multiple Text Databases. IEEE ADL'99, 1999.
33. C. Yu, K. Liu, W. Meng, Z. Wu, N. Rishe. A Methodology for Retrieving Text Documents from Multiple Databases. IEEE Transactions on Knowledge and Data Engineering (to appear).
34. C. Yu, W. Meng. Principles of Database Query Processing for Advanced Applications. Morgan Kaufmann Publishers, San Francisco, 1998.
35. C. Yu, W. Meng, K. Liu, W. Wu, N. Rishe. Efficient and Effective Metasearch for a Large Number of Text Databases. CIKM'99, 1999.
36. C. Yu, W. Meng, K. Liu, W. Wu, N. Rishe. Efficient and Effective Metasearch for Text Databases Incorporating Linkages among Documents. ACM SIGMOD Conference, 2001 (to appear).
37. B. Yuwono, D. Lee. Server Ranking for Distributed Text Resource Systems on the Internet. DASFAA'97, 1997.