A methodology to retrieve text documents from multiple databases

IEEE Transactions on Knowledge and Data Engineering

Volumn 14, Issue 6, 2002, Pages 1347-1361

  Yu, Clement ^a   Liu, King Lup ^b   Meng, Weiyi ^c   Wu, Zonghuan ^c   Rishe, Naphtali ^d  

^a 1120 Science and Engineering Offices   (United States)

^b DEPAUL UNIVERSITY   (United States)

^c State University of New York at Binghamton   (United States)

^d The Department of Electrical and Computer Engineering   (United States)

Author keywords

Database selection; Distributed information retrieval; Metasearch; Resource discovery

Indexed keywords

ALGORITHMS; DISTRIBUTED DATABASE SYSTEMS; METADATA; QUERY LANGUAGES; SEARCH ENGINES; VECTORS; WORLD WIDE WEB;

DATABASE SELECTION; RESOURCE DISCOVERY;

INFORMATION RETRIEVAL;

EID: 0036858497     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2002.1047772     Document Type: Article

References (39)

1. C. Baumgarten, "A Probabilistic Model for Distributed Information Retrieval," Proc. ACM Special Interest Group on Information Retrieval Conf., pp. 258-266, July, 1997.
2. C. Baumgarten, "A Probabilistic Solution to the Selection and Fusion Problem in Distributed Information Retrieval," Proc. ACM Special Interest Group on Information Retrieval Conf., pp. 246-253, Aug. 1999.
3. N.J. Belkin, P. Kantor, E.A. Fox, and J.A. Shaw, "Combining the Evidence of Multiple Query Representations for Information Retrieval," Information Processing & Management, vol. 31, no, 3, pp. 431-448, May-June, 1995.
4. S. Brin and L. Page, "The Anatomy of a Large-Scale Hypertextual Web Search Engine," Proc. Seventh World Wide Web Conf., Apr. 1998.
5. J. Callan, Z. Lu, and W. Bruce Croft, "Searching Distributed Collections with Inference Networks," Proc. ACM Special Interest Group on Information Retrieval Conf. pp. 21-28, July 1995.
6. D. Dreilinger and A. Howe, "Experiences with Selecting Search Engines Using Metasearch," ACM Trans. Information Systems, vol. 15, no. 3, July 1997.
7. Y. Fan and S. Gauch, "Adaptive Agents for Information Gathering from Multiple, Distributed Information Sources," Proc. AAAI Symp. Intelligent Agents in Cyberspace, Mar. 1999.
8. J. French, "Evaluating Database Selection Techniques: A Testbed and Experiment," Proc. ACM Special Interest Group on Information Retrieval Conf., pp. 121-129, Aug. 1998.
9. J. French, "Comparing the Performance of Database Selection Algorithms," Proc. ACM Special Interest Group on Information Retrieval Conf., pp. 238-245, Aug. 1999.
10. N. Fuhr, "A Decision-Theoretic Approach to Database Selection in Networked IR," ACM Trans. Information Systems, vol. 17, no. 3, pp. 229-249, July 1999.
11. G. Furnas, "Information Retrieval Using a Singular Value Decomposition Model of Latent Semantic Structure," Proc. ACM Special Interest Group on Information Retrieval Conf., pp. 465-480, June 1988.
12. S. Gauch, G. Wang, and M. Gomez, "ProFusion: Intelligent Fusion from Multiple, Distributed Search Engines," J. Universal Computer Science, vol. 2, no. 9, pp. 637-649, 1996.
13. S. Gauch, J. Wang, and S. Rachakonda, "A Corpus Analysis Approach for Automatic Query Expansion and Its Extension to Multiple Databases," Proc. ACM Trans. Information Systems, vol. 17, no. 3, pp. 250-269, July 1999.
14. L. Gravano and H. Garcia-Molina, "Generalizing GlOSS to Vector-Space databases and Broker Hierarchies," Int'l Conf. Very Large Data Bases, pp. 78-89, Sep. 1995.
15. L. Gravano and H. Garcia-Molina, "Generalizing GlOSS to Vector-Space databases and Broker Hierarchies," technical report, Computer Science Dept., Stanford Univ., 1995.
16. L. Gravano and H. Garcia-Molina, "Merging Ranks from Heterogeneous Internet Sources," Int'l Conf. Very Large Data Bases, pp. 196-205, Aug. 1997.
17. A. Howe and D. Dreilinger, "SavvySearch: A Meta-Search Engine that Learns Which Search Engines to Query," AI Magazine, vol. 18, no. 2, 1997.
18. B. Jansen, A. Spink, J. Bateman, and T. Saracevic, "Real Life Information Retrieval: A Study of User Queries on the Web," Proc. ACM Special Interest Group on Information Retrieval Forum, vol. 32, no. 1, 1998.
19. B. Kahle and A. Medlar, "An Information System for Corporate Users: Wide Area information Servers," Technical Report TMC199, Thinking Machine Corporation, Apr. 1991.
20. S. Kirsch, "The Future of Internet Search: Infoseek's Experiences Searching the Internet" Proc. ACM Special Interest Group on Information Retrieval Forum, vol. 32, no. 2, pp. 3-7, 1998.
21. J. Kleinberg, "Authoritative Sources in Hyperlinked Environment," ACM-SIAM Symp. Discrete Algorithms, 1998.
22. G. Kowalski, Information Retrieval Systems, Theory and Implementation. Kluwer Academic, 1997.
23. K. Kwok, M. Chan, "Improving Two-Stage Ad-Hoc Retrieval for Short Queries," Proc. ACM Special Interest Group on Information Retrieval Conf., pp. 250-256, Aug. 1998.
24. S. Lawrence and C.L. Giles, "Searching the World Wide Web," Science, vol. 280, pp. 98-100, Apr. 1998.
25. S. Lawrence and C.L. Giles, "Accessibility of Information on the Web," Nature, vol. 400, pp. 107-109, July 1999.
26. K. Liu, C. Yu, W. Meng, W. Wu, and N. Rishe, "A Statistical Method for Estimating the Usefulness of Text Databases," IEEE Trans. Knowledge and Data Eng., vol. 14, no. 6, Nov./Dec. 2002.
27. W. Meng, K.-L. Liu, C. Yu, X. Wang, Y. Chang, and N. Rishe, "Determining Text Databases to Search in the Internet," Proc. Int'l Conf. Very Large Data Bases, pp. 14-25, Aug. 1998.
28. W. Meng, K. Liu, C. Yu, W. Wu, and N. Rishe, "Estimating the Usefulness of Search Engines," Proc. IEEE Int'l Conf. Data Eng., pp. 146-153, Mar. 1999.
29. G. Salton and M. McGill, Introduction to Modern Information Retrieval. New York: McCraw-Hill, 1983.
30. G. Salton, Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer. Addison Wesley, 1989.
31. E. Selberg and O. Etzioni, "Multiservice Search and Comparison Using the MetaCrawler," Proc. Fourth Int'l World Wide Web Conf., Dec. 1995.
32. E. Selberg and O. Etzioni, "The MetaCrawler Architecture for Resource Aggregation on the Web," IEEE Expert, 1997.
33. A. Singhal, C. Buckley, and M. Mitra, "Pivoted Document Length Normalization," Proc. ACM Special Interest Group on Information Retrieval Conf., pp. 21-29, Aug. 1996.
34. E. Voorhees, N. Gupta, and B. Johnson-Laird, "Learning Collection Fusion Strategies," Proc. ACM Special Interest Group on Information Retrieval Conf., pp. 172-179, July 1995.
35. J. Xu and J. Callan, "Effective Retrieval with Distributed Collections," Proc. ACM Special Interest Group on Information Retrieval Conf., pp. 112-120, Aug. 1998.
36. C. Yu, K. Liu, W. Wu, W. Meng, and N. Rishe, "Finding the Most Similar Documents across Multiple Text Databases," Proc. IEEE Conf. Advancements in Digital Libraries, pp. 150-162, May 1999.
37. C. Yu, W. Meng, K. Liu, W. Wu, and N. Rishe, "Efficient and Effective Metasearch for a Large Number of Text Databases," Proc. Eighth ACM Int'l Conf. Information and Knowledge Management, pp. 217-224, Nov. 1999.
38. C. Yu and W. Meng, Principles of Database Query Processing for Advanced Applications. Morgan Kaufmann, 1998.
39. B. Yuwono and D. Lee, "Server Ranking for Distributed Text Resource Systems on the Internet," Proc. Fifth Int'l Conf. Database Systems for Advanced Applications, pp. 391-400, Apr. 1997.