Building domain-specific Web collections for scientific digital libraries: A meta-search enhanced focused crawling method

Proceedings of the ACM IEEE International Conference on Digital Libraries, JCDL 2004

Volumn , Issue , 2004, Pages 135-141

  Qin, Jialun ^a   Zhou, Yilu ^a   Chau, Michael ^b  

^a UNIVERSITY OF ARIZONA   (United States)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Digital libraries; Domain specific collection building; Focused crawling; Meta search; Web search algorithm

Indexed keywords

ALGORITHMS; MATHEMATICAL MODELS; METADATA; NANOTECHNOLOGY; PORTALS; SEARCH ENGINES; VECTORS; WEBSITES;

DOMAIN-SPECIFIC COLLECTION BUILDING; FOCUSED CRAWLING; META-SEARCH; WEB SEARCH ALGORITHM;

DIGITAL LIBRARIES;

EID: 4944246916     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Bergmark, D. (2002a). "Collection Synthesis," in Proc. of Joint Conference on Digital Libraries 2002, Portland, Oregon, USA.
2. Bergmark, D., Lagoze, C. and Sbityakov, A. (2002b). "Focused Crawls, Tunneling, and Digital Libraries", in Proc. of the 6th European Conference on Digital Libraries, Rome, Italy.
3. Bowman, C., Danzig, P., Manber, U. and Schwartz, M. (1994). "Scalable Internet Resource Discovery: Research Problems and Approaches," Communications of the ACM, 37(8), 98-107.
4. Brin, S. and Page, L. (1998). "The Anatomy of a Large-Scale Hypertextual Web Search Engine," Computer Networks and ISDN Systems, 30(1-7).
5. th International World Wide Web Conference, Toronto, Canada.
6. Chau, M. and Chen, H. (2003). "Comparison of Three Vertical Search Spiders," IEEE Computer, 36(5), 56-62.
7. Chau, M., Chen, H., Qin, J., Zhou, Y., Sung, W., Chen, Y., Qin, Y., McDonald, D., Lally, A. M. and Landon, M. (2002). "NanoPort: a web portal for nanoscale science and technology" in Proc. of Joint Conference on Digital Libraries 2002, Portland, Oregon, USA.
8. Chen, H., Chung, Y., Ramsey, M. and Yang, C. (1998). "A Smart Itsy-Bitsy Spider for the Web," JASIS, 49(7), 604-618.
9. th International World Wide Web Conference, Toronto, Canada.
10. th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Boston, Massachusetts, USA.
11. Gibson, D., Kleinberg, J. and Raghavan, P. (1998). "Inferring Web Communities from Link Topology," in Proc. of the 9th ACM Conference on Hypertext and Hypermedia, Pittsburgh, Pennsylvania, USA.
12. Kleinberg, J. M. (1998). "Authoritative Sources in a Hyperlinked Environment," in Proc. of the ACM-SIAM Symposium on Discrete Algorithms, San Francisco, California, USA.
13. th International Computing and Combinatorics Conference, Tokyo, Japan.
14. Kluev, V. (2000). "Compiling Document Collections from the Internet," SIGIR Forum, 34(2).
15. th International Conference on Very Large Data Bases Conference, Edinburgh, Scotland, UK.
16. th International World Wide Web Conference, Toronto, Canada.
17. Lawrence, S. and Giles, C. L. (1998). "Searching the World Wide Web," Science, 280(5360):98.
18. Manber, U., Smith, M., and Gopal, B. (1997). "WebGlimpse: Combining Browsing and Searching," in Proceedings of the USENIX1997 Annual Technical Conference, Anaheim, California, Jan 1997.
19. McCallum, A., Nigam, K., Rennie, J. and Seymore, K. (1999). "Building Domain-Specific Search Engines with Machine Learning Techniques," in Proc. AAAI-99 Spring Symposium on Intelligent Agents in Cyberspace.
20. Salton, G. (1989). "Automatic Text Processing," MA: Addison-Wesley, 1989.
21. Sumner, R. G., Jr., Yang, K., and Dempsey, B. J. (1998). "An Interactive WWW Search Engine for User-defined Collections," in Proceedings of the 3rd ACM Conference on Digital Libraries, Pittsburgh, Pennsylvania, USA, Jun 1998, pp. 307-308.
22. Toyoda, M. and Kitsuregawa, M. (2001). "Creating a Web Community Chart for Navigating Related Communities," in Proc. of ACM Conference on Hypertext and Hypermedia, Århus, Denmark.