Panorama: Extending digital libraries with topical crawlers

Proceedings of the ACM IEEE International Conference on Digital Libraries, JCDL 2004

Volumn , Issue , 2004, Pages 142-150

  Pant, Gautam ^a   Tsioutsiouliklis, Kostas ^b   Johnson, Judy ^b   Giles, C Lee ^c  

^a UNIVERSITY OF IOWA   (United States)

^b NEC LABORATORIES AMERICA   (United States)

^c PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Classification; Clustering; Digital libraries; Topical crawling; Web mining

Indexed keywords

CLUSTERING; TOPICAL CRAWLING; TREE SEARCH STRATEGIES; WEB MINING;

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); DATA STORAGE EQUIPMENT; GRAPH THEORY; INFORMATION RETRIEVAL; PROBLEM SOLVING; SEARCH ENGINES; TREES (MATHEMATICS); WORLD WIDE WEB;

DIGITAL LIBRARIES;

EID: 4944227235     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. C. C. Aggarwal, F. Al-Garawi, and P. S. Yu. Intelligent crawling on the World Wide Web with arbitrary predicates. In Proc. 10th Intl. World Wide Web conference, Hong Kong, May 2001.
2. D. Bergmark. Collection synthesis. In Proc. 2nd ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2002), pages 253-262, 2002.
3. D. Bergmark, C. Lagoze, and A. Sbityakov. Focused crawls, tunneling, and digital libraries. In 6th European Conference on Research and Advances Technology for Digital Technology (ECDL 2002), 2002.
4. K. Bharat and M. R. Henzinger. Improved algorithms for topic distillation in hyperlinked environments. In Proc. 21st Annual Intl. ACM SIGIR Conference on Research and Development in Information Retrieval, pages 104-111, 1998.
5. K. Bollacker, S. Lawrence, and C. L. Giles. A system for automatic personalized tracking of scientific literature on the Web. In Proc. 4th ACM Conference on Digital Libraries, pages 105-113, 1999.
6. P. P. Calado, M. A. Gonçalves, E. A. Fox, B. Ribeiro-Neto, A. H. F. Laender, A. S. da Silva, D. C. Reis, P. A. Roberto, M. V. Vieira, and J. P. Lage. The Web-DL environment for building digital libraries from the Web. In Proc. 3rd ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2003), 2003.
7. S. Chakrabarti, K. Punera, and M. Subramanyam. Accelerated focused crawling through online relevance feedback. In Proc. 11th Intl. World Wide Web Conference, Hawaii, May 2002.
8. S. Chakrabarti, M. van den Berg, and B. Dom. Focused crawling: A new approach to topic-specific Web resource discovery. Computer Networks, 31(11-16):1623-1640, 1999.
9. M. Chau, D. Zeng, and H. Chen. Personalized spiders for Web search and analysis. In Proc. 1st ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2001), 2001.
10. H. Chen and S. Dumais. Bringing order to the Web: automatically categorizing search results. In Proc. SIGCHI Conference on Human Factors in Computing Systems, 2000.
11. J. Cho, H. Garcia-Molina, and L. Page. Efficient crawling through URL ordering. Computer Networks, 30(1-7): 161-172, 1998.
12. M. Craven, D. DiPasquo, D. Freitag, A. K. McCallum, T. M. Mitchell, K. Nigam, and S. Slattery. Learning to extract symbolic knowledge from the World Wide Web. In Proc. AAAI-98, 15th Conference of the American Association for Artificial Intelligence, 1998.
13. D. R. Cutting, J. O. Pedersen, D. Karger, and J. W. Tukey. Scatter/gather: A cluster-based approach to browsing large document collections. In Proc. 15th Annual Intl. ACM SIGIR Conference on Research and Development in Information Retrieval, pages 318-329, 1992.
14. P. M. E. De Bra and R. D. J. Post. Information retrieval in the World Wide Web: Making client-based searching feasible. In Proc. 1st Intl. World Wide Web Conference, 1994.
15. M. Diligenti, F. Coetzee, S. Lawrence, C. L. Giles, and M. Gori. Focused crawling using context graphs. In Proc. 26th Intl. Conference on Very Large Data Bases (VLDB 2000), Cairo, Egypt, 2000.
16. H. Han, C. L. Giles, E. Manavoglu, H. Zha, Z. Zhang, and E. A. Fox. Automatic document metadata extraction using support vector machines. In Proc. 3rd ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2003), 2003.
17. J. Johnson, K. Tsioutsiouliklis, and C. L. Giles. Evolving strategies for focused Web crawling. In Proc. 20th Intl. Conference on Machine Learning (ICML 2003), Washington DC, 2003.
18. J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM, 46(5):604-632, 1999.
19. R. Kumar, P. Raghavan, S. Rajagopalan, and A. Tomkins. Trawling the Web for emerging cyber-communities. Computer Networks, 31(11-16):1481-1493, 1999.
20. F. Menczer and R. K. Belew. Adaptive retrieval agents: Internalizing local context and scaling up to the Web. Machine Learning, 39(2-3):203-242, 2000.
21. F. Menczer, G. Pant, M. Ruiz, and P. Srinivasan. Evaluating topic-driven Web crawlers. In Proc. 24th Annual Intl. ACM SIGIR Conference on Research and Development in Information Retrieval, 2001.
22. M. Porter. An algorithm for suffix stripping. Program, 14(3):130-137, 1980.
23. S. RaviKumar, P. Raghavan, S. Rajagopalan, D. Sivakumar, A. Tomkins, and E. Upfal. Stochastic models for the Web graph. In IEEE Symposium on Foundations of Computer Science (FOCS), pages 57-65, Nov. 2000.
24. D. G. Roussinov and H. Chen. Information navigation on the Web by clustering and summarizing query results. Information Processing & Management, 37(6):789-816, 2001.
25. G. Salton. The SMART Retrieval System - Experiments in automatic document processing. Prentice Hall Inc., Englewood Cliffs, NL, 1971.
26. G. Salton and M. J. McGill. Introduction to Modern Information Retrieval. McGraw-Hill, 1983.
27. Y. Wang and M. Kitsuregawa. Evaluating contents-link coupled Web page clustering for Web search results. In Proc. 11th Intl. Conference on Information and Knowledge Management, 2002.
28. I. H. Witten and E. Frank. Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann, 1999.
29. Y. Yang and J. O. Pedersen. A comparative study on feature selection in text categorization. In Proc. 14th Intl. Conference on Machine Learning (ICML 97), pages 412-420. Morgan Kaufmann Publishers, 1997.
30. O. Zamir and O. Etzioni. Grouper: a dynamic clustering interface to Web search results. Computer Networks, 31(11-16):1361-1374, 1999.
31. Y. Zhao and G. Karypis. Evaluation of hierarchical clustering algorithms for document datasets. In Proc. 11th Intl. Conference on Information and Knowledge Management, 2002.