Web page cleaning for web mining through feature weighting

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2003, Pages 43-48

  Yi, Lan ^a   Liu, Bing ^b  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b 1120 Science and Engineering Offices   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMON STRUCTURES; FEATURE WEIGHTING; LARGE AMOUNTS; NODE IMPORTANCE; WEB PAGE CLASSIFICATION; WEB PAGE CLUSTERING; WEB PAGE NOISE; WEIGHTING METHODS;

ARTIFICIAL INTELLIGENCE;

WEBSITES;

EID: 84880811191     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. James Allan, Jaime Carbonell, George Doddington, Jonathan Yamron, and Yiming Yang. Topic detection and tracking pilot study: final report. In Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop, 1998.
2. Michael R. Anderberg. Cluster analysis for applications, Academic Press, New York, 1973.
3. Ricardo Baeza-Yates and Berthier Ribeiro-Neto. Modern Information Retrieval. Addison Wesley, 1999.
4. Ziv Bar-Yossef and Sridhar Rajagopalan. Template detection via data mining and its applications, WWW-2002, 2002.
5. Doug Beeferman, Adam Berger, and John Lafferty. A model of lexical attraction and repulsion. ACL-I997, 1997.
6. Doug Beeferman, Adam Berger and John Lafferty. Statistical models for text segmentation. Machine Learning, 34 (1-3): 177-210, 1999.
7. Soumen Chakrabarti, Mukul M. Joshi and Vivek B. Tawde. Enhanced topic distillation using text, markup tags, and hyperlinks. SIGIR-2001.
8. David Eichmann, Miguel Ruiz, Padmini Srinivasan, Nick Street, Chris Cul and Filippo Menczer. A cluster-based approach to tracking, detection and segmentation of broadcast news. In Proceedings of the DARPA Broadcast News Workshop, 1999.
9. Marti A. Hearst and Christian Plaunt. Subtopic structuring for full-length document access. SJGIR-93, 1993.
10. Thorsten Joachims. Text categorization with support vector machines: learning with many relevant features. ECML-1997, 1997.
11. Thorsten Joachims. Making large-Scale SVM Learning Practical. Advances in Kernel Methods - Support Vector Learning, B. Scholkopf and C. Burges and A. Smola (ed.), MIT-Press, 1999.
12. Hung-Yu Kao, Ming-Syan Chen Shian-Hua Lin, and Jan-Ming Ho, Entropy-Based Link Analysis for Mining Web Informative Structures. C1KM-2002, 2002.
13. Stefan Kaufmann. Cohesion and collocation: Using context vectors in text segmentation. ACL-1999, 1999.
14. Jon M. Kleinberg. Authoritative sources in a hyperlinked environment. In Proceedings of the Ninth Annual ACM-S1AM Symposium on Discrete Algorithms, 1998.
15. Nicholas Kushmerick. Learning to remove Internet advertisements. Agnets-1999, 1999.
16. Mong Li Lee, Tok Wang Ling, Wai Lup Low. Intelliclean: A knowledge-based intelligent data cleaner. SIGKDD-2000, 2000.
17. Shian-Hua Lin and Jan-Ming Ho. Discovering informative content blocks from Web documents. SIGKDD-2002, 2002.
18. Jeffrey C. Reynar. Statistical Models for Topic Segmentation. ACL-99, 1999
19. Gerard Salton and Michael J. McGill. Introduction to Modern Information Retrieval. McGraw-Hill, 1983.
20. Shannon, C. A Mathematical Theory of Communication. Bell System TechnicalJournal, Vol 27, pp.379-423and 623-656, July and October, 1948.
21. Yiming Yang, Jan O. Pedersen. A comparative study of feature selection in text categorization. ICML-97, 1997.