Noise reduction through summarization for Web-page classification

Information Processing and Management

Volumn 43, Issue 6, 2007, Pages 1735-1747

  Shen, Dou ^a   Yang, Qiang ^a   Chen, Zheng ^b  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

Content Body; Noise reduction; Web page categorization; Web page summarization

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); TEXT PROCESSING; WEBSITES;

CONTENT BODY; WEB-PAGE CATEGORIZATION; WEB-PAGE SUMMARIZATION;

NOISE ABATEMENT;

EID: 34547955345     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2007.01.013     Document Type: Article

References (40)

1. Alpaydin E. Introduction to machine learning (2004), The MIT Press
2. Attardi, G., Gullí, A., & Sebastiani, F. (1999). Automatic web page categorization by link and context analysis. In C. Hutchison, G. Lanzarone (Eds.), Proceedings of THAI-99, first European symposium on telematics, hypermedia and artificial intelligence (pp. 105-119). Varese, IT.
3. Berger, A. L., & Mittal, V. O. (2000). Ocelot: A system for summarizing web pages. In SIGIR'00: Proceedings of the 23rd annual international ACM SIGIR conference on research and development in information retrieval (pp. 144-151).
4. Berry M.W., Dumais S.T., and O'Brien G.W. Using linear algebra for intelligent information retrieval. SIAM Review 37 4 (1995) 573-595
5. Buyukkokten, O., Garcia-Molina, H., & Paepcke, A. (2001). Seeing the whole in parts: Text summarization for web browsing on handheld devices. In WWW'01: Proceedings of the 10th international conference on World Wide Web (pp. 652-662).
6. Chakrabarti S., Dom B.E., and Indyk P. Enhanced hypertext categorization using hyperlinks. In: Haas L.M., and Tiwary A. (Eds). Proceedings of SIGMOD-98, ACM international conference on management of data (1998), ACM Press, New York, US, Seattle, US 307-318
7. Chen H., and Dumais S.T. Bringing order to the web: Automatically categorizing search results. Proceedings of CHI-00, ACM international conference on human factors in computing systems (2000), ACM Press, New York, US, Den Haag, NL 145-152
8. Chen, Z., Liu, S., Liu, W., Pu, G., & Ma, W.-Y. (2003). Building a web thesaurus from web link structure. In SIGIR'03: Proceedings of the 26th annual international ACM SIGIR conference on research and development in informaion retrieval (pp. 48-55).
9. Chen, J., Zhou, B., Shi, J., Zhang, H., & Qiu, F. (2001). Function-based object model towards website adaptation. In WWW'01: Proceedings of the 10th international conference on World Wide Web (pp. 587-596).
10. Chuang, W. T., & Yang, J. (2000). Extracting sentence segments for text summarization: a machine learning approach. In: SIGIR'00: Proceedings of the 23rd annual international ACM SIGIR conference on research and development in information retrieval (pp. 152-159).
11. Cortes C., and Vapnik V. Support-vector networks. Machine Learning 20 3 (1995) 273-297
12. Deerwester S.C., Dumais S.T., Landauer T.K., Furnas G.W., and Harshman R.A. Indexing by latent semantic analysis. JASIS 41 6 (1990) 391-407
13. Delort, J.-Y., Bouchon-Meunier, B., & Rifqi, M. (2003). Web document summarization by context. In WWW (Posters).
14. Dietterich T.G. Ensemble methods in machine learning. MCS'00: Proceedings of the first international workshop on multiple classifier systems (2000), Springer-Verlag, London, UK 1-15
15. Glover E.J., Tsioutsiouliklis K., Lawrence S., Pennock D.M., and Flake G.W. Using web structure for classifying and describing web pages. Proceedings of WWW-02, international conference on the World Wide Web (2002), ACM Press, New York, US, Honolulu, US 562-569
16. Gong, Y., & Liu, X. (2001). Generic text summarization using relevance measure and latent semantic analysis. In SIGIR'01: Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval (pp. 19-25).
17. Hansen L.K., and Salamon P. Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence 12 10 (1990) 993-1001
18. Joachims T. Text categorization with support vector machines: Learning with many relevant features. In: Nédellec C., and Rouveirol C. (Eds). Proceedings of ECML-98, 10th European conference on machine learning (1998), Springer Verlag, Heidelberg, DE, Chemnitz, DE 137-142 published in the "Lecture Notes in Computer Science" series, number 1398
19. Joachims T. Transductive inference for text classification using support vector machines. In: Bratko I., and Dzeroski S. (Eds). Proceedings of ICML-99, 16th international conference on machine learning (1999), Morgan Kaufman, San Francisco, US, Bled, SL 200-209
20. Ker, S. J., & Chen, J.-N. (2000). A text categorization based on summarization technique. In Proceedings of the ACL-2000 workshop on recent advances in natural language processing and information retrieval (pp. 79-83).
21. Ko Y., Park J., and Seo J. Improving text categorization using the importance of sentences. Information Processing and Management 40 1 (2004) 65-79
22. Kolcz A., Prabakarmurthi V., and Kalita J.K. String match and text extraction: Summarization as feature selection for text categorization. In: Paques H., Liu L., and Grossman D. (Eds). Proceedings of CIKM-01 10th ACM international conference on information and knowledge management (2001), ACM Press, New York, US, Atlanta, US 365-370
23. Kupiec, J., Pedersen, J., & Chen, F. (1995). A trainable document summarizer. In SIGIR'95: Proceedings of the 18th annual international ACM SIGIR conference on research and development in information retrieval (pp. 68-73).
24. Lam W., and Han Y. Automatic textual document categorization based on generalized instance sets and a metamodel. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 5 (2003) 628-633
25. Landauer T.K., Foltz P.W., and Laham D. An introduction to latent semantic analysis. Discourse Processes 25 (1998) 259-284
26. Luhn H. The automatic creation of literature abstracts. IBM Journal of Research and Development 2 2 (1958)
27. McCallum, A., & Nigam, K. (1998). A comparison of event models for naive bayes text classification. In Proceedings of AAAI-98, workshop on learning for text categorization.
28. Mihalcea, R. (2005). Language independent extractive summarization. In AAAI (pp. 1688-1689).
29. Mitchell T.M. Machine learning (1997), McGraw-Hill Higher Education
30. Press W.H., Teukolsky S.A., Vetterling W.T., and Flannery B.P. Numerical recipes in C++: The art of scientific computing (1992), Cambridge University Press, New York
31. Sebastiani F. Machine learning in automated text categorization. ACM Computing Surveys 34 1 (2002) 1-47
32. Shen D., Chen Z., Yang Q., Zeng H.-J., Zhang B., Lu Y., et al. Web-page classification through summarization. SIGIR'04: Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval (2004), ACM Press, New York, NY, USA 242-249
33. Shen D., Pan R., Sun J.-T., Pan J.J., Wu K., Yin J., et al. Q2C@UST: Our winning solution to query classification in kddcup 2005. SIGKDD Explorations 7 2 (2005) 100-110
34. Sun J.-T., Shen D., Zeng H.-J., Yang Q., Lu Y., and Chen Z. Web-page summarization using clickthrough data. SIGIR'05: Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval (2005), ACM Press, New York, NY, USA 194-201
35. Teufel, S., & Moens, M. (1997). A comparison of event models for naive bayes text classification. In Proceedings of ACL/EACL-97: Workshop on intelligent and scalable text summarization.
36. van Rijsbergen C. Information retrieval. 2nd ed. (1979), Butterworth, London
37. Vapnik V.N. The nature of statistical learning theory (1995), Springer-Verlag New York, Inc., New York, NY, USA
38. Yang Y., and Pedersen J.O. A comparative study on feature selection in text categorization. In: Fisher D.H. (Ed). Proceedings of ICML-97, 14th international conference on machine learning (1997), Morgan Kaufman Publishers, San Francisco, US, Nashville, US 412-420
39. Yeh J.-Y., Ke H.-R., Yang W.-P., and Meng I.-H. Text summarization using a trainable summarizer and latent semantic analysis. Information Processing and Management 41 1 (2005) 75-95
40. Yi, L., Liu, B., & Li, X. (2003). Eliminating noisy information in web pages for data mining. In: KDD'03: Proceedings of the ninth ACM SIGKDD international conference on knowledge discovery and data mining (pp. 296-305).