A Naïve bayes classifier for web document summaries created by using word similarity and significant factors

International Journal on Artificial Intelligence Tools

Volumn 19, Issue 4, 2010, Pages 465-486

  Pera, Maria Soledad ^a   Ng, Yiu Kai ^a  

^a 3361 TMCB   (United States)

Author keywords

Multinomial Na ve Bayes classifier; sentence based summaries; significant factors; word correlation

Indexed keywords

BAYES CLASSIFIER; CLASSIFICATION PROCESS; CLASSIFICATION TIME; CORRELATION FACTORS; DATA SETS; DOCUMENT SUMMARIZATION; EXTRACTIVE SUMMARIZATIONS; HIGH QUALITY; INFORMATION NEED; INFORMATION SEARCH PROCESS; MULTINOMIALS; NEWSGROUPS; PRE-DEFINED CLASS; SENTENCE-BASED SUMMARIES; SIGNIFICANT FACTORS; TEXT CLASSIFICATION; WEB DOCUMENT; WORD CORRELATION; WORD SIMILARITY;

CLASSIFICATION (OF INFORMATION); CLASSIFIERS; TEXT PROCESSING; WORLD WIDE WEB;

INFORMATION RETRIEVAL SYSTEMS;

EID: 77956029713     PISSN: 02182130     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218213010000285     Document Type: Conference Paper

References (35)

1. L. Antiqueira, O. Oliveira, L. Costa, and M. Nunes. A Complex Network Approach to Text Summarization. Information Sciences: An International Journal, 179(5):584-599, 2009.
2. M. Binwahlan, N. Salim, and L. Suanmali. Swarm Based Text Summarization. In Proceedings of International Association of Computer Science and information Tech-nology -Spring Conference, pages 145-150, 2009.
3. S. Brin and L. Page. The Anatomy of a Large-Scale HypertextualWeb Search Engine. Computer Networks and ISDN Systems, 30:1-7, 1998.
4. O. Buyukkokten, O. Kaljuvee, H. Garcia-Molina, A. Paepcke, and T. Winograd. Ef-ficient Web Browsing on Handheld Devices Using Page and Form Summarization. ACM Transactions on Information Systems (TOIS), 20(1):82-115, 2002.
5. L. da F. Costa, F. Rodriguez, G. Travieso, and P. Villas Boas. Characterization of Complex Networks: A Survey of Measurements. Advances in Physics, 56(1):167-242, 2007.
6. D. Das and A. Martins. A Survey on Automatic Text Summarization. Literature Survey for the Language and Statistics II Course at CMU, 2007.
7. D. Dunlavy, D. O'Leary, J. Conroy, and J. Schlesinger. QCS: A System for Querying, Clustering and Summarizing documents. Information Processing and Management, 43(6):1588-1605, 2007.
8. M. Fattah and F. Ren. GA, MR, FFNN, PNN and GMM Based Models for Automatic Text Summarization. Computer, Speech and Language, 23(1):126-144, 2009.
9. Y. Gong. Generic Text Summarization Using Relevance Measure and Latent Semantic Analysis. In Proceedings of International Conference on Research and Development in Information Retrieval (ACM SIGIR), pages 19-25, 2001.
10. P. Judea. Probabilistic Reasoning in the Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, 1988.
11. J. Kleinberg. Authoritative Sources in Hyperlink Environment. JACM, 46(5):604-632, 1999.
12. J. Koberstein and Y.-K. Ng. Using Word Clusters to Detect Similar Web Documents. In Proceedings of International Conference on Knowledge Science, Engineering and Management (KSEM), pages 215-228, 2006.
13. A. Kolcz. Local Sparsity Control for Naive Bayes with Extreme Misclassification Costs. In Proceedings of International Conference on Knowledge Discovery and Data Mining (KDD), pages 128-137, 2005.
14. K. Lang. Newsweeder: Learning to Filter Netnews. In Proceedings of International Conference on Machine Learning (ICML), pages 331-339, 1997.
15. L. Li, K. Zhou, G. Xue, H. Zha, and Y. Yu. Enhancing Diversity, Coverage and Bal-ance for Summarization through Structure Learning. In Proceedings of International Conference on World Wide Web (WWW), pages 71-80, 2009.
16. C. Lin. ROUGE: A Package for Automatic Evaluation of Summaries. In Proceedings of ACL Workshop on Text Summarization Branches Out, pages 74-81, 2004.
17. X. Liu, J. Webster, and C. Kit. An Extractive Text Summarizer Based on Significant Words. Lecture Notes in Artificial Intelligence, 5459:168-178, 2009.
18. E. Lloret andM. Palomar. A Gradual Combination of Features for Building Automatic Summarization Systems. Lecture Notes in Artificial Intelligence, 5729:16-23, 2009.
19. G. Luger. Artificial Intelligence: Structures and Strategies for Complex Problem Solv-ing, 6th Ed. Addison Wesley, 2009.
20. H. Luhn. The Automatic Creation of Literature Abstracts. IBM Journal of Research and Development, 2(2):159-165, 1958.
21. A. Martins and N. Smith. Summarization with a Joint Model for Sentence Extraction and Compression. In Proceedings of the Association for Computational Linguistics Workshop on Integer Linear Programming for Natural Language Processing, pages 1-9, 2009.
22. A. McCallum and K. Nigam. A Comparison of Event Models for Naive Bayes Text Classification. In Proceedings of Workshop on Learning for Text Categorization, pages 41-48, 1998.
23. R. Mihalcea and S. Hassan. Recent Advances in Natural Language Processing IV, chapter Text Summarization for Improved Text Classification. John Benjamins, 2006.
24. R. Mihalcea and P. Tarau. A Language Independent Algorithm for Single and Mul-tiple Document Summarization. In Proceedings of International Joint Conference on Natural Language Processing (IJCNLP), pages 19-24, 2005.
25. K. Nigam, J. Lafferty, and A. McCallum. Using Maximum Entropy for Text Classi-fication. In Proceedings of Workshop on Machine Learning for Information Filtering, pages 61-67, 1999.
26. L. Qiu, B. Pang, S. Lin, and P. Chen. A Novel Approach to Multi-document Summa-rization. In Proceedings of International Conference on Database and Expert Systems Applications (DEXA), pages 187-191, 2007.
27. D. Radev. Text summarization. International Conference on Research and Develop-ment in Information Retrieval Tutorial, 2004.
28. D. Radev, E. Hovy, and K. McKeown. Introduction to the Special Issue on Summa-rization. Computational Linguistics, 28(4):399-408, 2002.
29. K. Sarinnapakorn and M. Kubat. Combining Subclassifiers in Text Categorization: A DST-Based Solution and a Case Study. IEEE TKDE, 19(12):1638-1651, 2007.
30. D. Shen, Z. Chen, Q. Yang, H. Zeng, B. Zhang, Y. Lu, and W. Ma. Web-page Classi-fication Through Summarization. In Proceedings of International Conference on Re-search and Development in Information Retrieval (ACM SIGIR), pages 242-249, 2004.
31. D. Shen, J. Sun, H. Li, Q. Yang, and Z. Chen. Document Summarization Using Con-ditional Random Fields. In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), pages 2862-2867, 2007.
32. X. Wang and J. Yang. CollabSum: Exploiting Multiple Document Clustering for Col-laborative Single Document Summarizations. In Proceedings of International Confer-ence on Research and Development in Information Retrieval (ACM SIGIR), pages 143-150, 2007.
33. Y. Yang. An Example-Based Mapping Method for Text Categorization and Retrieval. ACM Transactions on Information Systems (TOIS), 12(3):253-277, 1994.
34. Y. Yang and J. Pedersen. A Comparative Study on Feature Selection in Text Cate-gorization. In Proceedings of International Conference on Machine Learning (ICML), pages 412-420, 1997.
35. P. Zhang and C. Li. Automatic Text Summarization Based on Sentences Cluster-ing and Extraction. In Proceedings of IEEE International Conference on Computer Science and Information Technology (ICCSIT), pages 167-170, 2009.