Using the revised EM algorithm to remove noisy data for improving the one-against-the-rest method in binary text classification

Information Processing and Management

Volumn 43, Issue 5, 2007, Pages 1281-1293

  Han, Hyoungdong ^a   Ko, Youngjoong ^b   Seo, Jungyun ^a  

^a Sogang University   (South Korea)

^b Dong A University   (South Korea)

Author keywords

Binary text classification; The EM algorithm; The one against the rest method; The sliding window technique

Indexed keywords

ALGORITHMS; DATA STRUCTURES; INFORMATION RETRIEVAL; SPURIOUS SIGNAL NOISE; TEXT PROCESSING;

BINARY TEXT CLASSIFICATION; EXPECTATION MAXIMIZATION (EM) ALGORITHMS; ONE AGAINST THE REST METHOD; SLIDING WINDOW TECHNIQUE;

CLASSIFICATION (OF INFORMATION);

EID: 34247349127     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2006.11.003     Document Type: Article

References (25)

1. Brill E. Transformation-based error-driven learning and natural language processing: a case study in part of speech tagging. Computational Linguistics 21 4 (1995) 543-566
2. Craven M., DiPasquo D., Freitag D., McCallum A., Mitchell T., Nigam K., et al. Learning to construct knowledge bases from the world wide web. Artificial Intelligence 118 1-2 (2000) 69-113
3. Dempster A., Laird N.M., and Rubin D. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society Series B 39 1 (1997) 1-38
4. Hsu C.W., and Lin C.J. A comparison of methods of multi-class support vector machines. IEEE Transactions on Neural Networks 13 (2002) 415-425
5. Joachims T. Text categorization with support vector machines: Learning with many relevant features. Proceedings of European conference on machine learning (ECML) (1998), Springer 137-142
6. Joachims T. Learning to classify text using support vector machines (2002), Kluwer Academic Publishers
7. Ko Y., Park J., and Seo J. Improving text categorization using the importance of sentences. Information Processing and Management 40 1 (2004) 65-79
8. Ko, Y., & Seo, J. (2004). Learning with unlabeled data for text categorization using a bootstrapping and a feature projection technique. In Proceedings of the 42nd annual meeting of the association for computational linguistics (ACL 2004), pp. 255-262.
9. Ko Y., and Seo J. Using the feature projection technique based on a normalized voting method for text categorization. Information Processing and Management 40 2 (2004) 191-208
10. Lee, C.H., Lin, C.R., & Chen, M.S. (2001). Sliding-window filtering: an efficient algorithm for incremental mining. In Proceedings of the tenth international conference on information and knowledge management, pp. 263-270.
11. Li, X., & Liu, B. (2003). Learning to classify text using positive and unlabeled data. In Proceedings of eighteenth international joint conference on artificial intelligence (IJCAI-03), pp. 587-594.
12. Liu, B., Lee, W.S., Yu, P.S., & Li, X. (2002). Partially Supervised Classification of Text Documents. In Proceedings of the nineteenth international conference on machine learning (ICML, 2000), Sydney, Australia, pp. 8-12.
13. Lewis, D.D. (1998). Naive (bayes) at forty: The independence assumption in information retrieval. In Proceedings of European conference on machine learning.
14. McCallum, A., & Nigam, K. (1998). A comparison of event models for Naive Bayes text classification. AAAI'98 workshop on learning for text categorization, pp. 41-48.
15. Merialdo B. Tagging english text with a probabilistic model. Computational Linguisitcs 20 2 (1994) 155-171
16. Mitchell T. Machine learning (1997), McGraw-Hill, New York
17. Roy, N., & McCallum, A. (2001). Toward optimal active learning through sampling estimation of error reduction. In Proceedings of 18th international conference on machine learning, pp. 441-448.
18. Salton G., Yang C., and Wang A. A vector space model for automatic indexing. Communications of the ACM 18 11 (1975) 613-620
19. Schohn, G., & Cohn, D. (2000). Less is more: active learning with support vector machines. In Proceedings of 17th international conference on machine learning, pp. 839-846.
20. Tong S., and Koller D. Support vector machine active learning with application to text classification. Journal of Machine Learning Research 2 (2001) 45-66
21. Yang Y. An evaluation of statistical approaches to text categorization. Journal of Information Retrieval 1 1/2 (1999) 67-88
22. Yang Y., Slattery S., and Ghani R. A study of approaches to hypertext categorization. Journal of Intelligent Information Systems 18 2 (2002)
23. Yu, H., Han, J., & Chang, K. (2002). PEBL: positive example based learning for web page classification using SVM. In Proceedings of international conference on knowledge discovery and data mining (KDD-02).
24. Zadrozny, B., & Elkan, C. (2001). Obtaining calibrated probability estimates from decision trees and nai{dotless}̈ve bayesian classifiers. In Proceedings of the Eighteenth International Conference on Machine Learning.
25. Zadrozny, B., & Elkan, C. (2002). Reducing multi-class to binary by coupling probability estimates. In Proceedings of International Conference on Knowledge Discovery and Data Mining (KDD-02).