Improving supervised learning performance by using fuzzy clustering method to select training data

Journal of Intelligent and Fuzzy Systems

Volumn 19, Issue 4-5, 2008, Pages 321-334

  Guan, Donghai ^a   Yuan, Weiwei ^a   Lee, Young Koo ^a   Gavrilov, Andrey ^a   Lee, Sungyoung ^a  

^a Kyung Hee University   (South Korea)

Author keywords

Border based selection; Center based selection; Classification; Data selection; Fuzzy clustering; Hybrid selection

Indexed keywords

DATA REDUCTION; FLOW OF SOLIDS; FUZZY SETS; FUZZY SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; SUPERVISED LEARNING;

BORDER-BASED SELECTION; CENTER-BASED SELECTION; CLASSIFICATION; DATA SELECTION; HYBRID SELECTION;

FUZZY CLUSTERING;

EID: 55349136231     PISSN: 10641246     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (36)

1. A.K. Jain, M.N. Murty and P.J. Flynn, Data clustering: a review, in: ACM Computing Surveys, 1999, 264-323.
2. X.J. Zhu, Semi-supervised learning literature survey, Technical report 1530, Computer Science, University of Wisconsin-Madiso, 2006.
3. D.D. Lewis and W.A. Gale, A sequential algorithm for training text classifiers, in: Proceedings of 17th ACM International Conference on Research and Development in Information Retrieval 1994, 3-12.
4. D. Mackay, Information-based objective functions for active data selection, Neural Computation 4(4) (1992), 305-318.
5. O. Chapelle, B. Scholkopf and A. Zien, Semi-Supervised Learning, MIT-Press, 2006.
6. A.P. Dempster, N.M. Laird and D.B. Rubin, Maximum like-lihood for incomplete data via the EM algorithm, Journal of Royal Statistical Society B39(1) (1977), 1-38.
7. B.M. Shahshahani and D.A. Landgrebe, The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenon, IEEE Transaction on Geoscience and Remote Sensing 32(5) (1994), 1087-1095.
8. D.J. Miller and H.S. Uyar, A mixture of experts classifier with learning based on both labeled and unlabelled data, Advances in Neural Information Processing Systems (1997), 571-577.
9. K. Nigam, A.K. Mccallum, S. Thrun and T. Mitchell, Text classification from labeled and unlabeled documents using EM, in: Proceedings of 17th International Conference on Machine Learning, 2000, 103-134.
10. K. Fukumizu, Stastical active learning in multilayer perceptrons, IEEE Transactions on Neural Networks 11(1) (2000), 17-26.
11. C. Campbell, N. Cristianini and A. Smola, Query learning with large margin classifiers, in: Proceedings of 17th International Conference on Machine Learning, 2000, 111-118.
12. S. Tong and D. Koller, Support vector machine active learning with application to text classification, Journal of Machine Learning Research 2 (2001), 45-66.
13. G. Schohn and D. Cohn, Less is more: active learning with support vector machines, in: Proceedings of 17th International Conference on Machine Learning, 2000, 839-846.
14. D.D. Lewis and J. Catlett, Heterogeneous uncertainty sampling for supervised learning, in: Proceedings of 11th International Conference on Machine Learning, 1994, 148-156.
15. C. Thompson, M.E. Califf and R.J. Mooney, Active learning for natural language parsing and information extraction, in: Proceeding of 16th International Conference on Machine Learning, 1999, 406-414.
16. M. Tang, X. Luo and S. Roukos, Active learning for statistical natural language parsing, in: Proceeding of 40th Anniversary Meeting of Association for Computational Linguistics, 2002, 120-127.
17. R. Hwa, On minimizing training corpus for parser acquisition, in: Proceeding of 5th Computational Natural Language Learning Workshop, 2001, 84-89.
18. D. Cohn, L. Atlas and R. Ladner, Improving generalization with active learning, Machine Learning Journal 15 (1994), 210-221.
19. I. Dagan and S.P. Engelson, Committee-based sampling for training probabilistic classifiers, in: Proceeding of 12th International Conference on Machine Learning, 1995, 150-157.
20. I.A. Muslea, Active learning with multiple views, Ph.D. dissertation, Univ. Southern California, 2000.
21. R. Liere, Active learning with committees: An approach to efficient learning in text categorization using linear threshold algorithms, Ph.D. dissertation, Oregon State Univ. 2000.
22. N. Cebron and M.R. Berthold, Adaptive Fuzzy Clustering, Annual meeting of the North American Fuzzy Information Processing Society, NAFIPS 2006, Digital Object Identifier: 10.1109/NAFIPS.2006.365406, Publication Date: 3-6 June 2006, ISBN: 1-4244-0363-4.
23. J. Kang, Kwang Ryel Ryu and Hyuk-Chul Kwon, Using Cluster-Based Sampling to Select Initial Training Set for Active Learning in Text Classification, The 8th Pacific-Asia Conference on Knowledge Discovery and Data Mining, 2004, 384-388.
24. H.T. Nguyen and A. Smeulders, Active learning using pre-clustering, in: Proceedings of the twenty-first international conference on Machine learning, 2004, 79-86.
25. M. Li and I.K. Sethi, Confidence-based active learning, IEEE Transaction on Pattern Analysis and Machine Intelligence 28(8) (2003), 1251-1261.
26. K. Brinker, Incorporating diversity in active learning with support vector machines, in: Proceedings of 20th International conference on machine learning, 2003, 59-66.
27. S. Hoi, R. Jin, J. Zhu and M. Lyu, Batch mode active learning and its application to medical image classification, in: Proceedings of the 23th International Conference on Machine Learning, 2006, 417-424.
28. S. Hoi, R. Jin and M. Lyu, Large-scale text categorization by batch mode active learning, in: Proceedings of the International World Wide Web Conference, 2006, 633-642.
29. G. Schohn and D. Cohn, Less is more: Active learning with support vector machines, in: Proceedings of the 17th International Conference on Machine Learning, 2000, 839-846.
30. Z. Xu, K. Yu, V. Tresp and J. Wang, Representative sampling for text classification using support vector machines, in: Proceedings of the 25th European Conference on Information Retrieval Research, 2003, 393-407.
31. J.C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, New York, 1981.
32. L.A. Zadeh, Fuzzy sets as a basis for a theory of possibility, Fuzzy Sets and Systems 1(1) (1978), 3-28.
33. Yashil, Fuzzy C-Means Clustering MATLAB Toolbox, http://ce.sharif.edu/ ~m_amiri/project/yfcmc/index.htm.
34. UCI Machine Learning Repository, http://www.ics.uci.edu/≫mlearn/ MLRepository.html.
35. S. Basu, Semi-supervised Clustering: Probabilistic Models, Algorithms and Experiments, Ph. D. Thesis, Department of Computer Science, University of Texas at Austin, 2005.
36. B. Kulis and R.J. Mooney, Semi-supervised graph clustering: A kernel approach, in: Proceedings of the 22nd International Conference on Machine Learning, 2005, 457-464.