Improved adaptive splitting and selection: The hybrid training method of a classifier based on a feature space partitioning

International Journal of Neural Systems

Volumn 24, Issue 3, 2014, Pages

  Jackowski, Konrad ^a,b   Krawczyk, Bartosz ^b   Woźniak, MichaŁ ^b  

^a VSB TECHNICAL UNIVERSITY OF OSTRAVA   (Czech Republic)

^b WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

classifier ensemble; Combined classifier; evolutionary algorithm; hybrid algorithm; Machine learning; pattern classification

Indexed keywords

CLASSIFICATION ACCURACY; CLASSIFIER ENSEMBLES; COMBINED CLASSIFIERS; COMPOUND CLASSIFIERS; FEATURE SPACE PARTITIONING; HYBRID ALGORITHMS; TRAINING ALGORITHMS; TRAINING PROCEDURES;

EVOLUTIONARY ALGORITHMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; PATTERN RECOGNITION;

LAKES;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; HUMAN; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; HUMANS; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 84896878762     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065714300071     Document Type: Article

References (44)

1. L. I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms (Wiley-Interscience, 2004).
2. M. Wózniak, M. Grana and E. Corchado, A survey of multiple classifier systems as hybrid systems, Inform. Fusion 16 (2014) 3-17.
3. A. Krogh and J. Vedelsby, Neural network ensembles, cross validation, and active learning, in Advances in Neural Information Processing Systems, Vol. 7 (MIT Press, 1995), pp. 231-238.
4. G. Brown, J. L. Wyatt, R. Harris and X. Yao, Diversity creation methods: A survey and categorisation, Inform. Fusion 6(1) (2005) 5-20.
5. G. Giacinto, F. Roli and G. Fumera, Design of effective multiple classifier systems by clustering of classifiers, in 15th Int. Conf. Pattern Recognition, 2000. Proc., Vol. 2 (2000), pp. 160-163.
6. T. G. Dietterich and G. Bakiri, Solving multiclass learning problems via error-correcting output codes, J. Artif. Intell. Res. 2 (1995) 263-286.
7. M. A. H. Akhand, M. M. Islam and K. Murase, A comparative study of data sampling techniques for constructing neural network ensembles. Int. J. Neural Syst. 19(2) (2009) 67-89.
8. M. A. H. Akhand and Kazuyuki Murase, Ensembles of neural networks based on the alteration of input feature values, Int. J. Neural Syst. 22(1) (2012) 77-87.
9. A. Pavlo, E. Paulson, A. Rasin, D. J. Abadi, D. J. DeWitt, S. Madden and M. Stonebraker, A comparison of approaches to large-scale data analysis, in Proc. 2009 ACM SIGMOD Int. Conf. Management of Data, SIGMOD '09 (ACM, New York, NY, USA, 2009), pp. 165-178.
10. S. Ghosh-Dastidar, H. Adeli and N. Dadmehr, Principal component analysis-enhanced cosine radial basis function neural network for robust epilepsy and seizure detection, IEEE Trans. Biomed. Eng. 55(2) (2008) 512-518.
11. L. Breiman, Bagging predictors, Mach. Learn. 24(2) (1996) 123-140. (Pubitemid 126724382)
12. R. E. Schapire, The boosting approach to machine learning: An overview, MSRI Workshop on Nonlinear Estimation and Classification, Berkeley, CA, USA (2001).
13. R. Scherer, Designing boosting ensemble of relational fuzzy systems, Int. J. Neural Syst. 20(5) (2010) 381-388.
14. R. E. Schapire, The strength of weak learnability, Mach. Learn. 5(2) (1990) 197-227.
15. T. K. Ho, The random subspace method for constructing decision forests, IEEE Trans. Pattern Anal. Mach. Intell. 20 (1998) 832-844. (Pubitemid 128741345)
16. R. K. Bryll, R. Gutierrez-Osuna and F. K. H. Quek, Attribute bagging: Improving accuracy of classifier ensembles by using random feature subsets, Pattern Recogn. 36(6) (2003) 1291-1302. (Pubitemid 36225868)
17. L. Breiman, Random forests, Mach. Learn. 45(1) (2001) 5-32. (Pubitemid 32933532)
18. M. Skurichina and R. P. W. Duin, Bagging, boosting and the random subspace method for linear classifiers, Pattern Anal. Appl. 5(2) (2002) 121-135. (Pubitemid 40830126)
19. S. D. Bay, Nearest neighbor classification from multiple feature subsets, Intell. Data Anal. 3(3) (1999) 191-209. (Pubitemid 33260733)
20. G. Tremblay, R. Sabourin and P. Maupin, Optimizing nearest neighbour in random subspaces using a multi-objective genetic algorithm, in Proc. 17th Int. Conf. Pattern Recognition (ICPR'04), Vol. 1 (IEEE Computer Society, Washington, DC, USA, 2004), p. 208.
21. L. A. Rastrigin and R. H. Erenstein, Method of Col lective Recognition (Energoizdat, Moscow, 1981).
22. Y. Baram, Partial classification: The benefit of deferred decision, IEEE Trans. Pattern Anal. Mach. Intell. 20(8) (1998) 769-776. (Pubitemid 128741340)
23. L. I. Kuncheva, Clustering-and-selection model for classifier combination, in Fourth Int. Conf. Knowledge-Based Intelligent Engineering Systems and Allied Technologies, 2000. Proc., Vol. 1 (2000), pp. 185-188.
24. K. Jackowski and M. Wózniak, Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas, Pattern Anal. Appl. 12(4) (2009) 415-425.
25. H. M. Lee, C. M. Chen, J. M. Chen and Y. L. Jou, An efficient fuzzy classifier with feature selection based on fuzzy entropy, IEEE Trans. Syst., Man, Cyberne. B, Cybern. 31(3) (2001) 426-432.
26. J. H. Hong, J. K. Min, U. K. Cho and S. B. Cho, Fingerprint classification using one-vs-all support vector machines dynamically ordered with naïve bayes classifiers, Pattern Recogn. 41 (2008) 662-671.
27. G. Giacinto and F. Roli, Dynamic classifier selection based on multiple classifier behaviour, Pattern Recogn. 34(9) (2001) 1879-1881.
28. M. de Souto, R. Soares, A. Santana and A. Canuto, Empirical comparison of dynamic classifier selection methods based on diversity and accuracy for building ensembles, IEEE Int. Joint Conf. Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence) (2008) June 2008, pp. 1480-1487.
29. T. Woloszynski, M. Kurzynski, P. Podsiadlo and G. W. Stachowiak, A measure of competence based on random classification for dynamic ensemble selection. Inform. Fusion 13(3) (2012) 207-213.
30. K. Jackowski and M. Wózniak, Method of classifier selection using the genetic approach, Exp. Syst. 27(2) (2010) 114-128.
31. M. Wózniak and B. Krawczyk, Combined classifier based on feature space partitioning, J. Appl. Math. Comput. Sci. 22(4) (2012) 855-866.
32. K. Jackowski, B. Krawczyk and M. Wózniak, Cost-sensitive splitting and selection method for medical decision support system, in Intelligent Data Engineering and Automated Learning-IDEAL 2012, eds. H. Yin, J. A. F. Costa and G. Barreto, of Lecture Notes in Computer Science, Vol. 7435 (Springer Berlin Heidelberg, 2012), pp. 850-857.
33. R. O. Duda, P. E. Hart and D. G. Stork, Pattern Classification, 2nd edn. (Wiley, New York, 2001).
34. M. Ahmadlou and H. Adeli, Enhanced probabilistic neural network with local decision circles: A robust classifier, Integr. Comput.-Aided Eng. 17(3) (2010) 197-210.
35. N. Siddique and H. Adeli, Computational Intelligence: Synergies of Fuzzy Logic, Neural Networks and Evolutionary Computing (Wiley-Interscience, 2013).
36. A. K. Jain, M. N. Murty and P. J. Flynn, Data clustering: A review, ACM Comput. Surv. 31(3) (1999) 316-323. (Pubitemid 129686514)
37. S. Cost and S. Salzberg, A weighted nearest neighbor algorithm for learning with symbolic features, Mach. Learn. 10 (1993) 57-78.
38. L. I. Kuncheva, C. J. Whitaker, C. A. Shipp and R. P. W. Duin, Limits on the majority vote accuracy in classifier fusion, Pattern Anal. Appl. 6(1) (2003) 22-31. (Pubitemid 36719921)
39. T. Back, D. Fogel and Z. Michalewicz, Handbook of Evolutionary Computation (Oxford Univ. Press, 1997).
40. E. Alpaydin, Introduction to Machine Learning (The MIT Press, 2004).
41. A. Frank and A. Asuncion, UCI machine learning repository (2010), Available at http://archive.ics. uci.edu/ml.
42. R Development Core Team, R: A Language and Environment for Statistical Computing (R Foundation for Statistical Computing, Vienna, Austria, 2008).
43. E. Alpaydin, Combined 5×2 cv f test for comparing supervised classification learning algorithms, Neural Comput. 11(8) (1999) 1885-1892.
44. J. Demsar, Statistical comparisons of classifiers over multiple data sets, J. Mach. Learn. Res. 7 (2006) 1-30. (Pubitemid 43022939)