Relationship between data size, accuracy, diversity and clusters in neural network ensembles

International Journal of Computational Intelligence and Applications

Volumn 12, Issue 4, 2013, Pages

  Chiu, Chien Yuan ^a   Verma, Brijesh ^a  

^a CENTRAL QUEENSLAND UNIVERSITY   (Australia)

Author keywords

data clustering; Ensemble of classifiers; neural networks

Indexed keywords

AS NUMBERS; BENCHMARK DATASETS; CLUSTERING DATA; DATA CLUSTERING; ENSEMBLE OF CLASSIFIERS; NEURAL NETWORK ENSEMBLES; NUMBER OF CLASS; TRAINING AND TESTING;

CLUSTERING ALGORITHMS;

NEURAL NETWORKS;

EID: 84890407171     PISSN: 14690268     EISSN: None     Source Type: Journal    
DOI: 10.1142/S1469026813400051     Document Type: Conference Paper

References (33)

1. C. Y. Chiu and B. Verma, An evolutionary algorithm based optimization of neural ensemble classifers, Int. Conf. Neural Information Processing (ICONIP, 2011), Shanghai, China, pp. 292-298.
2. N. M. Wanas, R. A. Dara and M. S. Kamel, Adaptive fusion and co-operative training for classifer ensembles, Pattern Recognit. 39 (2006) 1781-1794. (Pubitemid 43867570)
3. A. Rahman and B. Verma, Novel layered clustering based approach for generating ensemble of classifers, IEEE Trans. Neural Netw. 22(5) (2011) 781-792.
4. T. Windeatt, Accuracy/diversity and ensemble MLP classifer design, IEEE Trans. Neural Netw. 17(5) (2006) 1194-1211. (Pubitemid 46445178)
5. B. Verma and A. Rahman, Cluster-oriented ensemble classifer: Impact of multicluster characterization on ensemble classifer learning, IEEE Trans. Knowl. Data Eng. 24 (2012) 605-618.
6. A. Scherbart and T. W. Nattkemper, The diversity of regression ensembles combining bagging and random subspace method, Int. Conf. Neural Information Processing (ICONIP, 2008), Auckland, New Zealand, pp. 911-918.
7. L. I. Kuncheva and G. J. Whitaker, Measures of diversity in classifer ensembles and their relationship with the ensemble accuracy, Mach. Learn. 51(2) (2003) 181-207.
8. E. K. Tang, P. N. Suganthan and X. Yao, An analysis of diversity measure, Mach. Learn. 65 (2006) 247-271.
9. A. Rahman, B. Verma and X. Yao, Non-uniform layered clustering for ensemble classifer generation and optimality, Int. Conf. Neural Information Processing (ICONIP, 2010), Sydney, Australia, pp. 551-558.
10. L. Breiman, Bagging predictors, Mach. Learn. 24(2) (1996) 123-1401.
11. L. Chen and M. S. Kamel, A generalized adaptive ensemble generation and aggregation approach for multiple classifers systems, Pattern Recognit. 42 (2009) 629-644.
12. L. Nanni and A. Lumini, Fuzzy bagging: A novel ensemble of classifers, Pattern Recognit. 39 (2006) 488-490. (Pubitemid 41808629)
13. R. E. Schapire, The strength of weak learnability, Mach. Learn. 5(2) (1990) 197-227.
14. N. G. Pedrajas, Constructing ensembles of classifers by means of weighted instance selection, IEEE Trans. Neural Netw. 20 (2009) 258-277.
15. L. Ping, Abc-boost: Adaptive base class boost for multi-class classifcation, in ICML '09, Proceedings of the 26th Annual International Conference on Machine Learning (Montreal, Canada, 2009), pp. 625-632.
16. L. Ping, Robust LogitBoost and Adaptive Base Class (ABC) LogitBoost (Cornell University, Ithaca, NY, 2007), p. 14853.
17. Y. Rreund and R. E. Schapire, Decision-theoretic generalization of on-line learning and an application to boosting, J. Comput. Syst. Sci. 55(1) (1997) 119-139. (Pubitemid 127433398)
18. M. Jin and J. Zhang, Multi-class learning by smoothed boosting, Mach. Learn. 67 (2007) 207-227. (Pubitemid 46616362)
19. J. Rodriguez and J. Maudes, Boosting recombined weak classifers, Pattern Recognit. Lett. 29 (2009) 1049-1059.
20. M. D. Muhlbaier, A. Topalis and R. Polikar, Learn.NC: Combining ensemble of classifers with dynamically weighted consult-and-vote for e±cient incremental learning of new classes, IEEE Trans. Neural Networks 20(1) (2009) 152-168.
21. D. S. C. Nascimento and A. L. V. Coelho, Ensembling heterogeneous learning models with boosting, Int. Conf. Neural Information Processing (ICONIP, 2009), Bangkok, Thailand, pp. 512-519.
22. L. Rokach, O. Maimon and I. Lavi, Space decomposition in data mining: A clustering approach, Int. Symp. Methodologies for Intelligent Systems (2003), Maebashi City, Japan, pp. 24-31. (Pubitemid 37331851)
23. L. I. Kuncheva, Switching between selection and fusion in combining classifers: An experiment, IEEE Trans. Syst. Man Cybern. 32(2) (2002) 146-156. (Pubitemid 34249373)
24. G. Nasierding, G. Tsoumakas and A. Z. Kouzani, Clustering based multi-label classif-cation for image annotation and retrieval, IEEE Int. Conf. Syst. Man Cybern. (San Antonio, TX, USA, 2009) 4514-4519.
25. L. I. Kuncheva, J. J. Rodriguez, C. O. Plumpton, D. E. Linden and S. J. Johnston, Random subspace ensembles for FMRI classifcation, IEEE Trans. Med. Imaging 29(2) (2010) 531-542.
26. N. M. Wanas, R. A. Dara and M. S. Kamel, Adaptive fusion and co-operative training for classifer ensembles, Pattern Recognit. 39 (2006) 1781-1794. (Pubitemid 43867570)
27. U. Bhowan, M. Johnston and M. Zhang, Evolving ensembles in multi-objective genetic programming for classifcation with unbalance data, in Proc. 13th Annual Conf. Genetic and Evolutionary Computation (GECCO, 2011), Dublin, Ireland, pp. 1331-1338.
28. D. W. Opitz and J. W. Shavlik, Actively searching for an efective neural network ensemble, Connect. Sci. 8 (1996) 337-354. (Pubitemid 127011452)
29. A. H. R. R. Ko, A. Sabourin, D. E. S. Britto and L. Oliverira, Pairwise fusion matrix for combining classifers, Pattern Reconginit. 40 (2007) 2198-2210.
30. W. N. Street and K. YongSeog, A streaming ensemble algorithm for large scale classif-cation, Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (San Francisco, CA, USA, 2001), pp. 377-382.
31. A. Frank and A. Asuncion, UCI Machine Learning Repository (Irvine, A: University of California, School of Information and Computer Science, 2010), http://archive.ics.uci.-edu/ml.
32. R. Kohavi and D. H. Wolpert, Bias plus variance decomposition for zero-one loss functions, in Proc. Int. Conf. Machine Learning (Bari, Italy, 1996), pp. 275-283.
33. D. Rumelhart, G. Hinton and R. Williams, Learning internal representations by error propagation, in Parallel Distributed Processing: Explorations in the Microstructure of Confnition, eds. D. Rumelhart and J. McClelland, Vol. 1 (MIT Press, Cambridge, MA, 1986), pp. 318-363.