A comparative study of data sampling techniques for constructing neural network ensembles

International Journal of Neural Systems

Volumn 19, Issue 2, 2009, Pages 67-89

  Akhand, M A H ^a   Islam, Md Monirul ^a   Murase, Kazuyuki ^a  

^a UNIVERSITY OF FUKUI   (Japan)

Author keywords

Bagging; Boosting; Diversity; Generalization; Negative correlation learning; Neural network ensemble; Random subspace method

Indexed keywords

BAGGING; BOOSTING; DIVERSITY; GENERALIZATION; NEGATIVE CORRELATION LEARNING; NEURAL NETWORK ENSEMBLE; RANDOM SUBSPACE METHOD;

CONTENT BASED RETRIEVAL; DECISION TREES; EDUCATION; LEARNING SYSTEMS; NEURAL NETWORKS;

CLASSIFIERS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPARATIVE STUDY; DECISION SUPPORT SYSTEM; HUMAN; INFORMATION PROCESSING; INFORMATION RETRIEVAL; METHODOLOGY;

AUTOMATIC DATA PROCESSING; DECISION SUPPORT TECHNIQUES; HUMANS; INFORMATION STORAGE AND RETRIEVAL; NEURAL NETWORKS (COMPUTER);

EID: 67650085798     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065709001859     Document Type: Article

References (30)

1. G. Brown, J. Wyatt, R. Harris and X. Yao, Diversity creation methods: A survey and categorization, Information Fusion 6 (2005) 99-111.
2. T. G. Dietterich, Ensemble learning, The Handbook of Brain Theory and Neural Networks, 2nd edn., (2002) 405-408.
3. L. Breiman, Bagging predictors, Machine Learning 24 (1996) 123-140.
4. Y. Freund and R. E. Schapire, Experiments with a new boosting algorithm, in Proc. of the 13th Int. Conf. on Machine Learning (Morgan Kaufmann, 1996), pp. 148-156.
5. P. Melville and R. J. Mooney, Creating diversity in ensembles using artificial data, Information Fusion 6 (2005) 99-111.
6. G. Martínez-Muñoz and A. Súarez, Switching class labels to generate classification ensembles, Pattern Recognition 38 (2005) 1483-1494.
7. T. K. Ho, The random subspace method for constructing decision forests, IEEE Trans. on Pattern Analysis and Machine Intelligence 20 (1998) 832-844.
8. L. Breiman, Randomizing outputs to increase prediction accuracy, Machine Learning 40 (2000) 229-242.
9. Y. Liu and X. Yao, Ensemble learning via negative correlation, Neural Networks 12 (1999) 1399-1404.
10. Y. Liu and X. Yao, Simultaneous training of negatively correlated neural networks in an ensemble, IEEE Trans. Systems, Man, and Cybernetics - Part B 29 (1999) 716-725.
11. L. Breiman, Random forests, Machine Learning 45 (2001) 5-32.
12. E. Bauter and R. Kohavi, An empirical comparison of voting classification algorithms: Bagging, boosting, and variants, Machine Learning 36 (1999) 105-142.
13. L. I. Kuncheva, M. Skurichina and R. P. W. Duin, An experimental study on diversity for bagging and boosting with linear classifiers, Information Fusion 3 (2002) 245-258.
14. D. W. Opitz and R. Maclin, Popular ensemble methods: An empirical study, Journal of Artificial Intelligence Research 11 (1999) 169-198.
15. L. O. Hall, X. Liu, K. W. Bowyer and R. Banfield, An analysis of neural network versus decision tree performance on a bio-informatics problem, in Proc. of Workshop on Information Technology (Morocco, Rabat, 2003).
16. P. Melville and R. Mooney, Constructing diverse classifier ensembles using artificial training examples, in Proc. of the 18th International Joint Conference on Artificial Intelligence (Mexico, 2003), pp. 505-510.
17. J. DePasquale and R. Polikar, Random feature subset selection for ensemble based classification of data with missing features, Lecture Notes in Computer Science 4472 (2007) 251-260.
18. R. Polikar, Bootstrap inspired techniques in computational intelligence, IEEE Signal Processing Magazine 24(4) (2007) 59-72.
19. S. Haykin, Neural Networks - A Comprehensive Foundation, 2nd edn. (Prentice Hall, 1999).
20. A. Tsymbal, M. Pechenizkiy and P. Cunningham, Diversity in search strategies for ensemble feature selection, Information Fusion 6 (2005) 83-98.
21. A. Chandra, H. Chen and X. Yao, Trade-off between diversity and accuracy in ensemble generation, Studies in Computational Intelligence (SCI) 16 (2006) 429-464.
22. Md. Monirul Islam, X. Yao and K. Murase, A constructive algorithm for training cooperative neural network ensembles, IEEE Trans. on Neural Networks 14 (2003) 820-834.
23. D. J. Newman, S. Hettich, C. L. Blake and C. J. Merz, UCI Repository of machine learning databases, Dept. of Information and Computer Sciences, University of California, Irvine. (http://www.ics.uci.edu/∼mlearn/)
24. L. Prechelt, Proben1 - A set of benchmarks and benching rules for neural network training algorithms, Tech. Rep. 21/94 (Fakultat fur Informatik, University of Karlsruhe, Germany, 1994).
25. M. Skurichina and R. P. W. Duin, Bagging and the random subspace method for redundant feature spaces, Lecture Notes in Computer Science 2096 (2001) 1-10.
26. R. E. Banfield, L. O. Hall, K. W. Bowyer and W. P. Kegelmeyer, A comparison of decision tree ensemble creation techniques, IEEE Trans. on Pattern Analysis and Machine Intelligence 29 (2007) 173-180.
27. H. Adeli and S. L. Hung, A concurrent adaptive conjugate gradient learning algorithm on MIMD machines, Journal of Supercomputer Applications 7(2) (1993) 155-156.
28. S. L. Hung and H. Adeli, Parallel backpropagation learning algorithms on Cray Y-MP8/864 supercomputer, Neurocomputing 5(6) (1993) 287-302.
29. H. Adeli and S. L. Hung, An adaptive conjugate gradient learning algorithm for effective training of multilayer neural networks, Applied Mathematics and Computation 62(1) (1994) 81-102.
30. H. Adeli and S. L. Hung, A parallel genetic/neural network learning algorithm for MIMD shared memory machines, IEEE Transactions on Neural Networks 5(6) (1994) 900-909.