Progressive interactive training: A sequential neural network ensemble learning method

Neurocomputing

Volumn 73, Issue 1-3, 2009, Pages 260-273

  Akhand, M A H ^a   Islam, Md Monirul ^b   Murase, K ^b  

^a KHULNA UNIVERSITY OF ENGINEERING AND TECHNOLOGY   (Bangladesh)

^b UNIVERSITY OF FUKUI   (Japan)

Author keywords

Bagging and boosting; Indirect communication; Negative correlation learning; Neural network ensemble

Indexed keywords

BAGGING AND BOOSTING; BENCHMARK CLASSIFICATION; BOOSTING ALGORITHM; INDIRECT COMMUNICATION; INFORMATION CENTER; INTERACTIVE TRAINING; NEGATIVE CORRELATION LEARNING; NEURAL NETWORK ENSEMBLE; SEQUENTIAL NEURAL NETWORKS; TRAINING METHODS; TRAINING PROCESS; TRAINING SCHEMES;

EDUCATION; LOCOMOTIVES; RAILROAD CARS;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; CONTROLLED STUDY; EXPERIMENTAL STUDY; INFORMATION PROCESSING; NETWORK LEARNING; PRIORITY JOURNAL;

EID: 70350726190     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.09.001     Document Type: Article

References (25)

1. Sharkey A.J.C. On combining artificial neural nets. Connection Science 8 (1996) 299-314
2. Sharkey A.J.C., and Sharkey N.E. Combining diverse neural nets. Knowledge Engineering Review 12 3 (1997) 299-314
3. Brown G., Wyatt J., Harris R., and Yao X. Diversity creation methods: a survey and categorization. Information Fusion 6 (2005) 99-111
4. Breiman L. Bagging predictors. Machine Learning 24 (1996) 123-140
5. Y. Freund, R.E. Schapire, Experiments with a new boosting algorithm, in: Proceedings of the 13th International Conference on Machine Learning, Morgan Kaufmann, Los Altos, CA, 1996, pp. 148-156.
6. J.R. Quinlan, Bagging, boosting, and C4.5, in: Proceedings of the 13th National Conference on Artificial Intelligence and Eighth Innovative Applications of Artificial Intelligence Conference, AAAI Press/MIT Press, Menlo Park, 1996, pp. 725-730.
7. Opitz D.W., and Maclin R. Popular ensemble methods: an empirical study. Journal of Artificial Intelligence Research 11 (1999) 169-198
8. Bauter E., and Kohavi R. An empirical comparison of voting classification algorithms: bagging, boosting, and variants. Machine Learning 36 (1999) 105-142
9. Monirul Islam Md., Yao X., and Murase K. A constructive algorithm for training cooperative neural network ensembles. IEEE Transactions on Neural Networks 14 (2003) 820-834
10. G. Brown, Diversity in neural network ensembles, Ph.D. Thesis, School of Computer Science, University of Birmingham, UK, 2003.
11. Liu Y., and Yao X. Simultaneous training of negatively correlated neural networks in an ensemble. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 29 6 (1999) 716-725
12. Liu Y., and Yao X. Ensemble learning via negative correlation. Neural Networks 12 (1999) 1399-1404
13. Melville P., and Mooney R.J. Creating diversity in ensembles using artificial data. Information Fusion 6 (2005) 99-111
14. Bonabeau E., Dorigo M., and Theraulaz G. Swarm Intelligence: From Natural to Artificial Systems (1999), Oxford University Press, Oxford
15. Cordon O., Herrera F., and Stützle T. A review on the ant colony optimization metaheuristic: basis, models and new trends. Mathware and Soft Computing 9 (2002) 141-175
16. L. Prechelt, Proben1-a set of benchmarks and benching rules for neural network training algorithms, Technical Report 21/94, Fakultat fur Informatik, University of Karlsruhe, Germany, 1994.
17. Hansen K., and Salamon P. Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence 12 10 (1990) 993-1001
18. Tsymbal A., Pechenizkiy M., and Cunningham P. Diversity in search strategies for ensemble feature selection. Information Fusion 6 (2005) 83-98
19. Haykin S. Neural Networks-A Comprehensive Foundation. third ed. (1999), Prentice Hall, New York
20. Y. Liu, Generate different neural networks by negative correlation learning, Lecture Notes in Computer Science, vol. 3610, Springer, Berlin/Heidelberg, 2005, pp. 149-156.
21. Liu Y. How to generate different neural networks. Studies in Computational Intelligence (SCI) 35 (2007) 225-240
22. Chandra A., Chen H., and Yao X. Trade-off between diversity and accuracy in ensemble generation. Studies in Computational Intelligence (SCI) 16 (2006) 429-464
23. Kuncheva L.I., and Whitaker C.J. Measures of diversity in classifier ensembles. Machine Learning 51 (2003) 181-207
24. Vezhnevets A., and Barinova O. Avoiding boosting overfitting by removing confusing samples. Lecture Notes in Computer Science 4701 (2007) 430-441
25. Ho T.K. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (1998) 832-844