Class-switching neural network ensembles

Neurocomputing

Volumn 71, Issue 13-15, 2008, Pages 2521-2528

  Martínez Muñoz, Gonzalo ^a   Sánchez Martínez, Aitor ^a   Hernández Lobato, Daniel ^a   Suárez, Alberto ^a  

^a UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

Author keywords

Bagging; Boosting; Class switching; Decision trees; Ensembles of classifiers; Neural networks

Indexed keywords

DECISION TREES; FORESTRY; NEURAL NETWORKS;

BAGGING; BENCHMARK CLASSIFICATION; BOOSTING; BOOSTING ENSEMBLES; CLASS-SWITCHING; CLASSIFICATION PERFORMANCE; ENSEMBLES OF CLASSIFIERS; GENERALIZATION ACCURACY;

SWITCHING;

ACCURACY; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION ALGORITHM; CONFERENCE PAPER; CONTROLLED STUDY; DECISION TREE; INFORMATION PROCESSING; MACHINE LEARNING; PRIORITY JOURNAL; QUALITY CONTROL; RANDOM SAMPLE; TASK PERFORMANCE;

EID: 56449095607     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2007.11.041     Document Type: Conference Paper

References (31)

1. A. Asuncion, D.J. Newman, UCI machine learning repository, 2007 .
2. E. Bauer, R. Kohavi, An empirical comparison of voting classiffication algorithms: Bagging, boosting, and variants, Mach. Learn. 36 (1-2) (1999) 105-139.
3. L. Breiman, Bagging predictors, Mach. Learn. 24 (2) (1996) 123-140.
4. L. Breiman, Arcing classifiers, Ann. Statist. 26 (3) (1998) 801-849.
5. L. Breiman, Randomizing outputs to increase prediction accuracy, Mach. Learn. 40 (3) (2000) 229-242.
6. L. Breiman, Random forests, Mach. Learn. 45 (1) (2001) 5-32.
7. L. Breiman, J.H. Friedman, R.A. Olshen, C.J. Stone, Classification and Regression Trees, Chapman & Hall, New York, 1984.
8. I. Cantador, J.R. Dorronsoro, Balanced boosting with parallel perceptrons, in: J. Cabestany, A. Prieto, F.S. Hernández (Eds.), IWANN, Lecture Notes in Computer Science, Vol. 3572, Springer, 2005.
9. T.G. Dietterich, An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization, Mach. Learn. 40 (2) (2000) 139-157.
10. T.G. Dietterich, G. Bakiri, Solving multiclass learning problems via error-correcting output codes, J. Artif. Intell. Res. 2 (1995) 263-286.
11. Y. Freund, R.E. Schapire, A decision-theoretic generalization of on-line learning and an application to boosting, in: Proceedings of the 2nd European Conference on Computational Learning Theory, 1995.
12. J. Fürnkranz, Round robin classification, J. Mach. Learn. Res. 2 (2002) 721-747.
13. L.K. Hansen, P. Salamon, Neural network ensembles, IEEE Trans. Pattern Anal. Mach. Intell. 12 (10) (1990) 993-1001.
14. T.K. Ho, C4.5 decision forests, in: Proceedings of the 14th International Conference on Pattern Recognition, vol. 1, 1998.
15. C. Igel, M. Hüsken, Improving the RPROP learning algorithm, in: Proceedings of the 2nd International Symposium on Neural Computation, ICSC Academic Press, 2000.
16. H.-C. Kim, S. Pang, H.-M. Je, D. Kim, S.Y. Bang, Constructing support vector machine ensemble, Pattern Recognition 36 (12) (2003) 2757-2767.
17. E.B. Kong, T.G. Dietterich, Error-correcting output coding corrects bias and variance, in: Proceedings of the 12th International Conference on Machine Learning, 1995.
18. G. Martínez-Munoz, A. Sánchez-Martínez, A. Suárez, Building ensembles of neural networks with class-switching, in: S.D. Kollias, A. Stafylopatis, W. Duch, E. Oja (Eds.), ICANN (1), Lecture Notes in Computer Science, Vol. 4131, Springer, 2006.
19. G. Martínez-Muñoz, A. Suárez, Switching class labels to generate classification ensembles, Pattern Recognition 38 (10) (2005) 1483-1494.
20. C. Nadeau, Y. Bengio, Inference for the generalization error, Mach. Learn. 52 (3) (2003) 239-281.
21. S. Nissen, Implementation of a fast artificial neural network library (FANN), Technical Report, Department of Computer Science, University of Copenhagen, 2003. URL: .
22. D. Opitz, R. Maclin, Popular ensemble methods: An empirical study, J. Artif. Intell. Res. 11 (1999) 169-198.
23. M.P. Perrone, L.N. Cooper, When networks disagree: Ensemble methods for hybrid neural networks, in: R.J. Mammone (Ed.), Neural Networks for Speech and Image Processing, Chapman & Hall, London, 1993, pp. 126-142.
24. J.R. Quinlan, C4.5 Programs for Machine Learning, Morgan Kaufmann, Los Altos, CA, 1993.
25. J.R. Quinlan, Bagging boosting and C4.5, in: Proceedings of the 13th National Conference on Artificial Intelligence, Cambridge, MA, 1996.
26. G. Rätsch, T. Onoda, K.-R. Müller, Soft margins for AdaBoost, Mach. Learn. 42 (3) (2001) 287-320.
27. R.E. Schapire, Y. Freund, P.L. Bartlett, W.S. Lee, Boosting the margin: a new explanation for the effectiveness of voting methods, Ann. Statist. 12 (5) (1998) 1651-1686.
28. A.J.C. Sharkey, Combining Arti.cial Neural Nets: Ensemble and Modular Multi-Net Systems, Springer, London, 1999.
29. G. Valentini, T.G. Dietterich, Low bias bagged support vector machines, in: T. Fawcett, N. Mishra (Eds.), ICML, AAAI press, 2003.
30. G. Valentini, T.G. Dietterich, Bias-variance analysis of support vector machines for the development of SVM-based ensemble methods, J. Mach. Learn. Res. 5 (2004) 725-775.
31. D.H. Wolpert, Stacked generalization, Neural Networks 5 (2) (1992) 241-259.