Constructing ensembles of classifiers using supervised projection methods based on misclassified instances

Expert Systems with Applications

Volumn 38, Issue 1, 2011, Pages 343-359

  García Pedrajas, Nicolás ^a   García Osorio, César ^b  

^a UNIVERSITY OF CÓRDOBA   (Spain)

^b UNIVERSITY OF BURGOS   (Spain)

Author keywords

Boosting; Classification; Ensembles of classifiers; Subspace methods

Indexed keywords

ADABOOST; BOOSTING; CLASSIFICATION; DATA SETS; ENSEMBLE CONSTRUCTION; ENSEMBLES OF CLASSIFIERS; INDIVIDUAL CLASSIFIERS; NON-LINEAR; OVER SAMPLING; PROJECTION ALGORITHMS; PROJECTION METHOD; SUB-SPACE METHODS; TRAINING SETS; UCI MACHINE LEARNING REPOSITORY;

ADAPTIVE BOOSTING; CLASSIFIERS;

CLASSIFICATION (OF INFORMATION);

EID: 77956614386     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2010.06.072     Document Type: Article

References (35)

1. R. Barandela, J.L. Sánchez, V. García, and E. Rangel Strategies for learning in class imbalance problems Pattern Recognition 36 2003 849 851
2. E. Bauer, and R. Kohavi An empirical comparison of voting classification algorithms: Bagging, boosting, and variants Machine Learning 36 1/2 1999 105 142
3. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140
4. Breiman, L. (1996b). Bias, variance, and arcing classifiers. Tech. Rep. 460, Department of Statistics, University of California, Berkeley, CA.
5. M. Bressan, and J. Vitriá Nonparametric discriminant analysis and nearest neighbor classification Pattern Recognition Letters 24 15 2003 2743 2749
6. Chang, C.-C., & Lin, C.-J. (2001). LIBSVM: A library for support vector machines. Software available from http://www.csie.ntu.edu.tw/cjlin/ libsvm.
7. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer SMOTE: Synthetic minority over-sampling technique Journal of Artificial Intelligence Research 16 2002 321 357
8. N. Cristianini, and J. Shawe-Taylor An introduction to support vector machines 2000 Cambridge University Press Cambridge
9. J. Demar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
10. de Ridder, D., & Duin, R. (2002). Locally linear embedding for classification (technical report ph-2002-01). Tech. Rep., Pattern Recognition Group, Department of Imaging Science and Technology, Delft University of Technology. Available from citeseer.ist.psu.edu/kuo01improved.html.
11. T.G. Dietterich Ensemble methods in machine learning J. Kittler, F. Roli, Proceedings of the first international workshop on multiple classifier systems Lecture notes in computer science Vol. 1857 2000 Springer Berlin 1 15
12. T.G. Dietterich An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization Machine Learning 40 2000 139 157
13. E.W. Dijkstra A note on two problems in connexion with graphs Numerische Mathematik 1 1959 269 271 Available from http://www-m3.ma.tum.de/twiki/pub/ MN0506/WebHome/dijkstra.pdf
14. Freund, Y., & Schapire, R. (1996). Experiments with a new boosting algorithm. In: Proceedings of the 13th international conference on machine learning, Bari, Italy (pp. 148-156).
15. K. Fukunaga, and J. Mantock Nonparametric discriminant analysis IEEE Transaction on Pattern Analysis and Machine Intelligence 5 6 1983 671 678
16. N. García-Pedrajas, and C. Fyfe Immune network based ensembles Neurocomputing 2007 1155 1166
17. N. García-Pedrajas, C. García-Osorio, and C. Fyfe Nonlinear boosting projections for ensemble construction Journal of Machine Learning Research 8 2007 1 33
18. X. Geng, D.-C. Zhan, and Z.-H. Zhou Supervised nonlinear dimensionality reduction for visualization and classification IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 35 6 2005 1098 1107
19. S. Haykin Neural networks - A comprehensive foundation 2nd ed. 1999 Prentice-Hall Upper Saddle River, NJ
20. Hettich, S., Blake, C., & Merz, C. (1998). UCI repository of machine learning databases. Available from http://www.ics.uci.edu/mlearn/MLRepository. html.
21. L.I. Kuncheva Combining classifiers: Soft computing solutions S.K. Pal, A. Pal, Pattern recognition: From classical to modern approaches 2001 World Scientific Singapore 427 451
22. L. Kuncheva, and C.J. Whitaker Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy Machine Learning 51 2 2003 181 207
23. Kuo, B.-C., Ko, L. W., Pai, C.-H., & Landgrebe, D. A. (2003). Regularized feature extractions for hyper-spectral data classification. In: International geoscience and remote sensing symposium, USA (Vol. 3, pp. 1767-1769).
24. B.-C. Kuo, and D.A. Landgrebe Nonparametric weighted feature extraction for classification IEEE Transactions on Geoscience and Remote Sensing 42 5 2004 1096 1105
25. D.D. Margineantu, and T.G. Dietterich Pruning adaptive boosting D.H. Fisher, Proceedings of the 14th international conference on machine learning 1997 Morgan Kaufmann San Francisco, CA 211 218
26. C.J. Merz Using correspondence analysis to combine classifiers Machine Learning 36 1 1999 33 58
27. J.R. Quinlan C4.5: Programs for machine learning 1993 Morgan Kaufmann San Mateo
28. J.R. Quinlan Bagging, boosting, and c4.5 Proceedings if the 13th national conference on artificial intelligence 1996 AAAI Press and the MIT Press Cambridge, MA 725 730
29. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 5500 2000 2323 2326
30. R.E. Schapire, Y. Freund, P.L. Bartlett, and W.S. Lee Boosting the margin: A new explanation for the effectiveness of voting methods Annals of Statistics 26 5 1998 1651 1686
31. A. Sierra, and A. Echevarría Evolutionary discriminant analysis IEEE Transactions on Evolutionary Computation 10 1 2006 81 92
32. D.F. Specht A general regression neural network IEEE Transactions on Neural Networks 2 6 1991 568 576
33. J.B. Tenenbaum, V. de Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 5500 2000 2319 2323
34. Q. Tian, J. Yu, and T.S. Huang Boosting multiple classifiers constructed by hybrid discriminant analysis N.C. Oza, R. Polikar, J. Kittler, F. Roli, Multiple classifier systems, sixth international workshop, MCS Lecture notes in computer science Vol. 3541 2005 Springer Seaside, CA 42 52 (Pubitemid 41422603)
35. W.S. Torgerson Multidimensional scaling: I. Theory and methods Psychometrika 17 4 1952 401 419