Eigenclassifiers for combining correlated classifiers

Information Sciences

Volumn 187, Issue 1, 2012, Pages 109-120

  Ulaş, Aydin ^a,c   Yildiz, Olcay Taner ^b   Alpaydin, Ethem ^a  

^a BOGAZICI UNIVERSITY   (Turkey)

^b IIK University   (Turkey)

^c Dipartimento di Informatica   (Italy)

Author keywords

Classifier correlation; Classifier design and evaluation; Machine learning

Indexed keywords

BASE CLASSIFIERS; CLASSIFIER DESIGN AND EVALUATION; DATA SETS; HYPERPARAMETERS; INCREMENTAL CONSTRUCTION; INPUT FEATURES; MACHINE-LEARNING; POSITIVE CORRELATIONS; SUBSET SELECTION; TRAINING SETS;

ALGORITHMS; PRINCIPAL COMPONENT ANALYSIS;

CLASSIFICATION (OF INFORMATION);

EID: 84155172806     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2011.10.024     Document Type: Article

References (54)

1. F. Alimolu, E. Alpaydin, Combining multiple representations and classifiers for pen-based handwritten digit recognition, in: Proceedings of the International Conference on Document Analysis and Recognition, ICDAR'97, 1997.
2. E. Alpaydin Voting over multiple condensed nearest neighbors Artificial Intelligence Review 11 1-5 1997 115 132 (Pubitemid 127508235)
3. E. Alpaydin Combined 5 × 2 cv F test for comparing supervised classification learning algorithms Neural Computation 11 8 1999 1885 1892
4. A. Asuncion, D.J. Newman, UCI machine learning repository, , 2007.
5. S.D. Bay, Combining nearest neighbor classifiers through multiple feature subsets, in: Proceedings of the International Conference on Machine Learning, ICML'98, 1998.
6. B. Biggio, G. Fumera, and F. Roli Multiple classifier systems for robust classifier design in adversarial environments International Journal of Machine Learning and Cybernetics 1 2010 27 41
7. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140 (Pubitemid 126724382)
8. G. Brown, J. Wyatt, R. Harris, and X. Yao Diversity creation methods: a survey and categorisation Information Fusion 6 1 2005 5 20
9. R. Caruana, A. Niculescu-Mizil, G. Crew, A. Ksikes, Ensemble selection from libraries of models, in: Proceedings of the International Conference on Machine Learning, ICML'04, 2004.
10. C.C. Chang C.J. Lin LIBSVM: a library for support vector machines, , 2001.
11. C. Demir, and E. Alpaydin Cost-conscious classifier ensembles Pattern Recognition Letters 26 14 2005 2206 2214 (Pubitemid 41383620)
12. J. Demsar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30 (Pubitemid 43022939)
13. Y. Freund, R.E. Schapire, Experiments with a new boosting algorithm, in: Proceedings of the International Conference on Machine Learning, ICML'96, 1996.
14. G. Fumera, and F. Roli A theoretical and experimental analysis of linear combiners for multiple classifier systems IEEE Transactions on Pattern Analysis Machine Intelligence 27 6 2005 942 956 (Pubitemid 40889844)
15. S. García, A. Fernández, J. Luengo, and F. Herrera Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power Information Sciences 180 10 2010 2044 2064
16. T.K. Ho The random subspace method for constructing decision forests IEEE Transactions on Pattern Analysis and Machine Intelligence 20 8 1998 832 844 (Pubitemid 128741345)
17. R.A. Jacobs Bias/variance analysis of mixtures-of-experts architectures Neural Computation 9 2 1997 369 383
18. A. Jain, K. Nandakumar, and A. Ross Score normalization in multimodal biometric systems Pattern Recognition 38 2005 2270 2285 (Pubitemid 41336698)
19. I.T. Jolliffe Discarding variables in a principal component analysis. II: Real data Applied Statistics 22 1 1973 21 31
20. L.I. Kuncheva Combining classifiers: soft computing solutions S.K. Pal, Pattern Recognition: From Classical to Modern Approaches 2001 World Scientific
21. L.I. Kuncheva Combining pattern classifiers: methods and algorithms 2004 Wiley-Interscience
22. L.I. Kuncheva Special issue on diversity in multiple classifier systems Information Fusion 6 1 2005 1 115
23. L.I. Kuncheva, and C.J. Whitaker Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy Machine Learning 51 2 2003 181 207
24. L.I. Kuncheva, C.J. Whitaker, C.A. Ship, R.P. Duin, Is independence good for combining classifiers? in: Proceedings of the 15th International Conference on Pattern Recognition, ICPR'00, 2000.
25. C.-L. Liu Classifier combination based on confidence transformation Pattern Recognition 38 2005 11 28
26. R. Mallipeddi, S. Mallipeddi, and P. Suganthan Ensemble strategies with adaptive evolutionary programming Information Sciences 180 9 2010 1571 1581
27. D.D. Margineantu, T.G. Dietterich, Pruning adaptive boosting, in: Proceedings of the International Conference on Machine Learning, ICML'97, 1997.
28. C.J. Merz Using correspondence analysis to combine classifiers Machine Learning 36 1-2 1999 33 58
29. C.J. Merz, and M.J. Pazzani A principal components approach to combining regression estimates Machine Learning 36 1-2 1999 9 32
30. D. Partridge, and W.B. Yates Engineering multiversion neural-net systems Neural Computation 8 4 1996 869 893 (Pubitemid 126449950)
31. C.E. Rasmussen, R.M. Neal, G. Hinton, D. van Camp, M. Revow, Z. Ghahramani, R. Kustra, R. Tibshirani, Delve data for evaluating learning in valid experiments, < http://www.cs.toronto.edu/∼delve/ >, 1995-1996.
32. S. Raudys Trainable fusion rules. I: large sample size case Neural Networks 19 2006 1506 1516 (Pubitemid 44793161)
33. A.C. Rencher Interpretation of canonical discriminant functions, canonical variates, and principal components The American Statistician 46 3 1992 217 225
34. F. Roli, G. Giacinto, G. Vernazza, Methods for designing multiple classifier systems, in: Proceedings of the International Workshop on Multiple Classifier Systems, MCS'01, 2001.
35. D. Ruta, and B. Gabrys Classifier selection for majority voting Information Fusion 6 1 2005 63 81
36. A.J.C. Sharkey, N.E. Sharkey, U. Gerecke, G.O. Chandroth, The "test and select" approach to ensemble combination, in: Proceedings of the International Workshop on Multiple Classifier Systems, MCS'00, vol. 1857, 2000.
37. C. Tamon, J. Xiang, On the boosting pruning problem, in: Proceedings of the European Conference on Machine Learning, ECML'00, 2000.
38. K.M. Ting, and I.H. Witten Issues in stacked generalization Journal of Artificial Intelligence Research 10 1999 271 289 (Pubitemid 30573908)
39. D.L. Tong, and R. Mintram Genetic algorithm-neural network (gann): a study of neural network activation functions and depth of genetic algorithm search applied to feature selection International Journal of Machine Learning and Cybernetics 1 2010 75 87
40. K. Tumer, and J. Ghosh Error correlation and error reduction in ensemble classifiers Connection Science 8 3 1996 385 404
41. A. Ula, Incremental construction of cost-conscious ensembles using multiple learners and representations in machine learning, Ph.D. thesis, Boazii University. , 2009.
42. A. Ula, M. Semerci, O.T. Yildiz, and E. Alpaydin Incremental construction of classifier and discriminant ensembles Information Sciences 179 9 2009 1298 1318
43. L.J. Wang An improved multiple fuzzy nnc system based on mutual information and fuzzy integral International Journal of Machine Learning and Cybernetics 2 2011 25 36
44. X.-Z. Wang, and C.-R. Dong Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy IEEE Transactions on Fuzzy Systems 17 2009 556 567
45. X.-Z. Wang, J.-H. Zhai, and S.-X. Lu Induction of multiple fuzzy decision trees based on rough set technique Information Sciences 178 2008 3188 3202
46. D.H. Wolpert Stacked generalization Neural Networks 5 1992 241 259
47. R. Xia, C. Zong, and S. Li Ensemble of feature sets and classification algorithms for sentiment classification Information Sciences 181 6 2011 1138 1152
48. J. Xiao, C. He, X. Jiang, and D. Liu A dynamic classifier ensemble selection approach for noise data Information Sciences 180 18 2010 3402 3421
49. Y. Yang, G.I. Webb, J. Cerquides, K.B. Korb, J. Boughton, and K.M. Ting To select or to weigh: a comparative study of linear combination schemes for superparent-one-dependence estimators IEEE Transactions on Knowledge and Data Engineering 19 12 2007 1652 1665 (Pubitemid 350025499)
50. O.T. Yildiz, E. Alpaydin, Linear discriminant trees, in: Proceedings of the International Conference on Machine Learning, ICML'00, 2000.
51. O.T. Yildiz, A. Ula, M. Semerci, E. Alpaydin, AYSU: machine learning data sets for model combination, , 2007.
52. E. Yu, and P. Suganthan Ensemble of niching algorithms Information Sciences 180 15 2010 2815 2833
53. Y. Zhang, S. Burer, and W.N. Street Ensemble pruning via semi-definite programming Journal of Machine Learning Research 7 2006 1315 1338 (Pubitemid 44024598)
54. Z.-H. Zhou, J. Wu, and W. Tang Ensembling neural networks: many could be better than all Artificial Intelligence 137 2002 239 263 (Pubitemid 34405220)