Combining Pattern Classifiers: Methods and Algorithms: Second Edition

Combining Pattern Classifiers: Methods and Algorithms: Second Edition

Volumn 9781118315231, Issue , 2014, Pages 1-357

  Kuncheva, Ludmila I ^a  

^a BANGOR UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CELLULAR TELEPHONE SYSTEMS; DATA MINING; LEARNING SYSTEMS; MAGNETIC RESONANCE IMAGING;

BANK TRANSACTIONS; BRAIN TUMOURS; CLASSIFIER ENSEMBLES; COMBINING CLASSIFIERS; OIL DEPOSITS; PATTERN CLASSIFIER; VERBAL INSTRUCTIONS; VOX POPULI;

PATTERN RECOGNITION;

EID: 84926402173     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118914564     Document Type: Book

References (443)

1. T. Abeel, T. Helleputte, Y. Van de Peer, P. Dupont, and Y. Saeys. Robust biomarker identification for cancer diagnosis with ensemble feature selection methods. Bioinformatics (Oxford, England), 26(3):392-398, 2010.
2. M. Abouelenien and X. Yuan. SampleBoost: improving boosting performance by destabilizing weak learners based on weighted error analysis. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR), pp. 585-588. IEEE, 2012.
3. D. W. Aha and R. L Bankert. A comparative evaluation of sequential feature selection algorithms. In: Proceedings of the 5th International Workshop on AI and Statistics, Ft Lauderdale, FL, 1995, pp. 1-7.
4. D. W. Aha and R. L. Blankert. Cloud classification using error-correcting output codes. Artificial Intelligence Applications: Natural Resources, Agriculture and Environmental Science, 11(1):13-28, 1997.
5. W. I. Ai and P. Langley. Induction of one-level decision trees. In: Proceedings of the Ninth International Conference on Machine Learning, pp. 233-240. Morgan Kaufmann, 1992.
6. M. Aksela. Comparison of classifier selection methods for improving committee performance. In: T.Windeatt and F. Roli, editors, Proc. 4rd Int.Workshop on Multiple Classifier Systems (MCS 2003), Guildford, UK. Volume 2709: Lecture Notes in Computer Science, pp. 84-93. Springer, 2003.
7. I. Aleksander and H. Morton. Introduction to Neural Computing, 2nd edition. International Thomson Computer Press, London, 1995.
8. L. A. Alexandre, A. C. Campilho, and M. Kamel. On combining classifiers using sum and product rules. Pattern Recognition Letters, 22(12):1283-1289, 2001.
9. F. M. Alkoot and J. Kittler. Experimental evaluation of expert fusion strategies. Pattern Recognition Letters, 20:1361-1369, 1999.
10. E. L. Allwein, R. E. Schapire, and Y. Singer. Reducing multiclass to binary: a unifying approach for margin classifiers. Journal of Machine Learning Research, 1:113-141, 2000.
11. E. Alpaydin. Comparison of statistical and neural classifiers and their applications to optical character recognition and speech classification. In: C. T. Leondes, editor, Image Processing and Pattern Recognition, Volume 5: Neural Network Systems, pp. 61-88. Academic Press, 1998.
12. E. Alpaydin. Introduction to Machine Learning. MIT Press, Cambridge, MA, 2004.
13. E. Alpaydin and C. Kaynak. Cascading classifiers. KYBERNETIKA, 34(4):369-374, 1998.
14. E. Alpaydin and E. Mayoraz. Learning error-correcting output codes from data. In:Proceedings of ICANN'99, pp. 743-748. MIT AI Laboratory, 1999.
15. W. Altidor, T. M. Khoshgoftaar, and A. Napolitano. A noise-based stability evaluation of threshold-based feature selection techniques. In: IEEE International Conference on Information Reuse and Integration (IRI), pp. 240-245. IEEE Systems, Man, and Cybernetics Society, 2011.
16. H. Altinçay. On naive Bayesian fusion of dependent classifiers. Pattern Recognition Letters, 26(15):2463-2473, 2005.
17. J. A. Anderson and E. Rosenfeld. Neurocomputing. Foundations of Research. The MIT Press, Cambridge, MA, 1988.
18. P. Arabie, L. J. Hubert, and G. De Soete. Clustering and Classification.World Scientific, Singapore, 1996.
19. G. Armano, C. Chira, and N. Hatami. A new gene selection method based on random subspace ensemble for microarray cancer classification. In: M. Loog, L.Wessels, M. J. T. Reinders, and D. Ridder, editors, Pattern Recognition in Bioinformatics, Volume 7036:Lecture Notes in Computer Science, pp. 191-201. Springer, Berlin, Heidelberg, 2011.
20. R.Avnimelech and N. Intrator. Boosted mixture of experts: an ensemble learning scheme. Neural Computation, 11(2):483-497, 1999.
21. B. Ayerdi,J. Maiora, and M. Grana. Active learning of hybrid extreme rotation forests for CTA image segmentation. In: Proceedings of the 12th International Conference on Hybrid Intelligent Systems (HIS), pp. 543-548. IEEE, 2012.
22. K. Bache and M. Lichman. UCI Machine Learning Repository, 17 December 2013. http://archive.ics.uci.edu/ml.
23. M. A. Bagheri, Q. Gao, and S. Escalera. A genetic-based subspace analysis method for improving error-correcting output coding. Pattern Recognition, 46(10):2830-2839, 2013.
24. T. Bailey and A. K. Jain. A note on distance-weighted k-nearest neighbor rules. IEEE Transactions on Systems, Man, and Cybernetics, 8(4):311-313, 1978.
25. R. E. Banfield, L. O. Hall, K. W. Bowyer, and W. P. Kegelmeyer. A new ensemble diversity measure applied to thinning ensembles. In: T. Windeatt and F. Roli, Guildford, UK. Volume 2709: Lecture Notes in Computer Science, pp. 306-316. Springer, 2003.
26. Y. L. Barabash. Collective Statistical Decisions in Recognition. Radio i Sviaz, Moscow, 1983 (In Russian).
27. Z. Barutcuoglu, P. Long, and R. Servedio. One-pass boosting. In: J. C. Platt, D. Koller, Y. Singer, and S. Roweis, editors, Advances in Neural Information Processing Systems (NIPS), Volume 20, pp. 73-80. MIT Press, Cambridge, MA, 2007.
28. R. Battiti and A. M. Colla. Democracy in neural nets: voting schemes for classification. Neural Networks, 7:691-707, 1994.
29. E. Bauer and R. Kohavi. An empirical comparison of voting classification algorithms:bagging, boosting, and variants. Machine Learning, 36:105-142, 1999.
30. M. A. Bautista, S. Escalera, X. Baró, P. Radeva, J. Vitriá, and O. Pujol. Minimal design of error-correcting output codes. Pattern Recognition Letters, 33(6):693-702, 2012.
31. A. Bella, C. Ferri, J. Hernández-Orallo, and M. J. Ramírez-Quintana. On the effect of calibration in classifier combination. Applied Intelligence, 38(4):566-585, 2013.
32. S. Ben-David, P. M. Long, and Y. Mansour. Agnostic boosting. In: David Helmbold and BobWilliamson, editors, Computational Learning Theory. Volume 2111: Lecture Notes in Computer Science, pp. 507-516. Springer, Berlin, Heidelberg, 2001.
33. A. Ben-Hur and J. Weston. A user's guide to support vector machines. In: Data Mining Techniques for the Life Sciences. Volume 609: Methods in Molecular Biology, pp. 223-239. Springer, 2008.
34. J. A. Benediktsson and P. H. Swain. Consensus theoretic classification methods. IEEE Transactions on Systems, Man, and Cybernetics, 22:688-704, 1992.
35. C. Berenstein, L. N. Kanal, and D. Lavine. Consensus rules. In: L. N. Kanal and J. F. Lemmer, editors, Uncertainty in Artificial Intelligence, pp. 27-32. Elsevier Science Publishers B.V., 1986.
36. A. Bertoni, R. Folgieri, and G. Valentini. Random subspace ensembles for the biomolecular diagnosis of tumors. In: Models and Metaphors from Biology to Bioinformatics Tools, NETTAB, 2004.
37. A. Bertoni, R. Folgieri, and G. Valentini. Feature selection combined with random subspace ensemble for gene expression based diagnosis of malignancies. In: B. Apolloni, M. Marinaro, and R. Tagliaferri, editors, Biological and Artificial Intelligence Environments, pp. 29-36. Springer, 2005.
38. J. C. Bezdek. Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York, 1981.
39. J. C. Bezdek, J. M. Keller, R. Krishnapuram, and N. R. Pal. Fuzzy Models and Algorithms for Pattern Recognition and Image Processing. Kluwer Academic Publishers, 1999.
40. C. M. Bishop. Neural Networks for Pattern Recognition. Clarendon Press, Oxford, 1995.
41. C. M. Bishop. Pattern Recognition and Machine Learning. Springer, New York, 2006.
42. A. Blum and P. Langley. Selection of relevant features and examples in machine learning. Artificial Intelligence, 97(1-2):245-271, 1997.
43. P. Bonissone, J. M. Cadenas, M. C. Garrido, and R. A. Díaz-Valladares. A fuzzy random forest. International Journal of Approximate Reasoning, 51(7):729-747, 2010.
44. R. F. Bordley. A multiplicative formula for aggregating probability assessments. Management Science, 28:1137-1148, 1982.
45. J. K. Bradley and R. Schapire. FilterBoost: regression and classification on large datasets. In: Advances in Neural Information Processing Systems (NIPS), Volume 20. MIT Press, Cambridge, MA, 2008.
46. L. Breiman. Bagging predictors. Technical Report 421, Department of Statistics, University of California, Berkeley, CA, 1994.
47. L. Breiman. Bagging predictors. Machine Learning, 26(2):123-140, 1996.
48. L. Breiman. Arcing classifiers. The Annals of Statistics, 26(3):801-849, 1998.
49. L. Breiman. Pasting small votes for classification in large databases and on-line. Machine Learning, 36:85-103, 1999.
50. L. Breiman. Random forests. Machine Learning, 45:5-32, 2001.
51. L. Breiman, J. Friedman, R. Olshen, and C. Stone. Classification and Regression Trees. Wadsworth International, Belmont, CA, 1984.
52. G. Brown. An information theoretic perspective on multiple classifier systems. In: Proceedings of the 8th International Workshop on Multiple Classifier Systems, LNCS, pp. 344-353. Springer, 2009.
53. G. Brown. Ensemble learning. In: C. Sammut and G. Webb, editors, Encyclopedia of Machine Learning. Springer, 2010.
54. G. Brown and L. I. Kuncheva. GOOD and BAD diversity in majority vote ensembles. In: Proc. 9th International Workshop on Multiple Classifier Systems (MCS'10), Cairo, Egypt. Volume 5997: Lecture Notes in Computer Science, pp. 124-133. Springer, 2010.
55. G. Brown, A. Pocock, M. Zhao, and M. Lujan. Conditional likelihood maximisation:a unifying framework for information theoretic feature selection. Journal of Machine Learning Research, 13:27-66, 2012.
56. G. Brown, J. Wyatt, R. Harris, and X. Yao. Diversity creation methods: a survey and categorisation. Information Fusion, 6(1):5-20, 2005.
57. L. Bruzzone and R. Cossu. A multiple-cascade-classifier system for a robust and partially unsupervised updating of land-cover maps. IEEE Transactions on Geoscience and Remote Sensing, 40(9):1984-1996, 2002.
58. R. Bryll, R. Gutierrez-Osuna, and F. Quek. Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets. Pattern Recognition, 36(6):1291-1302, 2003.
59. P. Bühlmann and B. Yu. Boosting with the L2 loss: regression and classification. Journal of the American Statistical Association, 98:324-339, 2003.
60. P. Bühlmann and T. Hothorn. Twin boosting: improved feature selection and prediction. Statistics and Computing, 20(2):119-138, 2010.
61. C. J. C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2(2):121-167, 1998.
62. J. B. D. Cabrera. On the impact of fusion strategies on classification errors for large ensembles of classifiers. Pattern Recognition, 39:1963-1978, 2006.
63. R. A. Calvo and S. D'Mello. Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Transactions on Affective Computing, 1(1):18-37, 2010.
64. A. M. P. Canuto, M. C. C. Abreu, L. M. Oliveira, J. C. Xavier Jr., and A. de M. Santos. Investigating the influence of the choice of the ensemble members in accuracy and diversity of selection-based and fusion-based methods for ensembles. Pattern Recognition Letters, 28(4):472-486, 2007.
65. S.-H. Cha. Comprehensive survey on distance/similarity measures between probability density functions. International Journal of Mathematical Models and Methods in Applied Sciences, 1(4):300-307, 2007.
66. P. K. Chan,Wei Fan, A. L. Prodromidis, and S. J. Stolfo. Distributed data mining in credit card fraud detection. IEEE Intelligent Systems and their Applications, 14(6):67-74, 1999.
67. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee. Choosing multiple parameters for support vector machines. Machine Learning, 46(1):131-159, 2002.
68. N. V. Chawla, L. O. Hall, K. W. Bowyer, T. E. Moore Jr., and W. P. Kegelmeyer. Distributed pasting of small votes. In F. Roli and J. Kittler, editors, Proc. 3d International Workshop on Multiple Classifier Systems, MCS'02, Cagliari, Italy. Volume 2364: Lecture Notes in Computer Science, pp. 51-62. Springer, 2002.
69. N. V. Chawla, A. Lazarevic, L. O. Hall, and K. W. Bowyer. SMOTEBoost: improving prediction of the minority class in boosting. In: Knowledge Discovery in Databases:PKDD 2003. Volume 2838: Lecture Notes in Computer Science, pp. 107-119. Springer, Berlin, Heidelberg, 2003.
70. N. V. Chawla and K. W. Bowyer. Random subspaces and subsampling for 2-d face recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (CVPR), Volume 2, pp. 582-589, 2005.
71. D. Chen and X. Cheng. An asymptotic analysis of some expert fusion methods. Pattern Recognition Letters, 22:901-904, 2001.
72. K. Chen, L. Wang, and H. Chi. Methods of combining multiple classifiers with different features and their applications to text-independent speaker identification. International Journal on Pattern Recognition and Artificial Intelligence, 11(3):417-445, 1997.
73. S. B. Cho. Pattern recognition with neural networks combined by genetic algorithm. Fuzzy Sets and Systems, 103:339-347, 1999.
74. S. S. Choi, S. H. Cha, and C. Tappert. Asurvey of binary similarity and distance measures. Journal on Systemics, Cybernetics and Informatics, 8(1):43-48, 2010.
75. Dan Claudiu Ciresan, Ueli Meier, Luca Maria Gambardella, and Jürgen Schmidhuber. Deep big simple neural nets excel on handwritten digit recognition. Neural Computation, 22:3207-3220, 2010.
76. W. W. Cohen. Fast effective rule induction. In: Twelfth International Conference on Machine Learning, pp. 115-123. Morgan Kaufmann, 1995.
77. T. M. Cover. The best two independent measurements are not the two best. IEEE Transactions on Systems, Man, and Cybernetics, 4:116-117, 1974.
78. P. Cunningham and J. Carney. Diversity versus quality in classification ensembles based on feature selection. Technical Report TCD-CS-2000-02, Department of Computer Science, Trinity College, Dublin, 2000.
79. D. Richard Cutler, Thomas C. Edwards Jr., Karen H. Beard, Adele Cutler, and Kyle T. Hess. Random forests for classification in ecology. Ecology, 88(11):2783-2792, 2007.
80. F. Cutzu. Polychotomous classification with pairwise classifiers: a new voting principle. In: Proc. 4th International Workshop on Multiple Classifier Systems (MCS 2003), Guildford, UK. Volume 2709: Lecture Notes in Computer Science, pp. 115-124. Springer, 2003.
81. B. V. Dasarathy. Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. IEEE Computer Society Press, Los Alamitos, CA, 1990.
82. B. V. Dasarathy and B. V. Sheela. A composite classifier system design: concepts and methodology. Proceedings of IEEE, 67:708-713, 1979.
83. M. Dash and H. Liu. Feature selection for classification. Intelligent Data Analysis, 1:131-156, 1997.
84. W. H. E. Day. Consensus methods as tools for data analysis. In: H. H. Bock, editor, Classification and Related Methods for Data Analysis, pp. 317-324. Elsevier Science Publishers B.V. (North Holland), 1988.
85. K. W. De Bock and D. Van den Poel. An empirical evaluation of rotation-based ensemble classifiers for customer churn prediction. Expert Systems with Applications, 38(10):12293-12301, 2011.
86. F. De Martino, G. Valente, N. Staeren, J. Ashburner, and R. Goebel a E. Formisano. Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns. NeuroImage, 43(1):44-58, 2008.
87. M. Demirekler and H. Altincay. Plurality voting-based multiple classifier systems: statistically independent with respect to dependent classifiers sets. Pattern Recognition, 35:2365-2379, 2002.
88. A. Demiriz, K. P. Bennett, and J. Shawe-Taylor. Linear programming boosting via column generation. Machine Learning, 46:225-254, 2002.
89. J.Demšar. Statistical comparison of classifiers over multiple data sets. Journal of Machine Learning Research, 7:1-30, 2006.
90. P. A. Devijver and J. Kittler. Pattern Recognition: A Statistical Approach. Prentice-Hall, Inc., Englewood Cliffs, NJ, 1982.
91. L. Didaci and G. Giacinto. Dynamic classifier selection by adaptive k-nearestneighbourhood rule. In: Proceedings of the 5th International Workshop on Multiple Classifier Systems. (MCS'04), Cambridge, UK. Volume 3077: Lecture Notes in Computer Science, pp. 174-183. Springer, 2004.
92. L. Didaci, G. Giacinto, F. Roli, and G. L. Marcialis. A study on the performances of dynamic classifier selection based on local accuracy estimation. Pattern Recognition, 38(11):2188-2191, 2005.
93. C. Dietrich, G. Palm, and F. Schwenker. Decision templates for the classification of bioacoustic time series. Information Fusion, 4:101-109, 2003.
94. T. Dietterich. An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting and randomization. Machine Learning, 40(2):139-157, 2000.
95. T. G. Dietterich. Ensemble methods in machine learning. In: J. Kittler and F. Roli, editors, Multiple Classifier Systems, Cagliari, Italy. Volume 1857: Lecture Notes in Computer Science, pp. 1-15. Springer, 2000.
96. T. G. Dietterich. Bias-variance analysis of ensemble learning. In: 7th Course of the International School on Neural Networks "E.R. Caianiello", Ensemble Methods for Learning Machines, Vietri-sul-Mare, Salerno-Italy, 2002.
97. T. G. Dietterich and G. Bakiri. Error-correcting output codes: a general method for improving multiclass inductive learning programs. In: Proc. 9th National Conference on Artificial Intelligence, AAAI-91, pp. 572-577. AAAI Press, 1991.
98. T. G. Dietterich and G. Bakiri. Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research, 2:263-286, 1995.
99. T. G. Dietterich. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation, 7(10):1895-1924, 1998.
100. C. Domingo and O.Watanabe. Madaboost: a modification of AdaBoost. In: Proceedings of the Thirteenth Annual Conference on Computational Learning Theory, COLT '00, San Francisco, CA, USA. pp. 180-189. Morgan Kaufmann, 2000.
101. P. Domingos. Why does bagging work? A Bayesian account and its implications. In:Knowledge Discovery and Data Mining, pp. 155-158. AAAI Press, 1997.
102. P. Domingos. A unified bias-variance decomposition and its applications. In: Proc. 7th International Conference on Machine Learning, Stanford, CA, pp. 231-238. Morgan Kaufmann, 2000.
103. P. Domingos and M. Pazzani. On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning, 29:103-130, 1997.
104. H. Drucker, C. Cortes, L. D. Jackel, Y. LeCun, and V. Vapnik. Boosting and other ensemble methods. Neural Computation, 6:1289-1301, 1994.
105. D. Dubois and H. Prade. A review of fuzzy set aggregation connectives. Information Sciences, 36:85-121, 1985.
106. R. O. Duda and P. E. Hart. Pattern Classification and Scene Analysis. John Wiley & Sons, New York, 1973.
107. R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification, 2nd edition. John Wiley & Sons, New York, 2001.
108. R. P. W. Duin. The combining classifier: to train or not to train? In: Proc. 16th International Conference on Pattern Recognition, ICPR'02, Canada, pp. 765-770. IEEE Computer Society, 2002.
109. R. P. W. Duin and D. M. J. Tax. Experiments with classifier combination rules. In: J. Kittler and F. Roli, editors, Multiple Classifier Systems, Cagliari, Italy. Volume 1857:Lecture Notes in Computer Science, pp. 16-29, Springer, 2000.
110. R. P. W. Duin. A note on comparing classifiers. Pattern Recognition Letters, 17:529-536, 1996.
111. K. Dunne, P. Cunningham, and F. Azuaje. Solution to instability problems with sequential wrapper-based approaches to feature selection. Technical Report TCD-CS-2002-28, Department of Computer Science, Trinity College, Dublin, 2002.
112. S. Džeroski and B. Ženko. Is combining classifiers with stacking better than selecting the best one? Machine Learning, 54(3):255-273, 2004.
113. D. E. Eckhardt and L. D. Lee. A theoretical basis for the analysis of multiversion software subject to coincident errors. IEEE Transactions on Software Engineering, 11(12):1511-1517, 1985.
114. N. Edakunni, G. Brown, and T. Kovacs. Boosting as a product of experts. In: Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence, pp. 187-194. Association for Uncertainty in Artificial Intelligence Press, 2011.
115. B. Efron and R. Tibshirani. An Introduction to the Bootstrap. Chapman & Hall, New York, 1993.
116. M. Egmont-Petersen, W. R. M. Dassen, and J. H. C. Reiber. Sequential selection of discrete features for neural networks-a Bayesian approach to building a cascade. Pattern Recognition Letters, 20(11-13):1439-1448, 1999.
117. G. Eibl and K. P. Pfeiffer. How to make AdaBoost.M1 work for weak base classifiers by changing only one line of the code. In: Proceedings of the 13th European Conference on Machine Learning, ECML '02, pp. 72-83. Springer, Lecture Notes in Computer Science, 2002.
118. G. Eibl and K.-P. Pfeiffer. Multiclass boosting for weak classifiers. Journal of Machine Learning Research, 6:189-210, 2005.
119. R. Elwell and R. Polikar. Incremental learning of concept drift in nonstationary environments. IEEE Transactions on Neural Networks, 22(10):1517-1531, 2011.
120. H. Erdogan and M. U. Sen. A unifying framework for learning the linear combiners for classifier ensembles. In: Proceedings of the 20th International Conference on Pattern Recognition (ICPR), pp. 2985-2988. IEEE, 2010.
121. S. Escalera, O. Pujol, and P. Radeva. Error-correcting output codes library. Journal of Machine Learning Research, 11:661-664, 2010.
122. S. Escalera, O. Pujol, and P. Radeva. On the decoding process in ternary errorcorrecting output codes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(1):120-134, 2010.
123. S. Escalera, D. M. J. Tax, O. Pujol, P. Radeva, and R. P. W. Duin. Subclass problemdependent design for error-correcting output codes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(6):1041-1054, 2008.
124. F. Esposito, D. Malerba, and G. Semeraro. A comparative analysis of methods for pruning decision trees. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(5):476-491, 1997.
125. A. Esuli, T. Fagni, and F. Sebastiani. MP-Boost: a multiple-pivot boosting algorithm and its application to text categorization. In: String Processing and Information Retrieval. Volume 4209: Lecture Notes in Computer Science, pp. 1-12. Springer, Berlin, Heidelberg, 2006.
126. B. Everitt. Cluster Analysis. John Wiley and Sons, New York, 1993.
127. R. A. Fisher. The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7:179-188, 1936.
128. J. L. Fleiss. Statistical Methods for Rates and Proportions. John Wiley & Sons, 1981.
129. G. Forman. An extensive empirical study of feature selection metrics for text classification. Journal of Machine Learning Research, 3:1289-1305, 2003.
130. E. Frank and S. Kramer. Ensembles of nested dichotomies for multi-class problems. In: Proceedings of the 21st International Conference of Machine Learning (ICML), pp. 305-312. ACM Press, 2004.
131. Y. Freund. An adaptive version of the boost by majority algorithm. Machine Learning, 43(3):293-318, 2001.
132. Y. Freund. A more robust boosting algorithm, eprint arXiv:0905.2138, Statistics -Machine Learning, 2009.
133. Y. Freund and R. E. Schapire. Experiments with a new boosting algorithm. In: Thirteenth International Conference on Machine Learning, San Francisco, pp. 148-156, Morgan Kaufmann, 1996.
134. Y. Freund and R. E. Schapire. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1):119-139, 1997.
135. Y. Freund and R. E. Schapire. Discussion of the paper "Arcing Classifiers" by Leo Breiman. The Annals of Statistics, 26(3):824-832, 1998.
136. J. Friedman, T. Hastie, and R. Tibshirani. Additive logistic regression: a statistical view of boosting. Annals of Statistics, 28(2):337-374, 2000.
137. J. H. Friedman. Regularized discriminant analysis. Journal of the American Statistical Association, 84(405):165-175, 1989.
138. J. H. Friedman. Stochastic gradient boosting. Computational Statistics and Data Analysis, 38:367-378, 2002.
139. N. Friedman, D. Geiger, and M. Goldszmid. Bayesian network classifiers. Machine Learning, 29(2):131-163, 1997.
140. K. S. Fu. Syntactic Pattern Recognition and Applications. Prentice Hall, Englewood Cliffs, NJ, 1982.
141. K. Fukunaga. Introduction to Statistical Pattern Recognition. Academic Press, Orlando, FL, 1972.
142. K. Fukushima. Cognitron: a self-organizing multilayered neural network. Biological Cybernetics, 20:121-136, 1975.
143. G. Fumera and F. Roli. Performance analysis and comparison of linear combiners for classifier fusion. In: Proc. 16th International Conference on Pattern Recognition. IEEE Computer Society, 2002.
144. G. Fumera and F. Roli. Linear combiners for classifier fusion: some theoretical and experimental results. In: T. Windeatt and F. Roli, editors, Proc. 4rd Int. Workshop on Multiple Classifier Systems (MCS 2003), Guildford, UK. Volume 2709: Lecture Notes in Computer Science, pp. 74-83. Springer, 2003.
145. G. Fumera and F. Roli. A theoretical and experimental analysis of linear combiners for multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27:942-956, 2005.
146. J. Gamma and P. Brazdil. Cascade generalization. Machine Learning, 41(3):315-343, 2000.
147. S. García and F. Herrera. An extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all pairwise comparisons. Journal of Machine Learning Research, 9:2677-2694, 2008.
148. N. García-Pedrajas, J. Maudes-Raedo, C. García-Osorio, and J. J. Rodríguez-Díez. Supervised subspace projections for constructing ensembles of classifiers. Information Sciences, 193:1-21, 2012.
149. P. Geurts, D. deSeny, M. Fillet, M.-A. Meuwis, M. Malaise, M.-P. Merville, and L. Wehenkel. Proteomic mass spectra classification using decision tree based ensemble methods. Bioinformatics, 21(14):3138-3145, 2005.
150. S. Ghahramani. Fundamentals of Probability, 2nd edition. Prentice Hall, Englewood Cliffs, NJ, 2000.
151. J. Ghosh. Multiclassifier systems: back to the future. In: F. Roli and J. Kittler, editors, Proc. 3d InternationalWorkshop on Multiple Classifier Systems, MCS'02, Cagliari, Italy. Volume 2364: Lecture Notes in Computer Science, pp. 1-15. Springer, 2002.
152. K. Ghosh, Y. S. Ng, and R. Srinivasan. Evaluation of decision fusion strategies for effective collaboration among heterogeneous fault diagnostic methods. Computers & Chemical Engineering, 35(2):342-355, 2011.
153. G. Giacinto and F. Roli. Dynamic classifier selection. In: Proceedings of the First International Workshop on Multiple Classifier Systems, Lecture Notes in Computer Science, pp. 177-189. Springer, 2000.
154. G. Giacinto and F. Roli. An approach to the automatic design of multiple classifier systems. Pattern Recognition Letters, 22:25-33, 2001.
155. G. Giacinto and F. Roli. Design of effective neural network ensembles for image classification processes. Image Vision and Computing Journal, 19(9-10):699-707, 2001.
156. G. Giacinto and F. Roli. Dynamic classifier selection based on multiple classifier behaviour. Pattern Recognition, 34(9):1879-1881, 2001.
157. P. O. Gislason, J. A. Benediktsson, and J. R. Sveinsson. Random forests for land cover classification. Pattern Recognition Letters, 27(4):294-300, 2006.
158. A. D. Gordon. Classification. Chapman & Hall /CRC, Boca Raton, FL, 1999.
159. B. Grofman, G. Owen, and S. L. Feld. Thirteen theorems in search of the truth. Theory and Decisions, 15:261-278, 1983.
160. V. Grossi and F. Turini. Stream mining: a novel architecture for ensemble-based classification. Knowledge and Information Systems, 30:247-281, 2012.
161. Y. Guermeur. Combining discriminant models with new multi-class SVMs. Pattern Analysis & Applications, 5(2):168-179, 2002.
162. C. Guerra-Salcedo and D. Whitley. Genetic approach to feature selection for ensemble creation. In: Proc. Genetic and Evolutionary Computation Conference, pp. 236-243. Morgan Kaufmann, 1999.
163. S. Günter and H. Bunke. Creation of classifier ensembles for handwritten word recognition using feature selection algorithms. In: Proc. 8th InternationalWorkshop on Frontiers in Handwriting Recognition, Canada, 2002.
164. I. Guyon and A. Elisseeff. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
165. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik. Gene selection for cancer classification using support vector machines. Machine Learning, 46:389-422, 2002.
166. M. S. Haghighi, A. Vahedian, and H. S. Yazdi. Creating and measuring diversity in multiple classifier systems using support vector data description. Applied Soft Computing, 11(8):4931-4942, 2011.
167. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H.Witten. The WEKA data mining software: an update. SIGKDD Explorations, 11, 2009.
168. J. Ham, Y. C. Chen, M. M. Crawford, and J. Ghosh. Investigation of the random forest framework for classification of hyperspectral data. IEEE Transactions on Geoscience and Remote Sensing, 43(3):492-501, 2005.
169. M. Han, X. Zhu, and W. Yao. Remote sensing image classification based on neural network ensemble algorithm. Neurocomputing, 78:133-138, 2012.
170. Y. Han and L. Yu. A variance reduction framework for stable feature selection. In: 2010 IEEE International Conference on Data Mining, pp. 206-215, 2010.
171. B. Hanczar, J. Hua, C. Sima, J.Weinstein, M. Bittner, and E. R. Dougherty. Small-sample precision of ROC-related estimates. Bioinformatics (Oxford, England), 26(6):822-830, 2010.
172. D. J. Hand and K. Yu. Idiot's Bayes-not so stupid after all? International Statistical Review, 69:385-398, 2001.
173. D. J. Hand. Classifier technology and the illusion of progress (with discussion). Statistical Science, 21:1-34, 2006.
174. L. K. Hansen and P. Salamon. Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(10):993-1001, 1990.
175. S. Hashem. Optimal linear combinations of neural networks. Neural Networks, 10(4):599-614, 1997.
176. S. Hashem. Treating harmful collinearity in neural network ensembles. In: A. J. C. Sharkey, editor, Combining Artificial Neural Nets, pp. 101-125. Springer, London, 1999.
177. S. Hashem, B. Schmeiser, and Y. Yih. Optimal linear combinations of neural networks:an overview. In: IEEE International Conference on Neural Networks, Orlando, FL, pp. 1507-1512. IEEE, 1994.
178. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer, New York, 2001.
179. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Data Mining, Inference, and Prediction, 2nd edition. Springer, 2009.
180. S. Haykin. Neural Networks. A Comprehensive Foundation. Macmillan College Publishing Company, New York, 1994.
181. D. Hernandez-Lobato, G. Martinez-Mu noz, and A. Suarez. How large should ensembles of classifiers be? Pattern Recognition, 46(5):1323-1336, 2013.
182. T. K. Ho. The random space method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8):832-844, 1998.
183. T. K. Ho. Multiple classifier combination: lessons and the next steps. In: A. Kandel and H. Bunke, editors, Hybrid Methods in Pattern Recognition, pp. 171-198. World Scientific, 2002.
184. T. K. Ho, J. J. Hull, and S. N. Srihari. Decision combination in multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16:66-75, 1994.
185. R. C. Holte. Very simple classification rules perform well on most commonly used datasets. Machine Learning, 11(1):63-91, 1993.
186. T. Hothorn and B. Lausen. Double-bagging: combining classifiers by bootstrap aggregation. Pattern Recognition, 36(6):1303-1309, 2003.
187. R. Hu and R. I. Damper. A 'No Panacea Theorem' for multiple classifier combination. In: The 18th International Conference on Pattern Recognition (ICPR'06), Hong Kong, IEEE Computer Society, 2006.
188. Y.-M. Huang, C.-M. Hung, and H. C. Jiau. Evaluation of neural networks and data mining methods on a credit assessment task for class imbalance problem. Nonlinear Analysis:Real World Applications, 7:720-747, 2006.
189. Y. S. Huang and C. Y. Suen. A method of combining multiple classifiers-a neural network approach. In: 12th International Conference on Pattern Recognition, Jerusalem, Israel, pp. 473-475. IEEE Computer Society, 1994.
190. Y. S. Huang and C. Y. Suen. A method of combining multiple experts for the recognition of unconstrained handwritten numerals. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17:90-93, 1995.
191. H. Ishwaran, U. B. Kogalur, E. H. Blackstone, and M. S. Lauer. Random survival forests. Annals of Applied Statistics, 2(3):841-860, 2008.
192. K. Jackowski and M.Wozniak. Method of classifier selection using the genetic approach. Expert Systems, 27(2):114-128, 2010.
193. R. A. Jacobs. Methods for combining experts' probability assessments. Neural Computation, 7:867-888, 1995.
194. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton. Adaptive mixtures of local experts. Neural Computation, 3:79-87, 1991.
195. A. K. Jain and R. C. Dubes. Algorithms for Clustering Data. Prentice Hall, Englewood Cliffs, NJ, 1988.
196. A. K. Jain and J. Mao. Guest editorial: special issue on artificial neural networks and statistical pattern recognition. IEEE Transactions on Neural Networks, 8(1):1-3, 1997.
197. B. Jin, A. Strasburger, S. Laken, F. A. Kozel, K. Johnson, M. George, and X. Lu. Feature selection for fMRI-based deception detection. BMC Bioinformatics, 10(Suppl 9):S15, 2009.
198. M. I. Jordan and R. A. Jacobs. Hierarchies of adaptive experts. In: International Conference on Neural Networks, San Diego, CA, pp. 192-196. IEEE, 1992.
199. M. I. Jordan and L. Xu. Convergence results for the EM approach to mixtures of experts architectures. Neural Networks, 8:1409-1431, 1995.
200. A. Jóźwik and G. Vernazza. Recognition of leucocytes by a parallel k-nn classifier. In: Proc. International Conference on Computer-Aided Medical Diagnosis, Warsaw, pp. 138-153, 1987.
201. A. Kalousis, J. Prados, and M. Hilario. Stability of feature selection algorithms. In: Proc. 5th IEEE International Conference on Data Mining (ICDM'05), pp. 218-225. IEEE, 2005.
202. E. M. Karabulut and T. Ibrikci. Effective diagnosis of coronary artery disease using the rotation forest ensemble method. Journal of Medical systems, 36(5):3011-3018, 2012.
203. T. Kavzoglu and I. Colkesen. An assessment of the effectiveness of a rotation forest ensemble for land-use and land-cover mapping. International Journal of Remote Sensing, 34(12):4224-4241, 2013.
204. H. Kim, H. Kim, H. Moon, and H. Ahn. Aweight-adjusted voting algorithm for ensembles of classifiers. Journal of the Korean Statistical Society, 40(4):437-449, 2011.
205. K. Kira and L. A. Rendell. Apractical approach to feature selection. In: Proceedings of the Ninth International Workshop on Machine Learning, pp. 249-256. Morgan Kaufmann, 1992.
206. J. Kittler and F. M. Alkoot. Relationship of sum and vote fusion strategies. In: F. Roli and J. Kittler, editors, Proc. Second International Workshop on Multiple Classifier Systems, MCS'01, Cambridge, UK. Volume 2096: Lecture Notes in Computer Science, pp. 339-348. Springer, 2001.
207. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3):226-239, 1998.
208. J. Kittler, A. Hojjatoleslami, and T.Windeatt. Strategies for combining classifiers employing shared and distinct representations. Pattern Recognition Letters, 18:1373-1377, 1997.
209. A. Klautau, N. Jevtić, and A. Orlitsky. On nearest-neighbor error-correcting output codes with application to all-pairs multiclass support vector machines. Journal of Machine Learning Research, 4:1-15, 2003.
210. E. M. Kleinberg. On the algorithmic implementation of stochastic discrimination. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(5):473-490, 2000.
211. A. H. R. Ko, R. Sabourin, A. de Souza Britto Jr., and L. Oliveira. Pairwise fusion matrix for combining classifiers. Pattern Recognition, 40(8):2198-2210, 2007.
212. R. Kohavi. Scaling up the accuracy of Naive-Bayes classifiers: a decision-tree hybrid. In: Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, 1996.
213. R. Kohavi, B. Becker, and D. Sommerfield. Improving simple Bayes. Technical report, Data Mining and Visualization Group, Silicon Graphics Inc, California, 1997.
214. R. Kohavi and G. John. Wrappers for feature subset selection. Artificial Intelligence Journal, 97:273-324, 1997.
215. R. Kohavi and D. H. Wolpert. Bias plus variance decomposition for zero-one loss functions. In: L. Saitta, editor, Machine Learning: Proc. 13th International Conference, pp. 275-283. Morgan Kaufmann, 1996.
216. R. Kohavi. A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the 14th International Joint Conference on Artificial Intelligence - Volume 2, IJCAI'95, pp. 1137-1143. Morgan Kaufmann Publishers Inc. San Francisco, CA, USA, 1995.
217. E. B.Kong and T. G. Dietterich. Error-correcting output coding corrects bias and variance. In: Proc. 12th International Conference on Machine Learning, California, pp. 313-321. Morgan Kaufmann, 1995.
218. I. Kononenko. Inductive and Bayesian learning in medical diagnosis. Applied Artificial Intelligence, 7:317-337, 1993.
219. P. Krizek, J. Kittler, and V. Hlavac. Improving stability of feature selection methods. In:Proceedings of the 12th International Conference on Computer Analysis of Images and Patterns, Berlin, Heidelberg. Volume 4673: CAIP'07, pages 929-936. Springer-Verlag, 2007.
220. A. Krogh and J. Vedelsby. Neural network ensembles, cross validation and active learning. In: G. Tesauro, D. S. Touretzky, and T. K. Leen, editors, Advances in Neural Information Processing Systems. Volume 7, pp. 231-238. MIT Press, Cambridge, MA, 1995.
221. S. Kumar, J. Ghosh, and M. M. Crawford. Hierarchical fusion of multiple classifiers for hyperspectral data analysis. Pattern Analysis & Applications, 5(2):210-220, 2002.
222. L. I. Kuncheva. 'fuzzy' vs 'non-fuzzy' in combining classifiers designed by boosting. IEEE Transactions on Fuzzy Systems, 11(6):729-741, 2003.
223. L. I. Kuncheva. Combining Pattern Classifiers. Methods and Algorithms. JohnWiley and Sons, New York, 2004.
224. L. I. Kuncheva. Using diversity measures for generating error-correcting output codes in classifier ensembles. Pattern Recognition Letters, 26:83-90, 2005.
225. L. I.Kuncheva and C. O. Plumpton. Choosing parameters for random subspace ensembles for fMRI classification. In: Proc. Proc. Multiple Classifier Systems (MCS'10), Cairo, Egypt, pp. 124-133. Springer, 2010.
226. L. I. Kuncheva and J. J. Rodríguez. An experimental study on rotation forest ensembles. In: Proceedings of the 7th International Workshop on Multiple Classifier Systems (MCS'07), Prague, Czech Republic. Volume 4472: Lecture Notes in Computer Science, pp. 459-468. Springer, 2007.
227. L. I. Kuncheva and J. J. Rodríguez. Classifier ensembles for fMRI data analysis: an experiment. Magnetic Resonance Imaging, 28(4):583-593, 2010.
228. L. I. Kuncheva, J. J. Rodríguez, C. O. Plumpton, D. E. J. Linden, and S. J. Johnston. Random subspace ensembles for fMRI classification. IEEE Transactions on Medical Imaging, 29(2):531-542, 2010.
229. L. I.Kuncheva, C. J. Smith, S.Yasir, C. O. Phillips, and K. E. Lewis. Evaluation of feature ranking ensembles for high-dimensional biomedical data: a case study. In: Proceedings of theWorkshop on Biological Data Mining and its Applications in Healthcare (BioDM), IEEE 12th International Conference on Data Mining, Brussels, Belgium, pp. 49-56. IEEE, 2012.
230. L. I. Kuncheva. Change-glasses approach in pattern recognition. Pattern Recognition Letters, 14:619-623, 1993.
231. L. I.Kuncheva. On combining multiple classifiers. In: Proc. 7th International Conference on Information Processing and Management of Uncertainty (IPMU'98), Paris, France, pp. 1890-1891, 1998. ISBN 2-9516453-2-5.
232. L. I. Kuncheva. Clustering-and-selection model for classifier combination. In: Proc. Knowledge-Based Intelligent Engineering Systems and Applied Technologies, Brighton, UK, pp. 185-188, 2000.
233. L. I. Kuncheva. Using measures of similarity and inclusion for multiple classifier fusion by decision templates. Fuzzy Sets and Systems, 122(3):401-407, 2001.
234. L. I. Kuncheva. Switching between selection and fusion in combining classifiers: an experiment. IEEE Transactions on Systems, Man, and Cybernetics, 32(2):146-156, 2002.
235. L. I. Kuncheva. A theoretical study on six classifier fusion strategies. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(2):281-286, 2002.
236. L. I. Kuncheva. A stability index for feature selection. In: Proc. IASTED, Artificial Intelligence and Applications, Innsbruck, Austria, pp. 390-395, 2007.
237. L. I.Kuncheva, J. C. Bezdek, and R. P.W. Duin. Decision templates for multiple classifier fusion: an experimental comparison. Pattern Recognition, 34(2):299-314, 2001.
238. L. I. Kuncheva and L. C. Jain. Designing classifier fusion systems by genetic algorithms. IEEE Transactions on Evolutionary Computation, 4(4):327-336, 2000.
239. L. I. Kuncheva and J. J. Rodríguez. Classifier ensembles with a random linear oracle. IEEE Transactions on Knowledge and Data Engineering, 19(4):500-508, 2007.
240. L. I. Kuncheva, C. J. Whitaker, C. A. Shipp, and R. P.W. Duin. Is independence good for combining classifiers? In: Proc. 15th International Conference on Pattern Recognition, Barcelona, Spain, Volume 2, pp. 169-171. IEEE Computer Society, 2000.
241. L. I. Kuncheva, C. J. Whitaker, C. A. Shipp, and R. P. W. Duin. Limits on the majority vote accuracy in classifier fusion. Pattern Analysis and Applications, 6:22-31, 2003.
242. L. I.Kuncheva. Genetic algorithm for feature selection for parallel classifiers. Information Processing Letters, 46(4):163-168, 1993.
243. L. I. Kuncheva. A bound on kappa-error diagrams for analysis of classifier ensembles. IEEE Transactions on Knowledge and Data Engineering, 25(3):494-501, 2013.
244. L. I. Kuncheva and J. J. Rodríguez. A weighted voting framework for classifiers ensembles. Knowledge and Information Systems 38, 259-275, 2014.
245. P. A. Lachenbruch. Multiple reading procedures: the performance of diagnostic tests. Statistics in Medicine, 7:549-557, 1988.
246. C. Lai, M. J. T. Reinders, and L. Wessels. Random subspace method for multivariate feature selection. Pattern Recognition Letters, 27(10):1067-1076, 2006.
247. L. Lam. Classifier combinations: implementations and theoretical issues. In: J. Kittler and F. Roli, editors, Multiple Classifier Systems, Cagliari, Italy. Volume 1857: Lecture Notes in Computer Science, pp. 78-86. Springer, 2000.
248. L. Lam and A. Krzyzak. A theoretical analysis of the application of majority voting to pattern recognition. In: 12th International Conference on Pattern Recognition, Jerusalem, Israel, pp. 418-420. IEEE Computer Society, 1994.
249. L. Lam and C. Y. Suen. Optimal combination of pattern classifiers. Pattern Recognition Letters, 16:945-954, 1995.
250. L. Lam and C. Y. Suen. Application of majority voting to pattern recognition: an analysis of its behavior and performance. IEEE Transactions on Systems, Man, and Cybernetics, 27(5):553-568, 1997.
251. P. Langley. Selection of relevant features in machine learning. In: Proc. AAAI Fall Symposium on Relevance, pp. 140-144, 1994.
252. P. Langley. The changing science of machine learning. Machine Learning, 82:275-279, 2011.
253. P. Langley,W. Iba, and K. Thompson. An analysis of Bayesian classifiers. In: Proceedings of the 10th National Conference on Artificial Intelligence, pages 399-406. AAAI Press, Menlo Park, California, 1992.
254. P. Latinne, O. Debeir, and C. Decaestecker. Different ways of weakening decision trees and their impact on classification accuracy of DT combination. In: J. Kittler and F. Roli, editors, Multiple Classifier Systems, Cagliari, Italy. Volume 1857: Lecture Notes in Computer Science, pp. 200-209. Springer, 2000.
255. A. Lazarevic and Z. Obradovic. Adaptive boosting techniques in heterogeneous and spatial databases. Intelligent Data Analysis, 5:1-24, 2001.
256. T. Lee, J. A. Richards, and P. H. Swain. Probabilistic and evidential approaches for multisource data analysis. IEEE Transactions on Geoscience and Remote Sensing, 25(3):283-293, 1987.
257. Li, S., Hou, X., Zhang, H. & Cheng, Q. Learning Spatially Localized, Parts-Based Representation, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2001, 1, I-207-I-212.
258. Y. Li, M. Dong, and R. Kothari. Classifiability-based omnivariate decision trees. IEEE Transactions on Neural Networks, 16(6):1547-1560, 2005.
259. A. Liawand M.Wiener. Classification and regression by randomForest.RNews, 2(3):18-22, 2002.
260. X. Lin, S. Yacoub, J. Burns, and S. Simske. Performance analysis of pattern classifier combination by plurality voting. Pattern Recognition Letters, 24(12):1795-1969, 2003.
261. F. Lingenfelser, J. Wagner, and E. André. A systematic discussion of fusion techniques for multi-modal affect recognition tasks. In: Proceedings of the 13th International Conference on Multimodal Interfaces, ICMI'11, pp. 19-26. ACM New York, NY, USA, 2011.
262. B. Littlewood and D. R. Miller. Conceptual modeling of coincident failures in multiversion software. IEEE Transactions on Software Engineering, 15(12):1596-1614, 1989.
263. H. Liu, R. Stine, and L. Auslender, editors. Proceedings of the Workshop on Feature Selection for Data Mining, Newport Beach, CA, 2005.
264. K.-H. Liu and D.-S. Huang. Cancer classification using Rotation Forest. Computers in Biology and Medicine, 38(5):601-610, 2008.
265. T. Löfström. Estimating, optimizing and combining diversity and performance measures in ensemble creation. PhD thesis, Department of Technology, Orebro University, 2008.
266. P. Long and R. Servedio. Martingale boosting. In Proceedings of the 18th Annual Conference on Computational Learning Theory (COLT), pp. 79-94. Springer, Lecture Notes in Computer Science, 2005.
267. P. M. Long and V. B. Vega. Boosting and microarray data. Machine Learning, 52:31-44, 2003.
268. C. G. Looney. Pattern Recognition Using Neural Networks. Theory and Algorithms for Engineers and Scientists. Oxford University Press, Oxford, 1997.
269. W. S. MacCulloch and W. Pitts. A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics, 5:115-133, 1943.
270. S. Mao, L. C. Jiao, L. Xiong, and S. Gou. Greedy optimization classifiers ensemble based on diversity. Pattern Recognition, 44(6):1245-1261, 2011.
271. D. D. Margineantu and T. G. Dietterich. Pruning adaptive boosting. In: Proc. 14th International Conference on Machine Learning, San Francisco, CA, pp. 378-387. Morgan Kaufmann, 1997.
272. A. I. Marques, V. Garcia, and J. S. Sanchez. Two-level classifier ensembles for credit risk assessment. Expert Systems with Applications, 39(12):10916-10922, 2012.
273. G. Martinez-Muñoz, D. Hernandez-Lobato, and A. Suarez. An analysis of ensemble pruning techniques based on ordered aggregation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(2):245-259, 2009.
274. L. Mason, P. L. Bartlet, and J. Baxter. Improved generalization through explicit optimization of margins. Machine Learning, 38(3):243-255, 2000.
275. F. Masulli and G. Valentini. Comparing decomposition methods for classification. In:Proc. International Conference on Knowledge-Based Intelligent Engineering Systems and Applied Technologies (Kes 2000), Brighton, UK, pp. 788-792, 2000.
276. F. Masulli and G. Valentini. Effectiveness of error-correcting output codes in multiclass learning problems. In: J. Kittler and F. Roli, editors, Multiple Classifier Systems Cagliari, Italy. Volume 1857: Lecture Notes in Computer Science, pp. 107-116. Springer, 2000.
277. O. Matan. On voting ensembles of classifiers (extended abstract). In: Proceedings of AAAI-96 Workshop on Integrating Multiple Learned Models, pp. 84-88. AAAI Press, 1996.
278. J. Maudes, J. J. Rodríguez, C. Garcia-Osorio, and N. Garcia-Pedrajas. Random feature weights for decision tree ensemble construction. Information Fusion, 13(1):20-30, 2012.
279. J. Meynet and J.-P. Thiran. Information theoretic combination of pattern classifiers. Pattern Recognition, 43(10):3412-3421, 2010.
280. L. Miclet and A. Cornuéjols. What is the place of Machine Learning between Pattern Recognition and Optimization? In: Proceedings of the TML-2008 Conference (Teaching Machine Learning), Saint-Etienne, France, 2008.
281. D. J. Miller and L. Yan. Critic-driven ensemble classification. IEEE Transactions on Signal Processing, 47(10):2833-2844, 1999.
282. M. Minsky and S. Papert. Perceptrons: An Introduction to Computational Geometry. MIT Press, Cambridge, MA, 1969.
283. P. Moerland and E. Mayoraz. Dynaboost: combining boosted hypotheses in a dynamic way. Technical Report IDIAP-RR99-09, IDIAP (Dalle Molle Institute for Perceptual Artificial Intelligence), 1999.
284. L. C. Molina, L. Belanche, and A. Nebot. Feature selection algorithms: a survey and experimental evaluation. In: Proc. the IEEE International Conference on Data Mining (ICDM'02), Japan. IEEE Computer Society, 2002.
285. A. M. Mood, F. A. Graybill, and D. C. Boes. Introduction to the Theory of Statistics, 3rd edition. McGraw-Hill Series in Probability and Statistics. McGraw-Hill, 1974.
286. C. Nadeau and Y. Bengio. Inference for the generalization error. Machine Learning, 62:239-281, 2003.
287. G. Nagy. Candide's practical principles of experimental pattern recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5(2):199-200, 1983.
288. L. Nanni and A. Lumini. An experimental comparison of ensemble of classifiers for bankruptcy prediction and credit scoring. Expert Systems with Applications, 36(2, Part 2):3028-3033, 2009.
289. K. C. Ng and B. Abramson. Consensus diagnosis: a simulation study. IEEE Transactions on Systems, Man, and Cybernetics, 22:916-928, 1992.
290. N. J. Nilsson. Learning Machines. McGraw-Hill, New York, 1962.
291. S. J. Nowlan and G. E. Hinton. Evaluation of adaptive mixtures of competing experts. In: R. P. Lippmann, J. E. Moody, and D. S. Touretzky, editors, Advances in Neural Information Processing Systems 3, pp. 774-780. Morgan Kaufmann, 1991.
292. S.-B. Oh. On the relationship between majority vote accuracy and dependency in multiple classifier systems. Pattern Recognition Letters, 24:359-363, 2003.
293. D. Opitz and J. Shavlik. A genetic algorithm approach for creating neural network ensembles. In: A. J. C. Sharkey, editor, Combining Artificial Neural Nets, pp. 79-99. Springer, London, 1999.
294. D. W. Opitz. Feature selection for ensembles. In: Proc. 16th National Conference on Artificial Intelligence, (AAAI), Orlando, FL, pp. 379-384. AAAI Press, 1999.
295. N. Oza and K. Tumer. Input decimation ensembles: decorrelation through dimensionality reduction. In: Proc. 12nd International Workshop on Multiple Classifier Systems, MCS'01, Cambridge, UK. Volume 2096: Lecture Notes in Computer Science, pp. 238-247. Springer, 2001.
296. N. C. Oza. Boosting with averaged weight vectors. In: T. Windeatt and F. Roli, editors, Proc. 4rd Int. Workshop on Multiple Classifier Systems (MCS 2003), Guildford, UK. Volume 2709: Lecture Notes in Computer Science, pp. 15-24. Springer, 2003.
297. N. C. Oza and K. Tumer. Classifier ensembles: select real-world applications. Information Fusion, 9(1):4-20, 2008.
298. A. Ozcift. SVM feature selection based rotation forest ensemble classifiers to improve computer-aided diagnosis of Parkinson disease. Journal of Medical Systems, 36(4):2141-2147, 2012.
299. M. Pal. Random forest classifier for remote sensing classification. International Journal of Remote Sensing, 26(1):217-222, 2005.
300. I. Partalas, G. Tsoumakas, and I. Vlahavas. Pruning an ensemble of classifiers via reinforcement learning. Neurocomputing, 72:1900-1909, 2009.
301. I. Partalas, G. Tsoumakas, and I. Vlahavas. An ensemble uncertainty aware measure for directed hill climbing ensemble pruning. Machine Learning, 81(3):257-282, 2010.
302. D. Partridge andW. Krzanowski. Refining multiple classifier system diversity. Technical Report 348, Computer Science Department, University of Exeter, UK, 2003.
303. D. Partridge and W. J. Krzanowski. Software diversity: practical statistics for its measurement and exploitation. Information & Software Technology, 39:707-717, 1997.
304. A. Passerini, M. Pontil, and P. Frasconi. New results on error correcting output codes of kernel machines. IEEE Transactions on Neural Networks, 15(1):45-54, 2004.
305. E. A. Patrick. Fundamentals of Pattern Recognition. Prentice-Hall, Inc., Englewood Cliffs, NJ, 1972.
306. E. Pȩkalska, R. P. W. Duin, and M. Skurichina. A discussion on the classifier projection space for classifier combining. In: F. Roli and J. Kittler, editors, Proc. 3rd International Workshop on Multiple Classifier Systems, MCS'02, Cagliari, Italy. Volume 2364: Lecture Notes in Computer Science, pp. 137-148. Springer, 2002.
307. E. Pȩkalska, M. Skurichina, and R. P. W. Duin. Combining Fisher linear discriminant for dissimilarity representations. In: J. Kittler and F. Roli, editors, Multiple Classifier Systems, Cagliari, Italy. Volume 1857: Lecture Notes in Computer Science, pp. 230-239. Springer, 2000.
308. F. Pereira, T. Mitchell, and M. Botvinick. Machine learning classifiers and fMRI: a tutorial overview. NeuroImage, 45(1, Supplement 1):S199-S209, 2009.
309. W. Pierce. Improving reliability of digital systems by redundancy and adaptation. PhD thesis, Electrical Engineering, Stanford University, 1961.
310. J. Platt. Probabilistic outputs for support vector machines and comparison to regularized likelihood methods. In: A. J. Smola, P. Bartlett, B. Schoelkopf, and D. Schuurmans, editors, Advances in Large Margin Classifiers, pp. 61-74. MIT Press, 2000.
311. R. Polikar. Ensemble based systems in decision making. IEEE Circuits and Systems Magazine, 6:21-45, 2006.
312. S. Prabhakar and A. K. Jain. Decision-level fusion in fingerprint verification. Pattern Recognition, 35(4):861-874, 2002.
313. L. Prechelt. PROBEN1-A set of neural network benchmark problems and benchmarking rules. Technical Report 21/94, University of Karlsruhe, Karlsruhe, Germany, 1994.
314. F. Provost and P. Domingos. Tree induction for probability-based ranking. Machine Learning, 52(3):199-215, 2003.
315. P. Pudil, J. Novovičová, and J. Kittler. Floating search methods in feature selection. Pattern Recognition Letters, 15:1119-1125, 1994.
316. O. Pujol, S. Escalera, and P. Radeva. An incremental node embedding technique for error correcting output codes. Pattern Recognition, 41:713-725, 2008.
317. O. Pujol, P. Radeva, and J. Vitria. Discriminant ECOC: a heuristic method for application dependent design of error correcting output codes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(6):1007-1012, 2006.
318. S. Puuronen, A. Tsymbal, and I. Skrypnyk. Correlation-based and contextual meritbased ensemble feature selection. In: Proc. 4th International Conference on Advances in Intelligent Data Analysis, IDA'01, Cascais, Portugal. Volume 2189: Lecture Notes in Computer Science, pp. 135-144. Springer, 2001.
319. J. R. Quinlan. Bagging, boosting and C4.5. In: Proc 13rd Int. Conference on Artificial Intelligence AAAI-96, Cambridge, MA, pp. 725-730. AAAI Press, 1996.
320. J. R. Quinlan. Induction of decision trees. Machine Learning, 1(1):81-106, 1986.
321. R. Ranawana and V. Palade. Multi-classifier systems: review and a roadmap for developers. International Journal of Hybrid Intelligent Systems, 3(1):35-61, 2006.
322. L. A. Rastrigin and R. H. Erenstein. Method of Collective Recognition. Energoizdat, Moscow, 1981. (In Russian).
323. G. Rätsch, T. Onoda, and K.-R. Müller. Soft margins for AdaBoost. Machine Learning, 42(3):287-320, 2001.
324. Š. Raudys. Trainable fusion rules. I. Large sample size case. Neural Networks, 19(10):1506-1516, 2006.
325. Š. Raudys. Trainable fusion rules. II. Small sample-size effects. Neural Networks, 19(10):1517-1527, 2006.
326. J. Read, A. Bifet, G. Holmes, and B. Pfahringer. Scalable and efficient multi-label classification for evolving data streams. Machine Learning, 88(1-2):243-272, 2012.
327. G. Reid, S.and Grudic. Regularized linear models in stacked generalization. In:J. A. Benediktsson, J. Kittler, and F. Roli, editors, Multiple Classifier Systems. Volume 5519: Lecture Notes in Computer Science, pp. 112-121. Springer, Berlin, Heidelberg, 2009.
328. M. D. Richard and R. P. Lippmann. Neural network classifiers estimate Bayesian: a posteriori probabilities. Neural Computation, 3:461-483, 1991.
329. R. Rifkin and A. Klautau. In defense of one-vs-all classification. Journal of Machine Learning Research, 5:101-141, 2004.
330. B. D. Ripley. Pattern Recognition and Neural Networks. University Press, Cambridge, 1996.
331. J. J. Rodríguez, L. I. Kuncheva, and C. J. Alonso. Rotation forest: a new classifier ensemble method. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(10):1619-1630, 2006.
332. J. J. Rodríguez, C. García-Osorio, and J. Maudes. Forests of nested dichotomies. Pattern Recognition Letters, 31(2):125-132, 2010.
333. L. Rokach. Collective-agreement-based pruning of ensembles. Computational Statistics & Data Analysis, 53(4):1015-1026, 2009.
334. L. Rokach. Taxonomy for characterizing ensemble methods in classification tasks:a review and annotated bibliography. Computational Statistics and Data Analysis, 53:4046-4072, 2009.
335. L. Rokach. Ensemble-based classifiers. Artificial Intelligence Review, 33:1-39, 2010.
336. F. Roli, G. Giacinto, and G. Vernazza. Methods for designing multiple classifier systems. In: J. Kittler and F. Roli, editors, Proc. Second International Workshop on Multiple Classifier Systems, Cambridge, UK. Volume 2096: Lecture Notes in Computer Science, pp. 78-87. Springer, 2001.
337. F. Roli, J. Kittler, G. Fumera, and D. Muntoni. An experimental comparison of classifier fusion rules for multimodal personal identity verification systems. In: F. Roli and J. Kittler, editors, Multiple Classifier Systems. Volume 2364: Lecture Notes in Computer Science, pp. 325-335. Springer, Berlin, Heidelberg, 2002.
338. F. Roli, J. Kittler, T. Windeatt, N. Oza, R. Polikar, M. Haindl, J. A. Benediktsson, N. El-Gayar, C. Sansone, and Z. H. Zhou, editors. Proc. of the international Workshops on Multiple Classifier Systems, Lecture Notes in Computer Science (LNCS). Springer, 2000-2013.
339. L. Rosasco, E. De, Vito A. Caponnetto, M. Piana, and A. Verri. Are loss functions all the same? Neural Computation, 15:1063-1076, 2004.
340. F. Rosenblatt. Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms. Spartan Books, Washington DC, 1962.
341. D. W. Ruck, S. K. Rojers, M. Kabrisky, M. E. Oxley, and B. W. Suter. The multilayer perceptron as an approximation to a Bayes optimal discriminant function. IEEE Transactions on Neural Networks, 1(4):296-298, 1990.
342. D. Ruta. Classifier diversity in combined pattern recognition systems. PhD thesis, University of Paisley, Scotland, UK, 2003.
343. D. Ruta and B. Gabrys. A theoretical analysis of the limits of majority voting errors for multiple classifier systems. Technical Report 11, ISSN 1461-6122, Department of Computing and Information Systems, University of Paisley, December 2000.
344. D. Ruta and B. Gabrys. Analysis of the correlation between majority voting error and the diversity measures in multiple classifier systems. In: Proc. SOCO 2001, Paisley, Scotland, 2001.
345. Y. Saeys, T. Abeel, and Y. Peer. Robust feature selection using ensemble feature selection techniques. In: Proceedings of the European conference on Machine Learning and Knowledge Discovery in Databases-Part II, pp. 313-325. Springer, 2008.
346. Y. Saeys, I. Inza, and P. Larrañaga. A review of feature selection techniques in bioinformatics. Bioinformatics, 23(19):2507-2517, 2007.
347. S. Salzberg. On comparing classifiers: pitfalls to avoid and a recommended approach. Data Mining and Knowledge Discovery, 1:317-328, 1997.
348. S. Salzberg. On comparing classifiers: a critique of current research and methods. Data Mining and Knowledge Discovery, 1:1-12, 1999.
349. F. Scarselli and A. C. Tsoi. Universal approximation using feedforward neural networks:a survey of some existing methods, and some new results. Neural Networks, 11(1):15-37, 1998.
350. R. E. Schapire. Theoretical views of boosting. In: Proc. 4th European Conference on Computational Learning Theory, pp. 1-10. Springer, 1999.
351. R. E. Schapire and Y. Freund. Boosting: Foundations and Algorithms. MIT Press, 2012.
352. R. E. Schapire, Y. Freund, P. Bartlett, and W. S. Lee. Boosting the margin: a new explanation for the effectiveness of voting methods. The Annals of Statistics, 26(5):1651-1686, 1998.
353. G. S. Sebestyen. Decision-Making Process in Pattern Recognition. The Macmillan Company, New York, 1962.
354. C. Seiffert, T. M. Khoshgoftaar, J. Van Hulse, and A. Napolitano. RUSBoost: a hybrid approach to alleviating class imbalance. IEEE Transactions on Systems, Man, and Cybernetics Part A, 40(1):185-197, 2010.
355. G. Seni and J. F. Elder. Ensemble Methods in Data Mining: Improving Accuracy Through Combining Predictions. Synthesis Lectures on Data Mining and Knowledge Discovery. Morgan & Claypool Publishers, 2010.
356. R. A. Servedio. Smooth boosting and learning with malicious noise. Journal of Machine Learning Research, 4:633-648, 2003.
357. M. Sewell. Ensemble learning. Technical Report RN/11/02, Department of Computer Science, UCL, London, 2011.
358. R. E. Shapire. Using output codes to boost multiclass learning problems. In: Proc. 14th International Conference on Machine Learning. Morgan Kaufmann, 1997.
359. L. Shapley and B. Grofman. Optimizing group judgemental accuracy in the presence of interdependencies. Public Choice, 43:329-343, 1984.
360. A. J. C. Sharkey, editor. Combining Artificial Neural Nets. Ensemble and Modular Multi-Net Systems. Springer, London, 1999.
361. A. J. C. Sharkey, N. E. Sharkey, U. Gerecke, and G. O. Chandroth. The test-and-select approach to ensemble combination. In: J. Kittler and F. Roli, editors, Multiple Classifier Systems, Cagliari, Italy. Volume 1857: Lecture Notes in Computer Science, pp. 30-44. Springer, 2000.
362. L. Shen and L. Bai. MutualBoost learning for selecting Gabor features for face recognition. Pattern Recognition Letters, 27(15):1758-1767, 2006.
363. H. W. Shin and S. Y. Sohn. Selected tree classifier combination based on both accuracy and error diversity. Pattern Recognition, 38(2):191-197, 2005.
364. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts from single depth images. In:Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1297-1304. IEEE, 2011.
365. C. Sima, S. Attor, U. Brag-Neto, J. Lowey, E. Suh, and E. R. Dougherty. Impact of error estimation on feature selection. Pattern Recognition, 38:2472-2482, 2005.
366. P. Simeone, C. Marrocco, and F. Tortorella. Design of reject rules for ECOC classification systems. Pattern Recognition, 45(2):863-875, 2012.
367. S. Singh and M. Singh. Adynamic classifier selection and combination approach to image region labelling. Signal Processing-Image Communication, 20(3):219-231, 2005.
368. D. B. Skalak. The sources of increased accuracy for two proposed boosting algorithms. In: Proc. American Association for Artificial Intelligence, AAAI-96, Integrating Multiple Learned Models Workshop. AAAI Press, 1996.
369. M. Skurichina. Stabilizing weak classifiers. PhD thesis, Delft University of Technology, Delft, The Netherlands, 2001.
370. P. Smialowski, D. Frishman, and S. Kramer. Pitfalls of supervised feature selection. Bioinformatics, 26(3):440-443, 2010.
371. F. Smieja. The pandemonium system of reflective agents. IEEE Transactions on Neural Networks, 7:97-106, 1996.
372. P. C. Smits. Multiple classifier systems for supervised remote sensing image classification based on dynamic classifier selection. IEEE Transactions on Geoscience and Remote Sensing, 40(4):801-813, 2002.
373. P. H. A. Sneath and R. R. Sokal. Numerical Taxonomy. W.H. Freeman & Co, 1973.
374. P. Somol, J. Grim, J. Novovičová, and P. Pudil. Improving feature selection process resistance to failures caused by curse-of-dimensionality effects. Kybernetika, 47(3):401-425, 2011.
375. P. Somol and J. Novovičová. Evaluating stability and comparing output of feature selectors that optimize feature subset cardinality. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(11):1921-1939, 2010.
376. R. J. Stapenhurst. Diversity, margins and non-stationary learning. PhD thesis, School of Computer Science, The University of Manchester, UK, 2012.
377. G. Stiglic, J. J. Rodríguez, and P. Kokol. Rotation of random forests for genomic and proteomic classification problems. In H. R. Arabnia and Q. N. Tran, editors, Software Tools and Algorithms for Biological Systems. Volume 696: Advances in Experimental Medicine and Biology, pp. 211-221. Springer, 2011.
378. V. Svetnik, A. Liaw, C. Tong, J. C. Culberson, R. P. Sheridan, and B. P. Feuston. Random forest: a classification and regression tool for compound classification and QSAR modeling. Journal of Chemical Information and Computer Sciences, 43(6):1947-1958, 2003.
379. E. K. Tang, P. N. Suganthan, and X. Yao. An analysis of diversity measures. Machine Learning, 65(1):247-271, 2006.
380. E. K. Tang, P. N. Suganthan, and X. Yao. Gene selection algorithms for microarray data based on least squares support vector machine. BMC Bioinformatics, 7(1):95, 2006.
381. D. Tao, X. Tang, X. Li, and X. Wu. Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(7):1088-1099, 2006.
382. D. M. J. Tax, R. P. W. Duin, and M. van Breukelen. Comparison between product and mean classifier combination rules. In: Proc.Workshop on Statistical Pattern Recognition, Prague, Czech, 1997.
383. D. M. J. Tax, M. van Breukelen, R. P. W. Duin, and J. Kittler. Combining multiple classifier by averaging or multiplying? Pattern Recognition, 33:1475-1485, 2000.
384. K. M. Ting and I. H. Witten. Issues in stacked generalization. Journal of Artificial Intelligence Research, 10:271-289, 1999.
385. D. M. Titterington, G. D. Murray, L. S. Murray, D. J. Spiegelhalter, A. M. Skene, J. D. F. Habbema, and G. J. Gelpke. Comparison of discrimination techniques applied to a complex data set of head injured patients. Journal of the Royal Statistical Society. Series A (General), 144:145-175, 1981.
386. J. T. Tou and R. C. Gonzalez. Pattern Recognition Principles. Reading, MA: Addison-Wesley, 1974.
387. G. T. Toussaint. Note on optimal selection of independent binary-valued features for pattern recognition. IEEE Transactions on Information Theory, 17:618, 1971.
388. V. Tresp and M. Taniguchi. Combining estimators using non-constant weighting functions. In: G. Tesauro, D. S. Touretzky, and T. K. Leen, editors, Advances in Neural Information Processing Systems 7. MIT Press, Cambridge, MA, 1995.
389. A. Tsymbal, P. Cunnigham, M. Pechenizkiy, and S. Puuronen. Search strategies for ensemble feature selection in medical diagnostics. Technical report, Trinity College Dublin, Ireland, 2003.
390. A. Tsymbal, M. Pechenizkiy, and P. Cunningham. Diversity in search strategies for ensemble feature selection. Information Fusion, 6(1):83-98, 2005.
391. J. D. Tubbs andW. O. Alltop. Measures of confidence associated with combining classification rules. IEEE Transactions on Systems, Man, and Cybernetics, 21:690-692, 1991.
392. S. Tulyakov, S. Jaeger, V. Govindaraju, and D. Doermann. Review of classifier combination methods. In: Simone Marinai and Hiromichi Fujisawa, editors, Machine Learning in Document Analysis and Recognition. Volume 90: Studies in Computational Intelligence, pp. 361-386. Springer, Berlin, Heidelberg, 2008.
393. K. Tumer and J. Ghosh. Analysis of decision boundaries in linearly combined neural classifiers. Pattern Recognition, 29(2):341-348, 1996.
394. K. Tumer and J. Ghosh. Linear and order statistics combiners for pattern classification. In: A. J. C. Sharkey, editor, Combining Artificial Neural Nets, pp. 127-161. Springer, London, 1999.
395. N. Ueda. Optimal linear combination of neural networks for improving classification performance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(2):207-215, 2000.
396. G. Valentini. Ensemble methods based on bias-variance analysis. PhD thesis, University of Genova, Genova, Italy, 2003.
397. G. Valentini and M. Re. Ensemble methods: a review. In: Advances in Machine Learning and Data Mining for Astronomy. Chapman & Hall, 2012.
398. V. Valev and A. Asaithambi. Multidimensional pattern recognition problems and combining classifiers. Pattern Recognition Letters, 22(12):1291-1297, 2001.
399. M. van Breukelen, R. P. W Duin, D. M. J. Tax, and J. E. den Hartog. Combining classifiers for the recognition of handwritten digits. In: I-st IAPR TC1 Workshop on Statistical Techniques in Pattern Recognition, Prague, Czech Republic, pp. 13-18, 1997.
400. M. Van Erp, L. Vuurpijl, and L. Schomaker. An overview and comparison of voting methods for pattern recognition. In: Proceedings of the 8th IEEE InternationalWorkshop on Frontiers in Handwriting Recognition (WFHR02), pp. 195-200. IEEE, 2002.
401. S.Van Landeghem, T. Abeel,Y. Saeys, andY.Van de Peer. Discriminative and informative features for biomolecular text mining with ensemble feature selection. Bioinformatics (Oxford, England), 26(18):i554-i560, 2010.
402. V. N. Vapnik. The Nature of Statistical Learning Theory. Springer, 1995.
403. V. N. Vapnik. An overview of statistical learning theory. IEEE Transactions on Neural Networks, 10(5):988-999, 1999.
404. S. B.Vardeman and M. D. Morris. Majority voting by independent classifiers can increase error rates. The American Statistician, 67(2):94-96, 2013.
405. P. Viola and M. J. Jones. Robust real-time face detection. International Journal of Computer Vision, 57(2):137-154, 2004.
406. E. A. Wan. Neural network classification: a Bayesian interpretation. IEEE Transactions on Neural Networks, 1(4):303-305, 1990.
407. G.Wang, J. Ma, L. Huang, and K. Xu. Two credit scoring models based on dual strategy ensemble trees. Knowledge-Based Systems, 26:61-68, 2012.
408. H. Wang, T. M. Khoshgoftaar, and A. Napolitano. A comparative study of ensemble feature selection techniques for software defect prediction. In: 2010 Ninth International Conference on Machine Learning and Applications (ICMLA), pp. 135-140. IEEE, 2010.
409. H. Wang, T. M. Khoshgoftaar, and R. Wald. Measuring robustness of feature selection techniques on software engineering datasets. In: 2011 IEEE International Conference on Information Reuse and Integration (IRI), pp. 309-314. IEEE, 2011.
410. X. Wang and X. Tang. Random sampling for subspace face recognition. International Journal of Computer Vision, 70:91-104, 2006.
411. M.Warmuth, J. Liao, and G. Ratsch. Totally corrective boosting algorithms that maximize the margin. In: Proceedings of the 23rd International Conference on Machine Learning, New York, pp. 1001-1008. ACM, ACM International Conference Proceeding Series, ISBN 1-59593-383-2, 2006.
412. G. I. Webb. MultiBoosting: a technique for combining boosting and wagging. Machine Learning, 40(2):159-196, 2000.
413. G. I.Webb, J. Boughton, and Z.Wang. Not so naive Bayes: aggregating one-dependence estimators. Machine Learning, 58(1):5-24, 2005.
414. W.Wei, T. K. Leen, and E. Barnard. A fast histogram-based postprocessor that improves posterior probability estimates. Neural Computation, 11(5):1235-1248, 1999.
415. T. Windeatt. Diversity measures for multiple classifier system analysis and design. Information Fusion, 6(1):21-36, 2005.
416. T. Windeatt and G. Ardeshir. Boosted ECOC ensembles for face recognition. In: International Conference on Visual Information Engineering VIE 2003, pp. 165-168. IEEE, 2003.
417. T. Windeatt and R. Ghaderi. Coding and decoding strategies for multi-class learning problems. Information fusion, 4:11-21, 2003.
418. T. Woloszynski and M. Kurzynski. A probabilistic model of classifier competence for dynamic ensemble selection. Pattern Recognition, 44(10-11):2656-2668, 2011.
419. T. Woloszynski, M. Kurzynski, P. Podsiadlo, and G. W. Stachowiak. A measure of competence based on random classification for dynamic ensemble selection. Information Fusion, 13(3):207-213, 2012.
420. D. H. Wolpert. Stacked generalization. Neural Networks, 5(2):241-260, 1992.
421. K. Woods, W. P. Kegelmeyer, and K. Bowyer. Combination of multiple classifiers using local accuracy estimates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19:405-410, 1997.
422. X. Wu, V. Kumar, J. R. Quinlan, J. Ghosh, Q. Yang, H. Motoda, G. J. McLachlan, A. Ng, B. Liu, P. S. Yu, Z.-H. Zhou, M. Steinbach, D. J. Hand, and D. Steinberg. Top 10 algorithms in data mining. Knowledge and Information Systems, 14(1):1-37, 2008.
423. J.-F. Xia, K. Han, and D.-S. Huang. Sequence-based prediction of protein-protein interactions by means of Rotation Forest and autocorrelation descriptor. Protein and Peptide Letters, 17(1):137-145, 2010.
424. J. Xiao, C. He, X. Jiang, and D. Liu. A dynamic classifier ensemble selection approach for noise data. Information Sciences, 180(18):3402-3421, 2010.
425. L. Xu, A. Krzyzak, and C. Y. Suen. Methods of combining multiple classifiers and their application to handwriting recognition. IEEE Transactions on Systems, Man, and Cybernetics, 22:418-435, 1992.
426. O. T. Yildiz and E. Alpaydin. Omnivariate decision trees. IEEE Transactions on Neural Networks, 12(6):1539-1546, 2001.
427. L. Yu, Y. Han, and M. E. Berens. Stable gene selection from microarray data via sample weighting. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 9(1):262-272, 2012.
428. L. Yu and H. Liu. Feature selection for high-dimensional data: a fast correlation-based filter solution. In: Proceedings of the 20th International Conference on Machine Learning (ICML2003), Washington, DC, AAAI Press, 2003.
429. G. U. Yule. On the association of attributes in statistics. Phil. Trans., A, 194:257-319, 1900.
430. B. Zadrozny and C. Elkan. Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers. In: Proceedings of the Eighteenth International Conference on Machine Learning (ICML'01), pp. 609-616. Morgan Kaufmann, 2001.
431. G. Zenobi and P. Cunningham. Using diversity in preparing ensembles of classifiers based on different feature subsets to minimize generalization error. In: Lecture Notes in Computer Science, pp. 576-587. Springer, 2001.
432. B. Zhang. Reliable classification of vehicle types based on cascade classifier ensembles. IEEE Transactions on Intelligent Transportation Systems, 14(1):322-332, 2013.
433. B. Zhang and T. D. Pham. Phenotype recognition with combined features and random subspace classifier ensemble. BMC Bioinformatics, 12(128), 2011.
434. C.-X. Zhang and R. P. W. Duin. An experimental study of one- and two-level classifier fusion for different sample sizes. Pattern Recognition Letters, 32(14):1756-1767, 2011.
435. C.-X. Zhang and J.-S. Zhang. Rotboost: a technique for combining rotation forest and adaboost. Pattern Recognition Letters, 29(10):1524-1536, 2008.
436. L. Zhang andW.-D. Zhou. Sparse ensembles using weighted combination methods based on linear programming. Pattern Recognition, 44(1):97-106, 2011.
437. Z. Zhang and P. Yang. An ensemble of classifiers with genetic algorithm based feature selection. IEEE Intelligent Informatics Bulletin, 9(1):18-24, 2008.
438. G. Zhong and C.-L. Liu. Error-correcting output codes based ensemble feature extraction. Pattern Recognition, 46(4):1091-1100, 2013.
439. Z.-H. Zhou. Ensemble Methods: Foundations and Algorithm. CRC Press - Business & Economics, 2012.
440. Z.-H. Zhou and N. Li. Multi-information ensemble diversity. In: N. Gayar, J. Kittler, and F. Roli, editors, Multiple Classifier Systems. Volume 5997: Lecture Notes in Computer Science, pp. 134-144. Springer, Berlin, Heidelberg, 2010.
441. J. Zhu, S. Rosset, H. Zou, and T. Hastie. Multiclass AdaBoost. Technical Report 430, Department of Statistics, University of Michigan, 2006.
442. Y. Zhu, J. Liu, and S. Chen. Semi-random subspace method for face recognition. Image and Vision Computing, 27(9):1358-1370, 2009.
443. Yu. A. Zuev. A probability model of a committee of classifiers. USSR Comput. Math. Math. Phys., 26(1):170-179, 1987.