A survey of multiple classifier systems as hybrid systems

Information Fusion

Volumn 16, Issue 1, 2014, Pages 3-17

  Woźniak, Michał ^a   Graña, Manuel ^b   Corchado, Emilio ^c  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

^b UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

^c UNIVERSITY OF SALAMANCA   (Spain)

Author keywords

Classifier ensemble; Classifier fusion; Combined classifier; Hybrid classifier; Multiple classifier system

Indexed keywords

CLASSIFIER ENSEMBLES; CLASSIFIER FUSION; COMBINED CLASSIFIERS; HYBRID CLASSIFIER; MULTIPLE CLASSIFIER SYSTEMS;

CLASSIFICATION (OF INFORMATION); DATA PROCESSING; HYBRID SYSTEMS; INFORMATION FUSION; INTELLIGENT SYSTEMS;

SURVEYS;

EID: 84887090067     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.inffus.2013.04.006     Document Type: Article

References (231)

1. J. Neumann The Computer and the Brain 1958 Yale University Press New Haven, CT, USA
2. A. Newell Intellectual issues in the history of artificial intelligence F. Machlup, U. Mansfield, The Study of Information: Interdisciplinary Messages 1983 John Wiley & Sons Inc. New York, NY, USA 187 294
3. D. Wolpert, The supervised learning no-free-lunch theorems, in: Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications, 2001, pp. 25-42.
4. C.K. Chow Statistical independence and threshold functions IEEE Transactions on Electronic Computers EC-14 1 1965 66 68
5. L. Shapley, and B. Grofman Optimizing group judgmental accuracy in the presence of interdependencies Public Choice 43 3 1984 329 333
6. B.V. Dasarathy, and B.V. Sheela A composite classifier system design: concepts and methodology Proceedings of the IEEE 67 5 1979 708 713
7. L. Rastrigin, R.H. Erenstein, Method of Collective Recognition, Energoizdat, Moscow, 1981.
8. L. Hansen, and P. Salamon Neural network ensembles IEEE Transactions on Pattern Analysis and Machine Intelligence 12 10 1990 993 1001 10.1109/34.58871
9. L. Xu, A. Krzyzak, and C. Suen Methods of combining multiple classifiers and their applications to handwriting recognition IEEE Transactions on Systems, Man and Cybernetics 22 3 1992 418 435
10. K. Tumer, and J. Ghosh Analysis of decision boundaries in linearly combined neural classifiers Pattern Recognition 29 2 1996 341 348
11. T. Ho, J.J. Hull, and S. Srihari Decision combination in multiple classifier systems IEEE Transactions on Pattern Analysis and Machine Intelligence 16 1 1994 66 75
12. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140
13. R. Schapire The strength of weak learnability Machine Learning 5 2 1990 197 227
14. Y. Freund Boosting a weak learning algorithm by majority Information Computing 121 2 1995 256 285
15. M. Kearns, and U. Vazirani An Introduction to Computational Learning Theory 1994 MIT Press Cambridge, MA, USA
16. D. Angluin Queries and concept learning Machine Learning 2 4 1988 319 342
17. A. Jain, R. Duin, and M. Jianchang Statistical pattern recognition: a review IEEE Transactions on Pattern Analysis and Machine Intelligence 22 1 2000 4 37
18. N. Oza, and K. Tumer Classifier ensembles: select real-world applications Information Fusion 9 1 2008 4 20
19. R. Polikar Ensemble based systems in decision making IEEE Circuits and Systems Magazine 6 3 2006 21 45
20. R. Polikar Ensemble learning Scholarpedia 3 12 2008 2776
21. L. Rokach Taxonomy for characterizing ensemble methods in classification tasks: a review and annotated bibliography Computational Statistics and Data Analysis 53 12 2009 4046 4072
22. L. Kuncheva Combining Pattern Classifiers: Methods and Algorithms 2004 Wiley-Interscience
23. L. Rokach Pattern Classification Using Ensemble Methods Series in Machine Perception and Artificial Intelligence 2010 World Scientific
24. G. Seni, and J. Elder Ensemble Methods in Data Mining: Improving Accuracy Through Combining Predictions 2010 Morgan and Claypool Publishers
25. B. Baruque, and E. Corchado Fusion Methods for Unsupervised Learning Ensembles 2011 Springer Verlag New York, Inc.
26. R. Duda, P. Hart, and D. Stork Pattern Classification second ed. 2001 Wiley New York
27. E. Alpaydin Introduction to Machine Learning second ed. 2010 The MIT Press
28. C. Bishop Pattern Recognition and Machine Learning (Information Science and Statistics) 2006 Springer-Verlag New York, Inc. Secaucus, NJ, USA
29. T. Dietterich Ensemble methods in machine learning Multiple Classifier Systems Lecture Notes in Computer Science vol. 1857 2000 Springer Berlin, Heidelberg 1 15
30. G. Marcialis, F. Roli, Fusion of face recognition algorithms for video-based surveillance systems, in: G.L. Foresti, C. Regazzoni, P. Varshney (Eds.), 2003, pp. 235-250.
31. S. Hashem Optimal linear combinations of neural networks Neural Networks 10 4 1997 599 614
32. R. Clemen Combining forecasts: a review and annotated bibliography International Journal of Forecasting 5 4 1989 559 583
33. J. Quinlan C4.5: Programs for Machine Learning Morgan Kaufmann Series in Machine Learning 1993 Morgan Kaufman Publishers
34. T. Wilk, and M. Wozniak Complexity and multithreaded implementation analysis of one class-classifiers fuzzy combiner E. Corchado, M. Kurzynski, M. Wozniak, Hybrid Artificial Intelligent Systems Lecture Notes in Computer Science vol. 6679 2011 Springer Berlin/Heidelberg 237 244
35. T. Kacprzak, K. Walkowiak, M. Wozniak, Optimization of overlay distributed computing systems for multiple classifier system - heuristic approach, Logic Journal of IGPL, doi:10.1093/jigpal/jzr020.
36. K. Walkowiak Anycasting in connection-oriented computer networks: models, algorithms and results International Journal of Applied Mathematics and Computer Sciences 20 1 2010 207 220
37. R. Agrawal, and R. Srikant Privacy-preserving data mining SIGMOD Records 29 2 2000 439 450
38. G. Giacinto, F. Roli, G. Fumera, Design of effective multiple classifier systems by clustering of classifiers, in: Proceedings of the 15th International Conference on Pattern Recognition, 2000, vol. 2, 2000, pp. 160-163.
39. T. Ho Complexity of classification problems and comparative advantages of combined classifiers Proceedings of the First International Workshop on Multiple Classifier Systems, MCS '00 2000 Springer-Verlag London, UK 97 106
40. F. Roli, and G. Giacinto Design of Multiple Classifier Systems 2002 World Scientific Publishing
41. L. Lam Classifier combinations: implementations and theoretical issues Proceedings of the First International Workshop on Multiple Classifier Systems, MCS '00 2000 Springer-Verlag London, UK 77 86
42. A.F.R. Rahman, and M.C. Fairhurst Serial combination of multiple experts: a unified evaluation Pattern Analysis and Applications 2 1999 292 311
43. G. Fumera, I. Pillai, and F. Roli A two-stage classifier with reject option for text categorisation 5th International Workshop on Statistical Techniques in Pattern Recognition (SPR 2004) vol. 3138 2004 Springer Lisbon, Portugal 771 779
44. P. Bartlett, and M. Wegkamp Classification with a reject option using a hinge loss Journal of Machine Learning Research 9 2008 1823 1840
45. M. Termenon, and M. Graña A two stage sequential ensemble applied to the classification of alzheimer's disease based on MRI features Neural Processing Letters 35 1 2012 1 12
46. P. Clark, and T. Niblett The CN2 induction algorithm Machine Learning 3 4 1989 261 283
47. R. Rivest Learning decision lists Machine Learning 2 3 1987 229 246
48. Y. Freund, and R. Schapire A decision-theoretic generalization of on-line learning and an application to boosting Journal of Computer and System Sciences 55 1 1997 119 139 10.1006/jcss.1997.1504
49. X. Wu, V. Kumar, J.R. Quinlan, J. Ghosh, Q. Yang, H. Motoda, G.J. McLachlan, A. Ng, B. Liu, P.S. Yu, Z.-H. Zhou, M. Steinbach, D.J. Hand, and D. Steinberg Top 10 algorithms in data mining Knowledge and Information Systems 14 1 2008 1 37 10.1007/s10115-007-0114-2
50. R. Schapire The strength of weak learnability Machine Learning 5 2 1990 197 227 10.1023/A:1022648800760
51. J. Kivinen, M.K. Warmuth, Boosting as entropy projection, in: Proceedings of the Twelfth Annual Conference on Computational Learning Theory, 1999. < http://dl.acm.org/citation.cfm?id=307424 >.
52. D. Partridge, and W. Krzanowski Software diversity: practical statistics for its measurement and exploitation Information and Software Technology 39 10 1997 707 717
53. G. Brown, L. Kuncheva, "good" And "bad" diversity in majority vote ensembles, in: Proceedings MCS 2010, pp. 124-133.
54. M. Smetek, and B. Trawinski Selection of heterogeneous fuzzy model ensembles using self-adaptive genetic algorithms New Generation Computing 29 2011 309 327
55. A.J.C. Sharkey, and N. Sharkey Combining diverse neural nets Knowledge Engineering Review 12 3 1997 231 247
56. A. Krogh, and J. Vedelsby Neural network ensembles, cross validation, and active learning Advances in Neural Information Processing Systems 7 1995 231 238
57. G. Zenobi, and P. Cunningham Using diversity in preparing ensembles of classifiers based on different feature subsets to minimize generalization error Machine Learning: ECML 2001 2001 576 587
58. G. Brown, J. Wyatt, R. Harris, and X. Yao Diversity creation methods: a survey and categorisation Information Fusion 6 1 2005 5 20
59. N. Ueda, R. Nakano, Generalization error of ensemble estimators, in: Proceedings of IEEE International Conference on Neural Networks, Washington, USA, 1996, pp. 90-95.
60. G. Brown, J. Wyatt, and P. Tiňo Managing diversity in regression ensembles Journal of Machine Learning Research 6 2005 1621 1650
61. L. Kuncheva, C. Whitaker, C. Shipp, and R. Duin Limits on the majority vote accuracy in classifier fusion Pattern Analysis and Applications 6 2003 22 31
62. Y. Bi The impact of diversity on the accuracy of evidential classifier ensembles International Journal of Approximate Reasoning 53 4 2012 584 607
63. D. Margineantu, and T. Dietterich Pruning adaptive boosting Proceedings of the Fourteenth International Conference on Machine Learning, ICML '97 1997 Morgan Kaufmann Publishers Inc. San Francisco, CA, USA 211 218
64. D. Skalak, The sources of increased accuracy for two proposed boosting algorithms, in: Proceedings of the American Association for Arti Intelligence, AAAI-96, Integrating Multiple Learned Models Workshop, 1996, pp. 120-125.
65. G. Giacinto, and F. Roli Design of effective neural network ensembles for image classification purposes Image Vision Computing 19 9-10 2001 699 707
66. R. Kohavi, D. Wolpert, Bias plus variance decomposition for zero-one loss functions, in: ICML-96, 1996.
67. J. Fleiss, and J. Cuzick The reliability of dichotomous judgments: unequal numbers of judgments per subject Applied Psychological Measurement 4 3 1979 537 542
68. P. Cunningham, and J. Carney Diversity versus quality in classification ensembles based on feature selection Proceedings of the 11th European Conference on Machine Learning, ECML '00 2000 Springer-Verlag London, UK 109 116
69. C. Shipp, and L. Kuncheva Relationships between combination methods and measures of diversity in combining classifiers Information Fusion 3 2 2002 135 148
70. E.K. Tang, P.N. Suganthan, and X. Yao An analysis of diversity measures Machine Learning 65 1 2006 247 271
71. G. Martinez-Mu/ noz, D. Hern/'andez-Lobato, and A. Suarez An analysis of ensemble pruning techniques based on ordered aggregation IEEE Transactions on Pattern Analysis and Machine Intelligence 31 2 2009 245 259
72. D. Ruta, and B. Gabrys Classifier selection for majority voting Information Fusion 6 1 2005 63 81
73. R. Banfield, L. Hall, K. Bowyer, and W. Kegelmeyer Ensemble diversity measures and their application to thinning Information Fusion 6 1 2005 49 62
74. Z.-H. Zhou, J. Wu, and W. Tang Ensembling neural networks: many could be better than all Artificial Intelligence 137 1-2 2002 239 263
75. B. Gabrys, and D. Ruta Genetic algorithms in classifier fusion Applied Soft Computing 6 4 2006 337 347
76. I. Partalas, G. Tsoumakas, and I. Vlahavas Pruning an ensemble of classifiers via reinforcement learning Neurocomputing 72 7-9 2009 1900 1909
77. Q. Dai A competitive ensemble pruning approach based on cross-validation technique Knowledge-Based Systems 0 2012 10.1016/j.knosys.2012.08.024
78. Y. Peng, Q. Huang, P. Jiang, and J. Jiang Cost-sensitive ensemble of support vector machines for effective detection of microcalcification in breast cancer diagnosis L. Wang, Y. Jin, Fuzzy Systems and Knowledge Discovery Lecture Notes in Computer Science vol. 3614 2005 Springer Berlin/Heidelberg 483 493
79. K. Jackowski, B. Krawczyk, and M. Woniak Cost-sensitive splitting and selection method for medical decision support system H. Yin, J.A. Costa, G. Barreto, Intelligent Data Engineering and Automated Learning - IDEAL 2012 Lecture Notes in Computer Science vol. 7435 2012 Springer Berlin Heidelberg 850 857
80. W. Du, Z. Zhan, Building decision tree classifier on private data, in: Proceedings of the IEEE International Conference on Privacy, Security and Data Mining - Volume 14, CRPIT '14, Australian Computer Society, Inc., Darlinghurst, Australia, 2002, pp. 1-8.
81. B. Krawczyk, and M. Wozniak Privacy preserving models of k-NN algorithm R. Burduk, M. Kurzynski, M. Wozniak, A. Zolnierek, Computer Recognition Systems 4 Advances in Intelligent and Soft Computing vol. 95 2011 Springer Berlin/Heidelberg 207 217
82. Y. Lindell, and B. Pinkas Secure multiparty computation for privacy-preserving data mining IACR Cryptology ePrint Archive 2008 2008 197
83. K. Walkowiak, S. Sztajer, and M. Wozniak Decentralized distributed computing system for privacy-preserving combined classifiers - modeling and optimization B. Murgante, O. Gervasi, A. Iglesias, D. Taniar, B. Apduhan, Computational Science and Its Applications - ICCSA 2011, Lecture Notes in Computer Science Vol. 6782 2011 Springer Berlin/Heidelberg 512 525
84. A. Pavlo, E. Paulson, A. Rasin, D. Abadi, D. DeWitt, S. Madden, and M. Stonebraker A comparison of approaches to large-scale data analysis Proceedings of the 2009 ACM SIGMOD International Conference on Management of Data, SIGMOD '09 2009 ACM New York, NY, USA 165 178
85. R.E. Schapire, The boosting approach to machine learning: an overview, in: MSRI Workshop on Nonlinear Estimation and Classification, Berkeley, CA, USA, 2001.
86. T. Ho, Random decision forests, in: Proceedings of the Third International Conference on Document Analysis and Recognition (Volume 1)-Volume 1, ICDAR '95, IEEE Computer Society, Washington, DC, USA, 1995, pp. 278-.
87. T. Ho The random subspace method for constructing decision forests IEEE Transactions on Pattern Analysis and Machine Intelligence 20 1998 832 844
88. L. Breiman Random forests Machine Learning 45 1 2001 5 32
89. M. Skurichina, and R. Duin Bagging, boosting and the random subspace method for linear classifiers Pattern Analysis and Applications 5 2 2002 121 135
90. G. Tremblay, R. Sabourin, P. Maupin, Optimizing nearest neighbour in random subspaces using a multi-objective genetic algorithm, in: Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1-Volume 01, ICPR '04, IEEE Computer Society, Washington, DC, USA, 2004, pp. 208-.
91. S. Bay Nearest neighbor classification from multiple feature subsets Intelligent Data Analysis 3 3 1999 191 209
92. L. Nanni Letters: Experimental comparison of one-class classifiers for online signature verification Neurocomputing 69 7-9 2006 869 873
93. D. Tao, X. Tang, X. Li, and X. Wu Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval IEEE Transactions on Pattern Analysis Machine Intelligence 28 7 2006 1088 1099
94. K. Ting, J. Wells, S. Tan, S. Teng, and G. Webb Feature-subspace aggregating: ensembles for stable and unstable learners Machine Learning 82 2011 375 397
95. R. Bryll, R. Gutierrez-Osuna, and F. Quek Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets Pattern Recognition 36 6 2003 1291 1302
96. Y. Baram Partial classification: the benefit of deferred decision IEEE Transactions on Pattern Analysis and Machine Intelligence 20 8 1998 769 776
97. L. Cordella, P. Foggia, C. Sansone, F. Tortorella, and M. Vento A cascaded multiple expert system for verification Multiple Classifier Systems Lecture Notes in Computer Science vol. 1857 2000 Springer Berlin/Heidelberg 330 339
98. K. Goebel, W. Yan, Choosing classifiers for decision fusion, in: Proceedings of the Seventh International Conference on Information Fusion, 2004, pp. 563-568.
99. B. Baruque, S. Porras, and E. Corchado Hybrid classification ensemble using topology-preserving clustering New Generation Computing 29 2011 329 344
100. L. Kuncheva, Clustering-and-selection model for classifier combination, in: Proceedings of the Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies, 2000, vol. 1, 2000, pp. 185-188.
101. K. Jackowski, and M. Wozniak Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas Pattern Analysis and Applications 12 4 2009 415 425
102. M. Wozniak, B. Krawczyk, Combined classifier based on feature space partitioning, International Journal of Applied Mathematics and Computer Sciences 22 (4) (2012) 855-866.
103. H. Lee, C. Chen, J. Chen, and Y. Jou An efficient fuzzy classifier with feature selection based on fuzzy entropy IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 31 3 2001 426 432
104. J. Hong, J. Min, U. Cho, and S. Cho Fingerprint classification using one-vs-all support vector machines dynamically ordered with naïve bayes classifiers Pattern Recognition 41 2008 662 671
105. A.R. Ko, R. Sabourin, and A. Britto From dynamic classifier selection to dynamic ensemble selection Pattern Recognition 41 5 2008 1735 1748
106. L. Didaci, G. Giacinto, F. Roli, and G. Marcialis A study on the performances of dynamic classifier selection based on local accuracy estimation Pattern Recognition 38 11 2005 2188 2191
107. G. Giacinto, and F. Roli Dynamic classifier selection based on multiple classifier behavior Pattern Recognition 34 9 2001 1879 1881
108. M. de Souto, R. Soares, A. Santana, A. Canuto, Empirical comparison of dynamic classifier selection methods based on diversity and accuracy for building ensembles, in: IJCNN 2008, IEEE International Joint Conference on Neural Networks, 2008, IEEE World Congress on Computational Intelligence, 2008, pp. 1480-1487.
109. T. Woloszynski, and M. Kurzynski A probabilistic model of classifier competence for dynamic ensemble selection Pattern Recognition 44 1011 2011 2656 2668
110. T. Woloszynski, M. Kurzynski, P. Podsiadlo, and G. Stachowiak A measure of competence based on random classification for dynamic ensemble selection Information Fusion 13 3 2012 207 213
111. W. Street, and Y. Kim A streaming ensemble algorithm (sea) for large-scale classification Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '01 2001 ACM New York, NY, USA 377 382
112. H. Wang, W. Fan, P. Yu, and J. Han Mining concept-drifting data streams using ensemble classifiers Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '03 2003 ACM New York, NY, USA 226 235
113. Y. Zhang, and X. Jin An automatic construction and organization strategy for ensemble learning on data streams SIGMOD Record 35 3 2006 28 33
114. J. Kolter, M. Maloof, Dynamic weighted majority: a new ensemble method for tracking concept drift, in: ICDM 2003, Third IEEE International Conference on Data Mining, 2003, 2003, pp. 123-130.
115. A. Tsymbal, M. Pechenizkiy, P. Cunningham, and S. Puuronen Dynamic integration of classifiers for handling concept drift Information Fusion 9 1 2008 56 68
116. X. Zhu, X. Wu, and Y. Yang Effective classification of noisy data streams with attribute-oriented dynamic classifier selection Knowledge Information Systems 9 3 2006 339 363
117. D. Tax, R. Duin, Using two-class classifiers for multiclass classification, in: Proceedings of the 16th International Conference on Pattern Recognition, 2002, vol. 2, 2002, pp. 124 -127.
118. T. Dietterich, and G. Bakiri Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research 2 1995 263 286
119. K. Duan, S. Keerthi, W. Chu, S. Shevade, and A. Poo Multi-category classification by soft-max combination of binary classifiers Proceedings of the 4th International Conference on Multiple Classifier Systems, MCS'03 2003 Springer-Verlag Berlin, Heidelberg 125 134
120. A. Passerini, M. Pontil, and P. Frasconi New results on error correcting output codes of kernel machines IEEE Transactions on Neural Networks 15 1 2004 45 54
121. T. Wu, C. Lin, and R. Weng Probability estimates for multi-class classification by pairwise coupling Journal of Machine Learning Research 5 2004 975 1005
122. J. Friedman, Another Approach to Polychotomous Classification, Tech. rep., Department of Statistics, Stanford University, 1996.
123. E. Hüllermeier, and S. Vanderlooy Combining predictions in pairwise classification: an optimal adaptive voting strategy and its relation to weighted voting Pattern Recognition 43 1 2010 128 142
124. M. Galar, A. Fernandez, E. Barrenechea, H. Bustince, and F. Herrera An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes Pattern Recognition 44 8 2011 1761 1776
125. D. Tax, R.P.W. Duin, Characterizing one-class datasets, in: Proceedings of the Sixteenth Annual Symposium of the Pattern Recognition Association of South Africa, 2005, pp. 21-26.
126. D. Tax, and R. Duin Combining one-class classifiers Proceedings of the Second International Workshop on Multiple Classifier Systems, MCS '01 2001 Springer-Verlag London, UK 299 308
127. T. Wilk, and M. Wozniak Soft computing methods applied to combination of one-class classifiers Neurocomputing 75 2012 185 193
128. G. Giacinto, R. Perdisci, M. Del Rio, and F. Roli Intrusion detection in computer networks by a modular ensemble of one-class classifiers Information Fusion 9 2008 69 82
129. Y. Hu Handbook of Neural Network Signal Processing 1st ed. 2000 CRC Press, Inc. Boca Raton, FL, USA
130. K. Woods, W.P. Kegelmeyer Jr., and K. Bowyer Combination of multiple classifiers using local accuracy estimates IEEE Transactions on Pattern Analysis and Machine Intelligence 19 4 1997 405 410
131. M. Wozniak, and M. Zmyslony Combining classifiers using trained fuser - analytical and experimental results Neural Network World 13 7 2010 925 934
132. S. Raudys Trainable fusion rules. I. Large sample size case Neural Networks 19 10 2006 1506 1516
133. M. van Erp, L. Vuurpijl, L. Schomaker, An overview and comparison of voting methods for pattern recognition, in: Proceedings of the Eighth International Workshop on Frontiers in Handwriting Recognition, 2002, 2002, pp. 195-200.
134. M. Wozniak, and K. Jackowski Some remarks on chosen methods of classifier fusion based on weighted voting E. Corchado, X. Wu, E. Oja, A. Herrero, B. Baruque, Hybrid Artificial Intelligence Systems Lecture Notes in Computer Science vol. 5572 2009 Springer Berlin/Heidelberg 541 548
135. S. Raudys Trainable fusion rules. II. Small sample-size effects Neural Networks 19 10 2006 1517 1527
136. H. Inoue, and H. Narihisa Optimizing a multiple classifier system M. Ishizuka, A. Sattar, PRICAI 2002: Trends in Artificial Intelligence Lecture Notes in Computer Science vol. 2417 2002 Springer Berlin/Heidelberg 1 16
137. L. Alexandre, A. Campilho, M. Kamel, Combining independent and unbiased classifiers using weighted average., in: Proceedings ICPR 2000, 2000, pp. 2495-2498.
138. B. Biggio, G. Fumera, and F. Roli Bayesian analysis of linear combiners Proceedings of the 7th International Conference on Multiple Classifier Systems, MCS '07 2007 Springer-Verlag Berlin, Heidelberg 292 301
139. J. Kittler, and F. Alkoot Sum versus vote fusion in multiple classifier systems IEEE Transactions on Pattern Analysis and Machine Intelligence 25 1 2003 110 115
140. N. Rao A generic sensor fusion problem: classification and function estimation F. Roli, J. Kittler, T. Windeatt, Multiple Classifier Systems Lecture Notes in Computer Science vol. 3077 2004 Springer 16 30
141. D. Opitz, J. Shavlik, Generating accurate and diverse members of a neural-network ensemble, in: NIPS, 1995, pp. 535-541.
142. L. Rokach, and O. Maimon Feature set decomposition for decision trees Intelligent Data Analysis 9 2 2005 131 158
143. G. Fumera, and F. Roli A theoretical and experimental analysis of linear combiners for multiple classifier systems IEEE Transactions on Pattern Analysis and Machine Intelligence 27 6 2005 942 956 10.1109/TPAMI.2005.109
144. M. Wozniak Experiments on linear combiners E. Pietka, J. Kawa, Information Technologies in Biomedicine Advances in Soft Computing vol. 47 2008 Springer Berlin/Heidelberg 445 452
145. R. Duin, The combining classifier: to train or not to train? in: Proceedings of the 16th International Conference on Pattern Recognition, 2002, vol. 2, 2002, pp. 765-770.
146. R. Jacobs, M. Jordan, S. Nowlan, and G. Hinton Adaptive mixtures of local experts Neural Computation 3 1991 79 87
147. R. Jacobs Methods for combining experts' probability assessments Neural Computation 7 5 1995 867 888
148. V. Tresp, and M. Taniguchi Combining estimators using non-constant weighting functions Advances in Neural Information Processing Systems vol. 7 1995 MIT Press 419 426
149. P. Cheeseman, M. Self, J. Kelly, J. Stutz, W. Taylor, and D. Freeman AutoClass: a Bayesian classification system Machine Learning: Proceedings of the Fifth International Workshop 1988 Morgan Kaufman
150. S. Shlien Multiple binary decision tree classifiers Pattern Recognition 23 7 1990 757 763
151. M. Wozniak Experiments with trained and untrained fusers E. Corchado, J. Corchado, A. Abraham, Innovations in Hybrid Intelligent Systems Advances in Soft Computing vol. 44 2007 Springer Berlin/Heidelberg 144 150
152. M. Wozniak Evolutionary approach to produce classifier ensemble based on weighted voting NaBIC 2009, World Congress on Nature & Biologically Inspired Computing, 2009 2009 IEEE 648 653
153. L. Lin, X. Wang, B. Liu, Combining multiple classifiers based on statistical method for handwritten chinese character recognition, in: Proceedings of the 2002 International Conference on Machine Learning and Cybernetics, 2002, vol. 1, 2002, pp. 252-255.
154. Z. Zheng, and B. Padmanabhan Constructing ensembles from data envelopment analysis INFORMS Journal on Computing 19 4 2007 486 496
155. D. Wolpert Stacked generalization Neural Networks 5 1992 241 259
156. Y. Huang, and C. Suen A method of combining multiple experts for the recognition of unconstrained handwritten numerals IEEE Transactions on Pattern Analysis and Machine Intelligence 17 1 1995 90 94
157. M.M. Gaber, A. Zaslavsky, and S. Krishnaswamy Mining data streams: a review SIGMOD Record 34 2 2005 18 26
158. A. Patcha, and J.-M. Park An overview of anomaly detection techniques: existing solutions and latest technological trends Computer Network 51 12 2007 3448 3470
159. M.M. Black, and R.J. Hickey Classification of customer call data in the presence of concept drift and noise Proceedings of the First International Conference on Computing in an Imperfect World, Soft-Ware 2002 2002 Springer-Verlag London, UK 74 87
160. H. Wang, W. Fan, P.S. Yu, and J. Han Mining concept-drifting data streams using ensemble classifiers Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '03 2003 ACM New York, NY, USA 226 235
161. M.M. Gaber, P.S. Yu, Classification of changes in evolving data streams using online clustering result deviation, in: Proc. Of International Workshop on Knowledge Discovery in Data Streams, 2006.
162. M. Markou, and S. Singh Novelty detection: a review - Part 1: Statistical approaches Signal Process 83 12 2003 2481 2497
163. M. Salganicoff Density-adaptive learning and forgetting Machine Learning: Proceedings of the Tenth Annual Conference 1993 Morgan Kaufmann San Francisco, CA
164. R. Klinkenberg, and T. Joachims Detecting concept drift with support vector machines Proceedings of the Seventeenth International Conference on Machine Learning, ICML '00 2000 Morgan Kaufmann Publishers Inc. San Francisco, CA, USA 487 494
165. M. Baena-García, J. del Campo-Ávila, R. Fidalgo, A. Bifet, R. Gavaldá, R. Morales-Bueno, Early drift detection method, in: Fourth International Workshop on Knowledge Discovery from Data Streams, 2006.
166. I. Zliobaite Change with delayed labeling: when is it detectable? Proceedings of the 2010 IEEE International Conference on Data Mining Workshops, ICD-MW '10 2010 IEEE Computer Society Washington, DC, USA 843 850
167. G. Giacinto, F. Roli, and L. Bruzzone Combination of neural and statistical algorithms for supervised classification of remote-sensing images Pattern Recognition Letters 21 5 2000 385 397
168. V. Rodriguez-Galiano, B. Ghimire, J. Rogan, M. Chica-Olmo, and J. Rigol-Sanchez An assessment of the effectiveness of a random forest classifier for land-cover classification ISPRS Journal of Photogrammetry and Remote Sensing 67 0 2012 93 104
169. P. Gislason, J. Benediktsson, and J. Sveinsson Random forests for land cover classification Pattern Recognition Letters 27 4 2006 294 300
170. J.-W. Chan, and D. Paelinckx Evaluation of random forest and Adaboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery Remote Sensing of Environment 112 6 2008 2999 3011
171. J. Peters, N. Verhoest, R. Samson, M. Meirvenne, L. Cockx, and B. Baets Uncertainty propagation in vegetation distribution models based on ensemble classifiers Ecological Modelling 220 6 2009 791 804
172. M. Han, X. Zhu, and W. Yao Remote sensing image classification based on neural network ensemble algorithm Neurocomputing 78 1 2012 133 138
173. B. Waske, and M. Braun Classifier ensembles for land cover mapping using multitemporal SAR imagery ISPRS Journal of Photogrammetry and Remote Sensing 64 5 2009 450 457 (theme Issue: Mapping with SAR: Techniques and Applications)
174. B. Waske, S. van der Linden, C. Oldenburg, B. Jakimow, A. Rabe, and P. Hostert imageRF - a user-oriented implementation for remote sensing image analysis with random forests Environmental Modelling & Software 35 0 2012 192 193
175. U. Maulik, and D. Chakraborty A self-trained ensemble with semisupervised SVM: an application to pixel classification of remote sensing imagery Pattern Recognition 44 3 2011 615 623
176. A. Henriques, A. Doria-Neto, and R. Amaral Classification of multispectral images in coral environments using a hybrid of classifier ensembles Neurocomputing 73 7-9 2010 1256 1264
177. Y. Maghsoudi, M. Collins, and D. Leckie Polarimetric classification of boreal forest using nonparametric feature selection and multiple classifiers International Journal of Applied Earth Observation and Geoinformation 19 0 2012 139 150
178. L. Bruzzone, R. Cossu, and G. Vernazza Combining parametric and non-parametric algorithms for a partially unsupervised classification of multitemporal remote-sensing images Information Fusion 3 4 2002 289 297
179. L. Bruzzone, R. Cossu, and G. Vernazza Detection of land-cover transitions by combining multidate classifiers Pattern Recognition Letters 25 13 2004 1491 1500
180. P. Du, S. Liu, J. Xia, and Y. Zhao Information fusion techniques for change detection from multi-temporal remote sensing images Information Fusion 14 1 2013 19 27
181. P. Arun-Raj-Kumar, and S. Selvakumar Distributed denial of service attack detection using an ensemble of neural classifier Computer Communications 34 11 2011 1328 1341
182. P. Kumar, and S. Selvakumar Detection of distributed denial of service attacks using an ensemble of adaptive and hybrid neuro-fuzzy systems Computer Communications 0 2012
183. A. Shabtai, R. Moskovitch, Y. Elovici, and C. Glezer Detection of malicious code by applying machine learning classifiers on static features: a state-of-the-art survey Information Security Technical Report 14 1 2009 16 29
184. M. Locasto, K. Wang, A. Keromytis, and S. Stolfo Flips: hybrid adaptive intrusion prevention Proceedings of the 8th International Conference on Recent Advances in Intrusion Detection, RAID'05 2006 Springer-Verlag Berlin, Heidelberg 82 101
185. K. Wang, G. Cretu, and S. Stolfo Anomalous payload-based worm detection and signature generation Proceedings of the 8th International Conference on Recent Advances in Intrusion Detection, RAID'05 2006 Springer-Verlag Berlin, Heidelberg 227 246
186. S. Peddabachigari, A. Abraham, C. Grosan, and J. Thomas Modeling intrusion detection system using hybrid intelligent systems Journal of Network and Computer Applications 30 1 2007 114 132
187. D.-I. Curiac, and C. Volosencu Ensemble based sensing anomaly detection in wireless sensor networks Expert Systems with Applications 39 10 2012 9087 9096
188. R.J. Bolton, and D.J. Hand Statistical fraud detection: a review Statistical Science 17 3 2002 235 255
189. F. Louzada, and A. Ara Bagging k-dependence probabilistic networks: an alternative powerful fraud detection tool Expert Systems with Applications 39 14 2012 11583 11592
190. S. Bhattacharyya, S. Jha, K. Tharakunnel, and J. Westland Data mining for credit card fraud: a comparative study Decision Support Systems 50 3 2011 602 613
191. L. Yu, W. Yue, S. Wang, and K. Lai Support vector machine based multiagent ensemble learning for credit risk evaluation Expert Systems with Applications 37 2 2010 1351 1360
192. Y. Kim, and S. Sohn Stock fraud detection using peer group analysis
193. B. Twala Multiple classifier application to credit risk assessment Expert Systems with Applications 37 4 2010 3326 3336
194. S. Finlay Multiple classifier architectures and their application to credit risk assessment European Journal of Operational Research 210 2 2011 368 378
195. G. Wang, and J. Ma A hybrid ensemble approach for enterprise credit risk assessment based on support vector machine Expert Systems with Applications 39 5 2012 5325 5331
196. M. Kim, and D. Kang Classifiers selection in ensembles using genetic algorithms for bankruptcy prediction Expert Systems with Applications 39 10 2012 9308 9314
197. P. Ravisankar, V. Ravi, and I. Bose Failure prediction of dotcom companies using neural network-genetic programming hybrids Information Sciences 180 8 2010 1257 1267
198. P. Ravisankar, V. Ravi, G. Rao, and I. Bose Detection of financial statement fraud and feature selection using data mining techniques Decision Support Systems 50 2 2011 491 500
199. C. Tsai Combining cluster analysis with classifier ensembles to predict financial distress Information Fusion 0 2011
200. Y. Peng, G. Wang, G. Kou, and Y. Shi An empirical study of classification algorithm evaluation for financial risk prediction Applied Soft Computing 11 2 2011 2906 2915
201. V. Ravi, H. Kurniawan, P. Nwee-Kok-Thai, and P. Ravi-Kumar Soft computing system for bank performance prediction Applied Soft Computing 8 1 2008 305 315
202. H. Zhao, A. Sinha, and W. Ge Effects of feature construction on classification performance: an empirical study in bank failure prediction Expert Systems with Applications 36 2, Part 2 2009 2633 2644
203. K. Aral, H. Guvenir, I. Sabuncuoglu, and A. Akar A prescription fraud detection model Computer Methods and Programs in Biomedicine 106 1 2012 37 46
204. I. Christou, M. Bakopoulos, T. Dimitriou, E. Amolochitis, S. Tsekeridou, and C. Dimitriadis Detecting fraud in online games of chance and lotteries Expert Systems with Applications 38 10 2011 13158 13169
205. H. Farvaresh, and M. Sepehri A data mining framework for detecting subscription fraud in telecommunication Engineering Applications of Artificial Intelligence 24 1 2011 182 194
206. L. Subelj, S. Furlan, and M. Bajec An expert system for detecting automobile insurance fraud using social network analysis Expert Systems with Applications 38 1 2011 1039 1052
207. A.X. Garg, N.K.J. Adhikari, H. McDonald, M.P. Rosas-Arellano, P.J. Devereaux, J. Beyene, J. Sam, and R.B. Haynes Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review Journal of the American Medical Association 293 10 2005 1223 1238
208. J. Eom, S. Kim, and B. Zhang AptaCDSS-E: a classifier ensemble-based clinical decision support system for cardiovascular disease level prediction Expert Systems with Applications 34 4 2008 2465 2479
209. R. Das, I. Turkoglu, and A. Sengur Effective diagnosis of heart disease through neural networks ensembles Expert Systems with Applications 36 4 2009 7675 7680
210. R. Das, I. Turkoglu, and A. Sengur Diagnosis of valvular heart disease through neural networks ensembles Computer Methods and Programs in Biomedicine 93 2 2009 185 191
211. W. Baxt Improving the accuracy of an artificial neural network using multiple differently trained networks Neural Computation 4 5 1992 772 780
212. X. Zhang, J. Mesirov, and D. Waltz Hybrid system for protein secondary structure prediction Journal of Molecular Biology 225 4 1992 1049 1063
213. L. Nanni Ensemble of classifiers for protein fold recognition Neurocomputing 69 7 2006 850 853
214. T. Yang, V. Kecman, L. Cao, C. Zhang, and J.Z. Huang Margin-based ensemble classifier for protein fold recognition Expert Systems with Applications 38 10 2011 12348 12355
215. A. Savio, M. Garcia-Sebastian, D. Chyzyk, C. Hernandez, M. Graña, A. Sistiaga, A.L. de Munain, and J. Villanua Neurocognitive disorder detection based on feature vectors extracted from VBM analysis of structural MRI Computers in Biology and Medicine 41 8 2011 600 610
216. D. Chyzhyk, M. Graña, A. Savio, and J. Maiora Hybrid dendritic computing with kernel-LICA applied to alzheimer's disease detection in MRI Neurocomputing 75 1 2012 72 77
217. L. Kuncheva, and J. Rodriguez Classifier ensembles for fMRI data analysis: an experiment Magnetic Resonance Imaging 28 4 2010 583 593
218. C. Plumpton, L. Kuncheva, N. Oosterhof, and S. Johnston Naive random subspace ensemble with linear classifiers for real-time classification of fMRI data Pattern Recognition 45 6 2012 2101 2108
219. C. Cabral, M. Silveira, and P. Figueiredo Decoding visual brain states from fMRI using an ensemble of classifiers Pattern Recognition 45 6 2012 2064 2074
220. G. Adomavicius, R. Sankaranarayanan, S. Sen, and A. Tuzhilin Incorporating contextual information in recommender systems using a multidimensional approach ACM Transactions Information Systems 23 1 2005 103 145
221. J. Konstan, and J. Riedl How online merchants predict your preferences and prod you to purchase IEEE Spectrum 49 10 2012 48 56
222. R. Burke Hybrid recommender systems: survey and experiments User Modeling and User-Adapted Interaction 12 4 2002 331 370
223. M. Balabanović, Y. Shoham, and Fab: content-based collaborative recommendation Communications of the ACM 40 3 1997 66 72
224. M.J. Pazzani A framework for collaborative, content-based and demographic filtering Artificial Intelligence Review 13 5-6 1999 393 408
225. M. Jahrer, A. Töscher, and R. Legenstein Combining predictions for accurate recommender systems Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '10 2010 ACM New York, NY, USA 693 702
226. C. Porcel, A. Tejeda-Lorente, M. Martínez, and E. Herrera-Viedma A hybrid recommender system for the selective dissemination of research resources in a technology transfer office Information Sciences 184 1 2012 1 19
227. M. Claypool, A. Gokhale, T. Miranda, P. Murnikov, D. Netes, and M. Sartin Combining content-based and collaborative filters in an online newspaper Proceedings of the ACM SIGIR '99 Workshop on Recommender Systems: Algorithms and Evaluation 1999 ACM
228. D. Billsus, and M. Pazzani User modeling for adaptive news access User Modeling and User-Adapted Interaction 10 2-3 2000 147 180
229. T. Tran, R. Cohen, Hybrid recommender systems for electronic commerce, in: Knowledge-Based Electronic Markets, Papers from the AAAI Workshop, AAAI Technical Report WS-00-04, AAAI Press, Menlo Park, CA, 2000, pp. 78-83.
230. M. Kunaver, T. Pozrl, M. Pogacnik, and J. Tasic Optimisation of combined collaborative recommender systems AEU - International Journal of Electronics and Communications 61 7 2007 433 443
231. M. Goksedef, and S. Gundoz-Oguducu Combination of web page recommender systems Expert Systems with Applications 37 4 2010 2911 2922