Improved classification with allocation method and multiple classifiers

Information Fusion

Volumn 31, Issue , 2016, Pages 26-42

  Karakatič, Sašo ^a   Podgorelec, Vili ^a  

^a UNIVERSITY OF MARIBOR   (Slovenia)

Author keywords

Allocation; Anomaly detection; Classification; Ensemble methods

Indexed keywords

ADAPTIVE BOOSTING; ALGORITHMS; ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; SIGNAL DETECTION;

ALLOCATION; ANOMALY DETECTION; CLASSIFICATION ACCURACY; CLASSIFICATION ALGORITHM; CLASSIFICATION RESULTS; ENSEMBLE METHODS; MULTIPLE CLASSIFIERS; SUPERVIZED MACHINE LEARNING;

CLASSIFICATION (OF INFORMATION);

EID: 84954187617     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.inffus.2015.12.006     Document Type: Article

References (51)

1. D. Aha, D. Kibler Instance-based learning algorithms Mach. Learn. 6 1991 37 66
2. K. Bache, M. Lichman, UCI Machine Learning Repository (2013).
3. L. Breiman Bagging predictors Mach. Learn. 24 1996 123 140
4. C.-C. Chang, C.-J. Lin LIBSVM: a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 27 2011 1-27:27
5. R.T. Clemen Combining forecasts: a review and annotated bibliography Int. J. Forecast. 5 1989 559 583
6. C. Cortes, V. Vapnik Support-vector networks Mach. Learn. 20 1995 273 297
7. J. Demšar Statistical comparisons of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30
8. T.G. Dietterich Ensemble methods in machine learning in: Mult. Classif. Syst. 2000 Springer 1 15
9. C. Ferri, P. Flach, J. Hernández-Orallo Delegating classifiers Proceedings of the Twenty-First International Conference on Machine Learning - ICML '04 2004 ACM Press New York, New York, USA 37
10. B. Frénay, M. Verleysen Classification in the presence of label noise: a survey. IEEE Trans. Neural Netw. Learn. Syst. 25 2014 845 869
11. Y. Freund, R.E. Schapire A decision-theoretic generalization of on-line learning and an application to boosting J. Comput. Syst. Sci. 55 1997 119 139
12. M. Friedman The use of ranks to avoid the assumption of normality implicit in the analysis of variance J. Am. Stat. Assoc. 32 1937 675 701
13. M. Galar, A. Fernández, E. Barrenechea, F. Herrera EUSBoost: enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling Pattern Recognit. 46 2013 3460 3471
14. N. García-Pedrajas, J. Maudes-Raedo, C. García-Osorio, J.J. Rodríguez-Díez Supervised subspace projections for constructing ensembles of classifiers Inf. Sci. 193 2012 1 21
15. J.V. Hansen Combining predictors: comparison of five meta machine learning methods Inf. Sci. 119 1999 91 105
16. L.K. Hansen, P. Salamon Neural network ensembles IEEE Trans. Pattern Anal. Mach. Intell. 12 1990 993 1001
17. A. de Haro-García, N. García-Pedrajas A divide-and-conquer recursive approach for scaling up instance selection algorithms Data Min. Knowl. Discov. 18 2008 392 418
18. S. Hashem optimal linear combinations of neural networks Neural Networks. 10 1997 599 614
19. S. Holm A simple sequentially rejective multiple test procedure Scand. J. Stat. 1979 65 70
20. R.C. Holte Very simple classification rules perform well on most commonly used datasets Mach. Learn. 11 1993 63 91
21. R.A. Jacobs, M.I. Jordan, S.J. Nowlan, G.E. Hinton Adaptive mixtures of local experts Neural Comput. 3 1991 79 87
22. G.H. John, P. Langley Estimating continuous distributions in bayesian classifiers Proceedings of the Eleventh Annual Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo 1995 338 345
23. D.J.H. Jonathan, J. Oliver On pruning and averaging decision trees Proceedings of the Twelfth International Conference On Machine Learning 1995 430 437
24. M.I. Jordan, R.A. Jacobs Hierarchical mixtures of experts and the EM algorithm Neural Comput. 6 1994 181 214
25. S.S. Keerthi, S.K. Shevade, C. Bhattacharyya, K.R.K. Murthy Improvements to Platt's SMO Algorithm for SVM Classifier Design Neural Comput. 13 2001 637 649
26. R. Kohavi Scaling up the accuracy of naive-bayes classifiers: a decision-tree hybrid Proceedings of the Second International Conference on Knowledge Discovery and Data Mining 1996 202 207
27. B. Krawczyk, M. Woźniak, B. Cyganek Clustering-based ensembles for one-class classification Inf. Sci. 264 2014 182 195
28. A. Krogh, J. Vedelsby Neural network ensembles, cross validation, and active learning Adv. Neural Inf. Process. Syst. 1995 231 238
29. M. Lopes, F. Gouyon, A.L. Koerich, L.E.S. Oliveira Selection of training instances for music genre classification Proceedings of the 2010 20th International Conference on Pattern Recognition, IEEE 2010 4569 4572
30. R. Maclin, D. Opitz, Popular ensemble methods: An empirical study. arXiv: 1106.0257. (2011).
31. H.B. Mann, D.R. Whitney On a test of whether one of two random variables is stochastically larger than the other Ann. Math. Stat. 18 1947 50 60
32. J.A. Olvera-López, J.A. Carrasco-Ochoa, J.F. Martínez-Trinidad, J. Kittler A review of instance selection methods Artif. Intell. Rev. 34 2010 133 143
33. D.W. Opitz, J.W. Shavlik Generating accurate and diverse members of a neural-network ensemble Adv. Neural Inf. Process. Syst. 8 1996 535 541
34. J. Ortega, M. Koppel, S. Argamon Arbitrating among competing classifiers using learned referees Knowl. Inf. Syst. 3 2001 470 490
35. H. Parvin, H. Alizadeh, M. Moshki, B. Minaei-Bidgoli, N. Mozayani Divide & conquer classification and optimization by genetic algorithm Proceedings of the Third International Conference on Convergence and Hybrid Information Technology 2008 858 863 ICCIT'08. 2008
36. M.P. Perrone Improving Regression Estimation: Averaging Methods for Variance Reduction with Extensions to General Convex Measure Optimization 1993
37. R. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufmann Publishers San Mateo, CA
38. L. Rokach Ensemble-based classifiers Artif. Intell. Rev. 33 2010 1 39
39. B. Schölkopf, J.C. Platt, J. Shawe-Taylor, A.J. Smola, R.C. Williamson Estimating the support of a high-dimensional distribution Neural Comput 13 2001 1443 1471
40. C. Seiffert, T.M. Khoshgoftaar, J. Van Hulse, A. Napolitano RUSBoost: Improving classification performance when training data is skewed Proceedings of the 19th International Conference on Pattern Recognition, ICPR 2008 2008 1 4
41. P.K. Sharma, H. Haleem, T. Ahmad Improving classification by outlier detection and removal Proceedings of the49th Annual Convention of the Computer Society of India CSI: Emerging ICT for Bridging the Future 2 2015 621 628
42. J. Shawe-Taylor, S. Sun A review of optimization methodologies in support vector machines Neurocomputing. 74 2011 3609 3618
43. M.R. Smith, T. Martinez Improving classification accuracy by identifying and removing instances that should be misclassified International Joint Conference on Neural Networks (IJCNN), 2011 2011 2690 2697
44. S.-H. Son, J.-Y. Kim Data reduction for instance-based learning using entropy-based partitioning Computer Science and its Applications 2006 Springer 590 599
45. J. Song, H. Takakura, Y. Okabe, K. Nakao Toward a more practical unsupervised anomaly detection system Inf. Sci. 231 2013 4 14
46. S. Sun Local within-class accuracies for weighting individual outputs in multiple classifier systems Pattern Recognit. Lett. 31 2010 119 124
47. S. Sun, C. Zhang Subspace ensembles for classification Phys. Stat. Mech. Appl. 385 2007 199 207
48. G.I. Webb Multiboosting: a technique for combining boosting and wagging Mach. Learn. 40 2000 159 196
49. D.H. Wolpert Stacked generalization Neural Netw. 5 1992 241 259
50. M. Woźniak, M. Graña, E. Corchado A survey of multiple classifier systems as hybrid systems Inf. Fusion. 16 2014 3 17
51. Zhuowen Tu Probabilistic boosting-tree: learning discriminative models for classification, recognition, and clustering in: Proceedings of the Tenth IEEE International Conference on Computer Vision Vol. 1, IEEE 2 2005 1589 1596