Comparison of single and ensemble classifiers in terms of accuracy and execution time

INISTA 2011 - 2011 International Symposium on INnovations in Intelligent SysTems and Applications

Volumn , Issue , 2011, Pages 470-474

  Amasyali, M F ^a   Ersoy, O K ^b  

^a YILDIZ TECHNICAL UNIVERSITY   (Turkey)

^b Purdue University   (United States)

Author keywords

base learners; classifier ensembles; committees of learners; consensus theory; mixture of experts; multiple classifier systems

Indexed keywords

BASE LEARNERS; CLASSIFIER ENSEMBLES; COMMITTEES OF LEARNERS; CONSENSUS THEORY; MIXTURE OF EXPERTS; MULTIPLE CLASSIFIER SYSTEMS;

DECISION TREES; INTELLIGENT SYSTEMS;

ALGORITHMS;

EID: 79961176847     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/INISTA.2011.5946119     Document Type: Conference Paper

References (26)

1. L.I. Kuncheva, C.J. Whitaker, "Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy", Machine Learning, Volume 51 Issue 2, 2003.
2. R.E. Banfield, L.O. Hall, K.W. Bowyer, D.Bhadoria, W.P. Kegelmeyer, and S.Eschrich, "A Comparison of Ensemble Creation Techniques", MCS 2004, LNCS 3077, pp. 223-232, 2004.
3. R.E. Banfield, L.O. Hall, K.W. Bowyer, and W.P. Kegelmeyer, "A Comparison of Decision Tree Ensemble Creation Techniques", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 29, No. 1, January 2007.
4. George H. John, Pat Langley, "Estimating Continuous Distributions in Bayesian Classifiers", Eleventh Conference on Uncertainty in Artificial Intelligence, San Mateo, 338-345, 1995.
5. S.S. Keerthi, S.K. Shevade, C. Bhattacharyya, K.R.K. Murthy, "Improvements to Platt's SMO Algorithm for SVM Classifier Design", Neural Computation, 13(3) p:637-649, 2001. (Pubitemid 33595014)
6. D. Aha, D. Kibler, "Instance-based learning algorithms", Machine Learning, 6:37-66, 1991. (Pubitemid 21727227)
7. R. Quinlan, C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Mateo, CA, 1993.
8. N. Landwehr, M. Hall, and E. Frank, "Logistic model trees" Machine Learning, 59(1-2):161-205, 2005. (Pubitemid 40890416)
9. L. Breiman, "Random Forests", Machine Learning, 45(1):5-32, 2001.
10. L. Breiman, J.H. Friedman, R.A. Olshen, C.J. Stone, Classification and Regression Trees, Wadsworth International Group, Belmont, California, 1984.
11. H. Shi. Best-first decision tree learning. Hamilton, NZ, 2007.
12. G. Holmes, B. Pfahringer, R. Kirkby, E. Frank, M. Hall, "Multiclass alternating decision trees", ECML, 161-172, 2001.
13. R. Kohavi, "Scaling Up the Accuracy of Naive-Bayes Classifiers: A Decision-Tree Hybrid", Second International Conference on Knowledge Discovery and Data Mining, 202-207, 1996.
14. Y. Freund, R.E. Schapire, "Experiments with a new boosting algorithm", Thirteenth International Conference on Machine Learning, San Francisco, 148-156, 1996.
15. L. Breiman, "Bagging predictors", Machine Learning, 24(2):123-140, 1996. (Pubitemid 126724382)
16. J.J. Rodriguez, L.I. Kuncheva, C.J. Alonso, "Rotation Forest: A new classifier ensemble method", IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(10):1619-1630, 2006. (Pubitemid 46405081)
17. K.M. Ting, I.H. Witten, "Stacking Bagged and Dagged Models", Fourteenth international Conference on Machine Learning, San Francisco, CA, 367-375, 1997.
18. P. Melville, R.J. Mooney, "Constructing Diverse Classifier Ensembles Using Artificial Training Examples", Eighteenth International Joint Conference on Artificial Intelligence, 505-510, 2003.
19. L. Dong, E. Frank, S. Kramer, "Ensembles of Balanced Nested Dichotomies for Multi-class Problems", PKDD, 84-95, 2005.
20. J. Friedman, T. Hastie, R. Tibshirani, "Additive Logistic Regression: a Statistical View of Boosting", Stanford University, 1998.
21. G.I. Webb, "MultiBoosting: A Technique for Combining Boosting and Wagging". Machine Learning. Vol.40:2, 2000.
22. T.K. Ho, "The Random Subspace Method for Constructing Decision Forests". IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8):832-844, 1998.
23. I.H. Witten, E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, 2nd Edition, Morgan Kaufmann, San Francisco, 2005.
24. C.L. Blake and C.J. Merz, UCI repository of machine learning databases, 1998.
25. E. Alpaydin, "Combined 5 x 2 cv F test for comparing supervised classification learning algorithms", Neural Computation, Volume 11 Issue 9, 1999.
26. J. Demsar, "Statistical comparison of classifiers over multiple data sets", Journal of Machine Learning Research, 7:1-30, 2006.. (Pubitemid 43022939)