Novel ensemble methods for regression via classification problems

Expert Systems with Applications

Volumn 39, Issue 7, 2012, Pages 6396-6401

  Ahmad, Amir ^a   Halawani, Sami M ^a   Albidewi, Ibrahim A ^a  

^a KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Classification; Decision trees; Ensembles; Regression

Indexed keywords

DISCRETIZATION METHOD; DISCRETIZATION PROCESS; DISCRETIZATIONS; ENSEMBLE METHODS; ENSEMBLES; REGRESSION; REGRESSION PROBLEM; TARGET VALUES;

CLASSIFICATION (OF INFORMATION); DECISION TREES; DISCRETE EVENT SIMULATION; VOLUME MEASUREMENT;

REGRESSION ANALYSIS;

EID: 84856959441     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2011.12.029     Document Type: Article

References (34)

1. Ahmad, A. (2010). Data transformation for decision tree ensembles. PhD thesis, School of Computer Science, University of Manchester.
2. S. Bibi, G. Tsoumakas, I. Stamelos, and I. Vlahavas Regression via classification applied on software defect estimation Expert Systems with Applications 32 2008 20912101
3. C.M. Bishop Pattern recognition and machine learning 2008 Springer-Verlag New York, Inc.
4. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140 (Pubitemid 126724382)
5. L. Breiman Random forests Machine Learning 45 1 2001 5 32 (Pubitemid 32933532)
6. L. Breiman, J. Friedman, R. Olshen, and C. Stone Classification and regression trees 1984 Wadsworth International Group CA
7. Richard L. Burden Numerical analysis 9th ed. 2010 BookNumerical
8. C.J.C. Burges A tutorial on support vector machines for pattern recognition Data Mining and Knowledge Discovery 2 1998 121167
9. Catlett, J. (1991). Megainduction: Machine learning on very large databases. PhD thesis, Basser Department of Computer Science, University of Sydney.
10. Chan, C. C.; Batur, C.; & Srinivasan, A. (1991). Determination of quantization intervals in rule based model for dynamic systems. In Proceedings of the IEEE conference on systems, man, and cybernetics (pp. 1719-1723).
11. T.G. Dietterich Approximate statistical tests for comparing supervised classification learning algorithms Neural Computation 10 1998 1895 1923 (Pubitemid 128463689)
12. Dietterich, T. G. (2000). Ensemble methods in machine learning. In Proceedings of conference multiple classifier systems (Vol. 1857, p. 1-15).
13. Dougherty, J.; Kahavi, R.; & Sahami, M. (1995). Supervised and unsupervised discretization of continuous features. In Machine learning: Proceedings of the twelth international conference.
14. Fan, W.; Wang, H.; Yu, P. S.; & Ma. S. (2003). Is random model better? On its accuracy and efficiency. In Proceedings of third IEEE international conference on data mining (ICDM2003) (p. 51-58).
15. Fan, W.; McCloskey, J.; & Yu, P. S. (2006). A general framework for accurate and fast regression by data summarization in random decision trees. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining (p. 136-146). (Pubitemid 44535511)
16. Fayyad, U. M.; & Irani, K. B. (1993). Multi-interval discretization of continuous valued attributes for classification learning. In Proceedings of the thirteenth international joint conference on artificial intelligence (p. 1022-1027).
17. Y. Freund, and R.E. Schapire A decision-theoretic generalization of on-line learning and an application to boosting Journal of Computer and System Sciences 55 1 1997 119 139 (Pubitemid 127433398)
18. P. Geurts, D. Ernst, and L. Wehenkel Extremely randomized trees Machine Learning 63 1 2006 3 42
19. M. Hall, E. Frank, Geoffrey Holmes, B. Pfahringer, P. Reutemann, and Ian H. Witten The WEKA data mining software: An update SIGKDD Explorations 11 1 2009 10 18
20. L.K. Hansen, and P. Salamon Neural network ensembles IEEE Transactions on Pattern Analysis and Machine Intelligence 12 10 1990 993 1001
21. R.C. Holte Very simple classification rules perform well on most commonly used datasets Machine Learning 11 1993 63 90
22. Indurkhya, N.; & Weiss, S. M. (2001). Solving regression problems with rule-based ensemble classifiers. In ACM international conference knowledge discovery and data mining (KDD01) (pp. 287-292).
23. T. Kohonen Self organization and associative memory 1989 Springer-Verlag Berlin, Germany
24. L.I. Kuncheva Combining pattern classifiers: Methods and algorithms 2004 Wiley-Interscience
25. Kwedlo, W.; & Kretowski, M. (1999). An evolutionary algorithm using mulivariate discretization for decision rule induction. In Principles of data mining and knowledge discovery (pp. 392-397).
26. T.M. Mitchell Machine learning 1997 McGraw-Hill
27. J.R. Quinlan C4.5: Programs for machine learning 1993 Morgan Kaufman Publishers Inc San Francisco, CA, USA
28. J.J. Rodriguez, L.I. Kuncheva, and C.J. Alonso Rotation forest: A new classifier ensemble method IEEE Transactions on Pattern Analysis and Machine Intelligence 28 10 2006 1619 1630 (Pubitemid 46405081)
29. Torgo, L.; & Gama, J. (1997). Search-based class discretization. In Proceedings of the 9th European conference on machine learning (pp. 266-273). (Pubitemid 127061934)
30. Torgo, L.; & Gama, J. (1999). Regression by classification. In: Advances in artificial intelligence (pp. 51-60). (Pubitemid 126142690)
31. L. Torgo, and J. Gama Regression using classification algorithms Intelligent Data Analysis 4 1 1997 275 292
32. K. Tumer, and J. Ghosh Error correlation and error reduction in ensemble classifiers Connection Science 8 3 1996 385 404
33. Van de Merckt, T. (1993). Decision trees in numerical attribute spaces. In Proceedings of the 13th international joint conference on artificial intelligence (pp. 1016-1021).
34. V. Vapnik Statistical learning theory 1998 Wiley-Interscience New York