A novel ensemble method for regression via classification problems

Journal of Computer Science

Volumn 7, Issue 3, 2011, Pages 387-393

  Halawani, Sami M ^a   Albidewi, Ibrahim A ^a   Ahmad, Amir ^a  

^a KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Classification problem; Decision trees; ERD ensembles; Extreme randomized discretization (ERD); Mean square error (MSE); Monothetic Contrast Criteria (MCC); Neural network; Regression via Classification (RVC); Rvc perform

Indexed keywords

EID: 80052837450     PISSN: 15493636     EISSN: None     Source Type: Journal    
DOI: 10.3844/jcssp.2011.387.393     Document Type: Article

References (34)

1. Abdulsalam, H., D.B. Skillicorn and P. Martin, 2011. Classification using streaming random forests. IEEE Trans. Know. Data Eng., 23: 22-36. DOI: 10.1109/TKDE.2010.36
2. Ahmad, A. and L. Dey, 2005. A feature selection technique for classificatory analysis. Patt. Recog. Lett., 26: 43-56. DOI: 10.1016/j.patrec.2004.08.015
3. Ahmad, A. and G. Brown, 2009. Random ordinality ensembles: A novel ensemble method for multivalued categorical data. Multiple Classifier Syst., 5519: 222-231. DOI: 10.1007/978-3-642-02326-2_23
4. Ahmad, A., 2010. Data transformation for decision tree ensembles. Ph.D. thesis, School of Computer Science, University of Manchester. http://www.cs.man.ac.uk/~gbrown/publications/ah madPhDthesis.pdf
5. Alfred, R., 2010. Summarizing relational data using semi-supervised genetic algorithm-based clustering techniques. J. Comput. Sci., 6: 775-784. DOI: 10.3844/jcssp.2010.775.784
6. Bishop, C.M., 2006. Pattern Recognition and Machine Learning. 1st Edn., Springer-Verlag, New York, ISBN-10: 9780387310732, pp: 738.
7. Breiman, L., 1996. Bagging predictors. Mach. Learn., 24: 123-140. DOI: 10.1023/A:1018054314350
8. Breiman, L., 2001. Random forests. Mach. Learn., 45: 5-32. DOI: 10.1023/A:1010933404324
9. Breiman, L., J. Friedman, R. Olshen and C. Stone, 1984. Classification and Regression Trees. 1st Edn., Chapman and Hall, London, ISBN-10: 0412048418, pp: 358.
10. Burges, C.J.C., 1998. A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discovery, 2: 121-167. DOI: 10.1023/A:1009715923555
11. Chandra, N.S., M.B. Shaik, A. Govardhan and M. Balraju, 2010. Comparative study of the effect of lossy and lossless block based binary plane techniques on medical images. J. Comput. Sci., 6: 1377-1380. DOI: 10.3844/jcssp.2010.1377.1380
12. Dougherty, J., R. Kahavi and M. Sahami, 1995. Supervised and unsupervised discretization of continuous features. Proceedings of the 12th International Conference on Machine Learning. (ICML'95), Morgan Kaufmann, pp: 194-202.
13. Fan, W., H. Wang, P.S. Yu and S. Ma, 2003. Is Random model better? On its accuracy and efficiency. Proceedings of 3rd IEEE International Conference on Data Mining, Nov. 19-22, Hawthorne, NY, USA., pp: 51-58. DOI: 10.1109/ICDM.2003.1250902
14. Fan, W., J. McCloskey and P.S. Yu, 2006. A general framework for accurate and fast regression by data summarization in random decision trees. Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, (ICKDM'06), ACM New York, NY, USA., pp: 136-146. DOI: 10.1145/1150402.1150421
15. Freund, Y. and R.E. Schapire, 1997. A decisiontheoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci., 55: 119-139. DOI: 10.1006/jcss.1997.1504
16. Geurts, P., D. Ernst and L. Wehenkel, 2006. Extremely randomized trees. Mach. Learn., 63: 3-42. DOI: 10.1007/s10994-006-6226-1
17. Halawani, S.M. and I.A. Albidewi, 2010. Recognition of hand printed characters based on simple geometric features. J. Comput. Sci., 6: 1512-1517. DOI: 10.3844/jcssp.2010.1512.1517
18. Hansen, L.K. and P. Salamon, 1990. Neural network ensembles. IEEE Trans. Patt. Anal. Mach. Intell., 12: 993-1001. DOI: 10.1109/34.58871
19. Indurkhya, N. and S.M. Weiss, 2001. Solving regression problems with rule-based ensemble classifiers. Proceedings of the 7th ACM International Conference Knowledge Discovery and Data Mining, (KDD'01), ACM New York, NY, USA., pp: 287-292. DOI: 10.1145/502512.502553
20. Ishrat, R., R. Parveen and S.I. Ahson, 2010. Pattern trees for fault-proneness detection in objectoriented software. J. Comput. Sci., 6: 1078-1082. DOI: 10.3844/jcssp.2010.1078.1082
21. Kohonen, T., 1989. Self Organization and Associative Memory. 3rd Edn., SpringerVerlag, Berlin, Germany, ISBN-10: 0387513876, pp: 312.
22. Kuncheva, L.I., 2004. Combining Pattern Classifiers: Methods and Algorithms. 1st Edn., Wiley-Interscience, New York, ISBN-10: 0471210781, pp: 350.
23. Merckt, T.V.D., 1993. Decision trees in numerical attribute spaces. Proceedings of the 13th International Joint Conference on Artificial Intelligence, pp: 1016-1021.
24. Minku, L., X. Yao, 2011. DDD: A New Ensemble Approach For Dealing With Concept Drift. IEEE Trans. Know. Data Eng., 99: 1-1. DOI: 10.1109/TKDE.2011.58
25. Mitchell, T.M., 1997. Machine Learning. 1st Edn., McGraw-Hill, New York, ISBN-10: 0070428077, pp: 414.
26. Quinlan, J.R., 1993. C4.5: Programs for Machine Learning. 1st Edn., Morgan Kaufmann Publishers Inc., San Francisco, CA, USA., ISBN-10: 1-55860-238-0, pp: 302.
27. Rodriguez, J.J., L.I. Kuncheva and C.J. Alonso, 2006. Rotation forest: A new classifier ensemble method. IEEE Trans. Patt. Anal. Mach. Intell., 28: 1619-1630. DOI: 10.1109/TPAMI.2006.211
28. Torgo, L. and J. Gama, 1996. Regression by classification. Advan. Artificial Intell., 1159: 51-60. DOI: 10.1007/3-540-61859-7_6
29. Torgo, L. and J. Gama, 1997a. Regression using classification algorithms. Intell. Data Anal., 1: 275-292. DOI: 10.1016/S1088-467X(97)00013-9
30. Torgo, L. and J. Gama, 1997b. Search-based class discretization. Mach. Learn., 1224: 266-273. DOI: 10.1007/3-540-62858-4_91
31. Tumer, K. and J. Ghosh, 1996. Error correlation and error reduction in ensemble classifiers. Connect. Sci., 8: 385-404.
32. Vapnik, V., 1998. Statistical Learning Theory. 1st Edn., Wiley, New York, ISBN-10: 0471030031, pp: 736.
33. Witten, I.H. and E. Frank, 2005. Data Mining: Practical Machine Learning Tools and Techniques. 3rd Edn., Elsevier Science, New York, ISBN-10: 9780123748560, pp: 650.]
34. Zhang, H. and J. Lu, 2010. Creating ensembles of classifiers via fuzzy clustering and deflection. Fuzzy Sets Syst., 161: 1790-1802. DOI: 10.1016/J.FSS.2009.11.013