Model selection in omnivariate decision trees using Structural Risk Minimization

Information Sciences

Volumn 181, Issue 23, 2011, Pages 5214-5226

  Yildiz, Olcay Taner ^a  

^a IIK University   (Turkey)

Author keywords

Classification; Decision tree; Machine learning; Model selection; Structural Risk Minimization; VC dimension

Indexed keywords

AKAIKE'S INFORMATION CRITERIONS; BAYESIAN INFORMATION CRITERION; CANDIDATE MODELS; CROSS VALIDATION; DATA SETS; MACHINE-LEARNING; MODEL SELECTION; MODEL SELECTION TECHNIQUES; OMNIVARIATE DECISION TREES; STRUCTURAL RISK MINIMIZATION; THREE MODELS; UNIVARIATE; UNIVARIATE MODELS; VC-DIMENSION;

CLASSIFICATION (OF INFORMATION); DECISION TREES; PLANT EXTRACTS;

TREES (MATHEMATICS);

EID: 80052917492     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2011.07.028     Document Type: Article

References (41)

1. H. Akaike, Information theory and an extension of the maximum likelihood principle, in: Second International Symposium on Information Theory, 1973, pp. 267-281.
2. E. Alpaydin Introduction to Machine Learning 2004 The MIT Press
3. H. Altinay Decision trees using model ensemble-based nodes Pattern Recognition 40 2007 3540 3551
4. C. Blake, C. Merz, UCI Repository of Machine Learning Databases, 2000. .
5. L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone Classification and Regression Trees 1984 John Wiley and Sons
6. C.E. Brodley, and P.E. Utgoff Multivariate decision trees Machine Learning 19 1995 45 77
7. B. Chandra, and P.P. Varghese Moving towards efficient decision tree construction Information Sciences 179 2009 1059 1069
8. Y.-L. Chen, C.-C. Wu, and K. Tang Building a cost-constrained decision tree with multiple condition attributes Information Sciences 179 2009 967 979
9. V. Cherkassky, and F. Mulier Learning From Data 1998 John Wiley and Sons
10. W.W. Cohen, Fast effective rule induction, in: The Twelfth International Conference on Machine Learning, 1995, pp. 115-123.
11. J. Demsar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30 (Pubitemid 43022939)
12. T.G. Dietterich Approximate statistical tests for comparing supervised classification learning classifiers Neural Computation 10 1998 1895 1923 (Pubitemid 128463689)
13. J.H. Friedman A recursive partitioning decision rule for non-parametric classification IEEE Transactions on Computers 1977 404 408
14. J. Gama Discriminant trees Sixteenth International Conference on Machine Learning 1999 Morgan Kaufmann New Brunswick, New Jersey 134 142
15. J. Gama Functional trees Machine Learning 55 2004 219 250
16. H. Guo, and S.B. Gelfand Classification trees with neural network feature extraction IEEE Transactions on Neural Networks 3 1992 923 933 (Pubitemid 23580840)
17. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learning 2001 Springer Verlag New York
18. R.C. Holte Very simple classification rules perform well on most commonly used datasets Machine Learning 11 1993 63 90
19. C.Z. Janikow Fuzzy decision trees: issues and methods IEEE Transactions on Systems, Man and Cybernetics 28 1998 1 14 (Pubitemid 128747981)
20. H. Kim, and W. Loh Classification trees with unbiased multiway splits Journal of the American Statistical Association 2001 589 604
21. N. Landwehr, M. Hall, E. Frank, Logistic model trees, in: Proceedings of the European Conference in Machine Learning, 2003, pp. 241-252. (Pubitemid 37230981)
22. W. Li, and C.F.J. Wu Columnwise-pairwise algorithms with applications to the construction of supersaturated designs Technometrics 39 1997 171 179 (Pubitemid 127634017)
23. Y. Li, M. Dong, and R. Kothari Classifiability-based omnivariate decision trees IEEE Transactions on Neural Networks 16 6 2005 1547 1560 (Pubitemid 41709651)
24. T.S. Lim, W.Y. Loh, and Y.S. Shih A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms Machine Learning 40 2000 203 228
25. W.Y. Loh, and Y.S. Shih Split selection methods for classification trees Statistica Sinica 7 1997 815 840
26. W.Y. Loh, and N. Vanichsetakul Tree-structured classification via generalized discriminant analysis Journal of the American Statistical Association 83 1988 715 725
27. S.K. Murthy Automatic construction of decision trees from data: a multi-disciplinary survey Data Mining and Knowledge Discovery 2 4 1998 345 389 (Pubitemid 128695483)
28. S.K. Murthy, S. Kasif, and S. Salzberg A system for induction of oblique decision trees Journal of Artificial Intelligence Research 2 1994 1 32
29. J.R. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufman San Meteo, CA
30. C.E. Rasmussen, R.M. Neal, G. Hinton, D. van Camp, M. Revow, Z. Ghahramani, R. Kustra, R. Tibshirani, Delve Data for Evaluating Learning in Valid Experiments, 1995-1996. .
31. U. Rückert, and L.D. Raedt An experimental evaluation of simplicity in rule learning Artificial Intelligence 172 2008 19 28 (Pubitemid 350046512)
32. G. Schwarz Estimating the dimension of a model Annals of Statistics 6 1978 461 464
33. A. Statnikov, C. Aliferis, I. Tsamardinos, D. Hardin, and S. Levy A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis Bioinformatics 21 2005 631 643 (Pubitemid 40424789)
34. V. Vapnik The Nature of Statistical Learning Theory 1995 Springer Verlag New York
35. V. Vapnik, E. Levin, and Y.L. Cun Measuring the VC-dimension of a learning machine Neural Computation 6 1994 851 876
36. X.Z. Wang, and C.R. Dong Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy IEEE Transactions on Fuzzy Systems 17 2009 556 567
37. X.Z. Wang, J.H. Zhai, and S.X. Lu Induction of multiple fuzzy decision trees based on rough set technique Information Sciences 178 2008 3188 3202
38. E. Yen, and I.-W.M. Chu Relaxing instance boundaries for the search of splitting points of numerical attributes in classification trees Information Sciences 177 2007 1276 1289 (Pubitemid 44908294)
39. O.T. Yildiz, and E. Alpaydin Omnivariate decision trees IEEE Transactions on Neural Networks 12 6 2001 1539 1546 (Pubitemid 33106064)
40. O.T. Yildiz, and E. Alpaydin Linear discriminant trees International Journal of Pattern Recognition and Artificial Intelligence 19 3 2005 323 353 (Pubitemid 40661791)
41. O.T. Yildiz, E. Alpaydin, Model selection in omnivariate decision trees, in: Proceedings of the 18th European Conference on Machine Learning, 2005, pp. 473-484.