Towards generating random forests via extremely randomized trees

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2014, Pages 2645-2652

  Zhang, Le ^a   Ren, Ye ^a   Suganthan, P N ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

RANDOM FORESTS;

BIAS AND VARIANCE; CLASSIFICATION ERRORS; ENSEMBLE CLASSIFIERS; ENSEMBLE METHODS; MULTIVARIATE DECISION TREE; RANDOM PARTITIONS; RANDOMIZED TREES; UNIVARIATE DECISION TREES;

DECISION TREES;

EID: 84908494818     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2014.6889537     Document Type: Conference Paper

References (36)

1. L. Breiman, "Bias, variance, and arcing classifiers", 1996.
2. -, "Bagging predictors", Machine learning, vol. 24, no. 2, pp. 123-140, 1996.
3. Y. Freund, R. E. Schapire et al., "Experiments with a new boosting algorithm", in ICML, vol. 96, 1996, pp. 148-156.
4. R. E. Banfield, L. O. Hall, K. W. Bowyer, D. Bhadoria, W. P. Kegelmeyer, and S. Eschrich, "A comparison of ensemble creation techniques", in Multiple classifier systems. Springer, 2004, pp. 223-232.
5. E. Bauer and R. Kohavi, "An empirical comparison of voting classification algorithms: Bagging, boosting, and variants", Machine learning, vol. 36, no. 1-2, pp. 105-139, 1999.
6. T. G. Dietterich, "Ensemble methods in machine learning", in Multiple classifier systems. Springer, 2000, pp. 1-15.
7. T. K. Ho, "The random subspace method for constructing decision forests", Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 20, no. 8, pp. 832-844, 1998.
8. Y. Freund and R. E. Schapire, "A desicion-theoretic generalization of online learning and an application to boosting", in Computational learning theory. Springer, 1995, pp. 23-37.
9. R. E. Schapire and Y. Freund, "Boosting the margin: a new explanation for the effectiveness of voting methods", The Annals of Statistics, vol. 26, pp. 322-330, 1998.
10. T. K. Ho, "A data complexity analysis of comparative advantages of decision forest constructors", Pattern Analysis & Applications, vol. 5, no. 2, pp. 102-112, 2002.
11. L. Breiman, "Random forests", Machine learning, vol. 45, no. 1, pp. 5-32, 2001.
12. H. Jiang, Y. Deng, H.-S. Chen, L. Tao, Q. Sha, J. Chen, C.-J. Tsai, and S. Zhang, "Joint analysis of two microarray gene-expression data sets to select lung adenocarcinoma marker genes", BMC bioinformatics, vol. 5, no. 1, p. 81, 2004.
13. K.-Q. Shen, C.-J. Ong, X.-P. Li, Z. Hui, and E. P. Wilder-Smith, "A feature selection method for multilevel mental fatigue eeg classification", Biomedical Engineering, IEEE Transactions on, vol. 54, no. 7, pp. 1231-1237, 2007.
14. V. Svetnik, A. Liaw, C. Tong, J. C. Culberson, R. P. Sheridan, and B. P. Feuston, "Random forest: a classification and regression tool for compound classification and qsar modeling", Journal of chemical information and computer sciences, vol. 43, no. 6, pp. 1947-1958, 2003.
15. M. Pal, "Random forest classifier for remote sensing classification", International Journal of Remote Sensing, vol. 26, no. 1, pp. 217-222, 2005.
16. A. Criminisi, J. Shotton, and S. Bucciarelli, "Decision forests with longrange spatial context for organ localization in ct volumes", in MICCAI Workshop on Probabilistic Models for Medical Image Analysis, 2009.
17. B. Yao, A. Khosla, and L. Fei-Fei, "Combining randomization and discrimination for fine-grained image categorization", in Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. IEEE, 2011, pp. 1577-1584.
18. T. Hastie, R. Tibshirani, and J. J. H. Friedman, The elements of statistical learning. Springer New York, 2001, vol. 1.
19. G. Biau, L. Devroye, and G. Lugosi, "Consistency of random forests and other averaging classifiers", The Journal of Machine Learning Research, vol. 9, pp. 2015-2033, 2008.
20. Y. Lin and Y. Jeon, "Random forests and adaptive nearest neighbors", Journal of the American Statistical Association, vol. 101, no. 474, pp. 578-590, 2006.
21. B. H. Menze, W. Petrich, and F. A. Hamprecht, "Multivariate feature selection and hierarchical classification for infrared spectroscopy: serumbased detection of bovine spongiform encephalopathy", Analytical and bioanalytical chemistry, vol. 387, no. 5, pp. 1801-1807, 2007.
22. Y. Saeys, T. Abeel, and Y. Van de Peer, "Robust feature selection using ensemble feature selection techniques", in Machine Learning and Knowledge Discovery in Databases. Springer, 2008, pp. 313-325.
23. B. H. Menze, B. M. Kelm, R. Masuch, U. Himmelreich, P. Bachert, W. Petrich, and F. A. Hamprecht, "A comparison of random forest and its gini importance with standard chemometric methods for the feature selection and classification of spectral data", BMC bioinformatics, vol. 10, no. 1, p. 213, 2009.
24. E. Tuv, A. Borisov, G. Runger, and K. Torkkola, "Feature selection with ensembles, artificial variables, and redundancy elimination", The Journal of Machine Learning Research, vol. 10, pp. 1341-1366, 2009.
25. X. Su, C.-L. Tsai, H. Wang, D. M. Nickerson, and B. Li, "Subgroup analysis via recursive partitioning", The Journal of Machine Learning Research, vol. 10, pp. 141-158, 2009.
26. G. Valentini and T. G. Dietterich, "Bias-variance analysis of support vector machines for the development of svm-based ensemble methods", The Journal of Machine Learning Research, vol. 5, pp. 725-775, 2004.
27. C.-X. Zhang and J.-S. Zhang, "Rotboost: A technique for combining rotation forest and adaboost", Pattern Recognition Letters, vol. 29, no. 10, pp. 1524-1536, 2008.
28. P. Geurts, D. Ernst, and L. Wehenkel, "Extremely randomized trees", Machine learning, vol. 63, no. 1, pp. 3-42, 2006.
29. S. Geman, E. Bienenstock, and R. Doursat, "Neural networks and the bias/variance dilemma", Neural computation, vol. 4, no. 1, pp. 1-58, 1992.
30. E. B. Kong and T. G. Dietterich, "Error-correcting output coding corrects bias and variance." in ICML, 1995, pp. 313-321.
31. R. Kohavi, D. H. Wolpert et al., "Bias plus variance decomposition for zero-one loss functions", in ICML, 1996, pp. 275-283.
32. J. H. Friedman, "On bias, variance, 0/1łloss, and the curse-of-dimensionality", Data mining and knowledge discovery, vol. 1, no. 1, pp. 55-77, 1997.
33. L. Breiman, "Arcing classifier (with discussion and a rejoinder by the author)", The annals of statistics, vol. 26, no. 3, pp. 801-849, 1998.
34. G. M. James, "Variance and bias for general loss functions", Machine Learning, vol. 51, no. 2, pp. 115-135, 2003.
35. L. Breiman, "Classification and regression trees", 1984.
36. K. V. S. Murthy and S. L. Salzberg, "On growing better decision trees from data", Ph. D. dissertation, Citeseer, 1995.