On the selection of decision trees in Random forests

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2009, Pages 302-307

  Bernard, Simon ^a   Heutte, Laurent ^a   Adam, Sébastien ^a  

^a UNIVERSITÉ DE ROUEN   (France)

Author keywords

[No Author keywords available]

Indexed keywords

APRIORI; CLASSIFIER SELECTION; DECISION TREE CLASSIFIERS; ENSEMBLE METHODS; ENSEMBLE PERFORMANCE; FIXED NUMBERS; INTERPRETABILITY; OPTIMAL CLASSIFIERS; POOR PERFORMANCE; RANDOM FORESTS; RANDOMIZED DECISIONS; RF INDUCTION;

CLASSIFIERS; LEARNING SYSTEMS; NEURAL NETWORKS;

DECISION TREES;

EID: 70449422000     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2009.5178693     Document Type: Conference Paper

References (23)

1. Y. Freund and R. Schapire, "Experiments with a new boosting algorithm, " International Conference on Machine Learning, pp. 148-156, 1996.
2. L. Breiman, "Arcing classifiers, " The Annals of Statistics, vol. 26, no. 3, pp. 801-849, 1998.
3. -, "Bagging predictors, " Machine Learning, vol. 24, no. 2, pp. 123-140, 1996.
4. T. Ho, "The random subspace method for constructing decision forests, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 8, pp. 832-844, 1998.
5. L. Breiman, "Random forests, " Machine Learning, vol. 45, no. 1, pp. 5-32, 2001.
6. L. Kuncheva, "That elusive diversity in classifier ensembles, " IbPRIA, pp. 1126-1138, 2003.
7. -, Combining Pattern Recognition. Methods and Algorithms. John Wiley and Sons, 2004.
8. S. Bernard, L. Heutte, and S. Adam, "Using random forests for handwritten digit recognition, " International Conference on Document Analysis and Recognition, pp. 1043-1047, 2007.
9. P. Boinee, A. D. Angelis, and G. Foresti, "Meta random forests, " International Journal of Computational Intelligence, vol. 2, no. 3, pp. 138-147, 2005.
10. L. Breiman, "Consistency of random forests and other averaging classifiers, " Technical Report, 2004.
11. A. Cutler and G. Zhao, "Pert - perfect random tree ensembles, " Computing Science and Statistics, vol. 33, 2001.
12. P. Geurts, D. Ernst, and L. Wehenkel, "Extremely randomized trees, " Machine Learning, vol. 36, no. 1, pp. 3-A2, 2006.
13. P. Latinne, O. Debeir, and C. Decaestecker, "Limiting the number of trees in random forests, "2nd International Workshop on Multiple Classifier Systems, pp. 178-187, 2001.
14. J. Rodriguez, L. Kuncheva, and C. Alonso, "Rotation forest : A new classifier ensemble method, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1619-1630, 2006.
15. M. Robnik-Sikonja, "Improving random forests, " European Conference on Machine Learning, LNAI 3210, Springer, Berlin, pp. 359-370, 2004.
16. H. Hao, C. Liu, and H. Sako, "Comparison of genetic algorithm and sequential search methods for classifier subset selection. " Seventh International Conference on Document Analysis and Recognition, vol. 2, pp. 765-769, 2003.
17. L. Breiman, J. Friedman, R. Olshen, and C. Stone, Classification and Regression Trees. Chapman and Hall (Wadsworth, Inc.) : New York, 1984.
18. R. Kohavi and G. H. John, "Wrappers for feature subset selection, " Artificial Intelligence, vol. 97, no. 1-2, pp. 273-324, 1997.
19. F. Roli, G. Giacinto, and G. Vernazza, "Methods for designing multiple classifier systems, " Multiple Classifiers Systems, pp. 78-87, 2001.
20. A. Asuncion and D. Newman, "UCI machine learning repository, " 2007. [Online]. Available: http://archive.ics.uci.edu/ml/
21. Y LeCun, L. Bottou, Y Bengio, and P. Haffner, "Gradient-based learning applied to document recognition, " Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.
22. S. Bernard, L. Heutte, and S. Adam, "Influence of hyperparameters on random forest accuracy, " Technical Report, University of Rouen, 2008.
23. P. Somol, P. Pudil, and J. Kittler, "Fast branch and bound algorithms for optimal feature selection, " IEEE transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 7, pp. 900-912, 2004.