Influence of hyperparameters on random forest accuracy

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5519 LNCS, Issue , 2009, Pages 171-180

  Bernard, Simon ^a   Heutte, Laurent ^a   Adam, Sébastien ^a  

^a UNIVERSITÉ DE ROUEN   (France)

Author keywords

Decision Trees; Ensemble Method; Random Forests; Supervised Learning

Indexed keywords

CLASSIFICATION ACCURACY; CLASSIFICATION METHODS; DATA SETS; DEFAULT VALUES; ENSEMBLE METHOD; EXPERIMENTAL STUDIES; HYPER-PARAMETER; HYPERPARAMETERS; MACHINE LEARNING PROBLEM; ONE STEP; OPTIMAL SETTING; PARAMETRIZATIONS; RANDOM FORESTS; REFERENCE ALGORITHM; RF PERFORMANCE; TREE INDUCTION;

CLASSIFIERS; DECISION TREES; OPTIMIZATION; SUPERVISED LEARNING;

LEARNING ALGORITHMS;

EID: 70349325846     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-02326-2_18     Document Type: Conference Paper

References (15)

1. Breiman, L.: Bagging predictors. Machine Learning 24(2), 123-140 (1996)
2. Ho, T.: The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(8), 832-844 (1998)
3. Bernard, S., Heutte, L., Adam, S.: Using random forests for handwritten digit recognition. In: International Conference on Document Analysis and Recognition, pp. 1043-1047 (2007)
4. Breiman, L.: Random forests. Machine Learning 45(1), 5-32 (2001)
5. Breiman, L.: Consistency of random forests and other averaging classifiers. Technical Report (2004)
6. Geurts, P., Ernst, D., Wehenkel, L.: Extremely randomized trees. Machine Learning 36(1), 3-42 (2006)
7. Latinne, P., Debeir, O., Decaestecker, C.: Limiting the number of trees in random forests. In: Kittler, J., Roli, F. (eds.) MCS 2001. LNCS, vol. 2096, pp. 178-187. Springer, Heidelberg (2001)
8. Rodriguez, J., Kuncheva, L., Alonso, C.: Rotation forest: A new classifier ensemble method. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(10), 1619-1630 (2006)
9. Breiman, L., Friedman, J., Olshen, R., Stone, C.: Classification and Regression Trees. Chapman and Hall/Wadsworth, Inc., New York (1984)
10. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proceedings of the IEEE 86(11), 2278-2324 (1998)
11. Asuncion, A., Newman, D.: UCI machine learning repository (2007)
12. Chatelain, C., Heutte, L., Paquet, T.: A two-stage outlier rejection strategy for numerical field extraction in handwritten documents. In: International Conference on Pattern Recognition, Honk Kong, China, vol. 3, pp. 224-227 (2006)
13. Heutte, L., Paquet, T., Moreau, J., Lecourtier, Y., Olivier, C.: A structural/statistical feature based vector for handwritten character recognition. Pattern Recognition Letters 19(7), 629-641 (1998)
14. Kimura, F., Tsuruoka, S., Miyake, Y., Shridhar, M.: A lexicon directed algorithm for recognition of unconstrained handwritten words. IEICE Transaction on Information and System E77-D(7), 785-793 (1994)
15. Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. Journal ofMachine Learning Research 3, 1157-1182 (2003)