Dynamic Random Forests

Pattern Recognition Letters

Volumn 33, Issue 12, 2012, Pages 1580-1586

  Bernard, Simon ^a   Adam, Sébastien ^a   Heutte, Laurent ^a  

^a UNIVERSITÉ DE ROUEN   (France)

Author keywords

Dynamic induction; Ensemble of classifiers; Random feature selection; Random forests

Indexed keywords

BOOSTING ALGORITHM; ENSEMBLE OF CLASSIFIERS; INDUCTION ALGORITHMS; RANDOM FORESTS; RANDOMIZATION PROCESS; RESAMPLING; RF INDUCTION; TRAINING DATA; TREE INDUCTION;

ALGORITHMS; DECISION TREES;

FORESTRY;

ALGORITHMS; FORESTRY; RANDOM PROCESSES;

EID: 84862295459     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2012.04.003     Document Type: Article

References (37)

1. Y. Amit, and D. Geman Shape quantization and recognition with randomized trees Neural Comput. 9 1996 1545 1588
2. Banfield, R.; Hall, L.; Bowyer, K.; Bhadoria, D.; Kegelmeyer, W.P.; Eschrich, S.; 2004. A comparison of ensemble creation techniques, In: The Fifth Internat. Conf. on Multiple Classifier Systems, pp. 223-232
3. R. Banfield, L. Hall, K. Bowyer, and W. Kegelmeyer A comparison of decision tree ensemble creation techniques IEEE Trans. Pattern Anal. Machine Intell. 29 1 2006 173 180
4. Bernard, S.; Heutte, L.; Adam, S.; 2007. Using random forests for handwritten digit recognition. In: Internat. Conf. on Document Analysis and Recognition, pp. 1043-1047.
5. S. Bernard, L. Heutte, and S. Adam Forest-RK: A new random forest induction method D.-S. Huang, D.C.W. II, D.S. Levine, K.-H. Jo, Proc. of the Internat. Conf. on Intelligent Computing (ICIC'08) Lecture Notes in Computer Science 5227 2008 Springer 430 437
6. Bernard, S.; Heutte, L.; Adam, S.; 2009. Influence of hyperparameters on random forests accuracy, In: Workshop on Multiple Classifier Systems, pp. 171-180.
7. Bernard, S.; Heutte, L.; Adam, S.; 2007. Using random forests for handwritten digit recognition, In: Internat. Conf. on Document Analysis and Recognition, pp. 1043-1047.
8. Bernard, S.; 2009. Random forests: From the study of behaviors to dynamic induction, Ph.D. Thesis (in french), University of Rouen, France.
9. L. Breiman Bagging predictors Mach. Learning 24 2 1996 123 140
10. Breiman, L.; 1996. Out-of-bag estimation, Technical Report, Department of Statistics, University of California, Berkeley.
11. L. Breiman Arcing classifiers Ann. Statist. 26 3 1998 801 849
12. L. Breiman Random forests Mach. Learning 45 1 2001 5 32
13. Chatelain, C.; Heutte, L.; Paquet, T.; 2006. A two-stage outlier rejection strategy for numerical field extraction in handwritten documents. In: Internat. Conf. on Pattern Recognition, Honk Kong, China, vol 3, pp. 224-227.
14. Cutler, A.; Zhao, G.; 2001. Pert - perfect random tree ensembles, Computing Science and Statistics, 33.
15. T. Dietterich An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization Mach. Learning 40 1998 139 157
16. Frank, A.; Asuncion, A.; 2010. UCI machine learning repository. .
17. Freund, Y.; Schapire, R.; 1996. Experiments with a new boosting algorithm. In: Internat. Conf. Machine Learning, pp. 148-156.
18. J. Gall, A. Yao, N. Razavi, L.V. Gool, and V. Lempitsky Hough forests for object detection, tracking, and action recognition IEEE Trans. Pattern Anal. Machine Intell. 33 11 2011 2188 2202
19. P. Geurts, D. Ernst, and L. Wehenkel Extremely randomized trees Mach. Learning 36 1 2006 3 42
20. I. Guyon, S. Gunn, M. Nikravesh, and L. Zadeh Feature extraction: foundations and applications Studies in Fuzziness and Soft Computing 207 2004
21. Hao, H.; Liu, C.; Sako H.; 2003. Comparison of genetic algorithm and sequential search methods for classifier subset selection, In: Seventh Internat. Conf. on Document Analysis and Recognition, vol. 2, pp. 765-769.
22. L. Heutte, T. Paquet, J. Moreau, Y. Lecourtier, and C. Olivier A structural/statistical feature based vector for handwritten character recognition Pattern Recognition Lett. 19 7 1998 629 641
23. T. Ho The random subspace method for constructing decision forests IEEE Trans. Pattern Anal. Machine Intell. 20 8 1998 832 844
24. F. Kimura, S. Tsuruoka, Y. Miyake, and M. Shridhar A lexicon directed algorithm for recognition of unconstrained handwritten words IEICE Trans. Inform. Syst. E77-D 7 1994 785 793
25. Latinne, P.; Debeir, O.; Decaestecker, C.; 2001. Limiting the number of trees in random forests. In: 2nd Internat. Workshop on Multiple Classifier Systems, pp. 178-187.
26. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner Gradient-based learning applied to document recognition Proc. IEEE 86 11 1998 2278 2324
27. D. Mease, and A. Wyner Evidence contrary to the statistical view of boosting J. Mach. Learn. Res. 9 2008 131 156
28. R. Meir, and G. Rätsch An introduction to boosting and leveraging Adv. Lect. Machine Learn. 2003 118 183
29. K.K. Nicodemus On the stability and ranking of predictors from random forest variable importance measures Briefings Bioinform. 12 4 2011 369 373
30. M. Robnik-Sikonja Improving random forests European Conf. on Machine Learning LNAI 3210 2004 Springer Berlin 359 370
31. J. Rodriguez, L. Kuncheva, and C. Alonso Rotation forest: A new classifier ensemble method IEEE Trans. Pattern Anal. Machine Intell. 28 10 2006 1619 1630
32. C. Strobl, A.L. Boulesteix, A. Zeileis, and T. Hothorn Bias in random forest variable importance measures: Illustrations, sources and a solution BMC Bioinform. 8 25 2007
33. Tripoliti, E.; Fotiadis, D.; Argyropoulou, M.; 2008. An automated supervised method for the diagnosis of alzheimers disease based on fmri data using weighted voting schemes, In: IEEE International Workshop on Imaging Systems and Techniques, pp. 340-345.
34. Tsymbal, A.; Pechenizkiy, M.; Cunningham, P.; 2006. Dynamic integration with random forests, In: European Conf. on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, pp. 801-808.
35. A. Verikas, A. Gelzinis, and M. Bacauskiene Mining data with random forests: A survey and results of new tests Pattern Recognition 44 2 2011 330 349
36. Wang, A.; Wan, G.; Cheng, Z.; Li, S.; 2009. An incremental extremely random forest classifier for online learning and tracking. In: ICIP'09 Proceedings of the 16th IEEE International Conference on Image Processing, pp. 1433-1436.
37. Wolf, L.; Martin, I.; 2005. Robust boosting for learning from few examples. In: IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, CVPR, pp. 359-364.