Estimating residual variance in random forest regression

Computational Statistics and Data Analysis

Volumn 55, Issue 11, 2011, Pages 2937-2950

  Mendez, Guillermo ^a   Lohr, Sharon ^b  

^a Arizona State University ^*  (United States)

^b ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Bootstrap; Gender gap; Greater male variability hypothesis; Nonparametric regression; Proximity measure; Regression tree; Sex differences

Indexed keywords

BOOTSTRAP; GENDER GAP; GREATER MALE VARIABILITY HYPOTHESIS; NON-PARAMETRIC REGRESSION; PROXIMITY MEASURE; REGRESSION TREES; SEX DIFFERENCE;

ALGORITHMS; BYPRODUCTS; COMPUTER SIMULATION; DATA MINING; DECISION TREES; MONTE CARLO METHODS; PLANT EXTRACTS; REGRESSION ANALYSIS;

ESTIMATION;

EID: 79959703102     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2011.04.022     Document Type: Article

References (40)

1. Arizona Department of Education Arizona's Instrument to Measure Standards 2007 Technical Report 2009 CTB/McGraw-Hill Monterey, CA
2. Biau, G., 2010. Analysis of a random forests model. Available at: arXiv:1005.0208v1.
3. G. Biau, and L. Devroye On the layered nearest neighbour estimate, the bagged nearest neighbour estimate and the random forest method in regression and classification Journal of Multivariate Analysis 101 2010 2499 2518
4. L. Breiman Bagging predictors Machine Learning 24 1996 123 140 (Pubitemid 126724382)
5. Breiman, L., 1996b. Out-of-bag estimation. Technical Report. Dept. of Statistics, Univ. of California, Berkeley.
6. L. Breiman Random forests Machine Learning 45 2001 5 32 (Pubitemid 32933532)
7. Breiman, L., 2004. Consistency for a simple model of random forests. Technical Report 670. Dept. of Statistics, Univ. of California, Berkeley.
8. L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone Classification and Regression Trees 1984 Wadsworth Belmont, CA
9. M.J. Buckley, G.K. Eagleson, and B.W. Silverman The estimation of residual variance in nonparametric regression Biometrika 75 1988 189 199
10. D.O. Cahoy A bootstrap test for equality of variances Computational Statistics and Data Analysis 54 2010 2306 2316
11. C.K. Carter, and G.K. Eagleson A comparison of variance estimators in nonparametric regression Journal of the Royal Statistical Society B 54 1992 773 780
12. A.C. Davison, and D.V. Hinkley Bootstrap Methods and Their Application 1997 Cambridge University Press Cambridge, UK
13. R. Díaz-Uriarte, and S. Alvarez de Andrés Gene selection and classification of microarray data using random forest BMC Bioinformatics 7 2006
14. B. Efron The estimation of prediction error: covariance penalties and cross-validation (with discussion) Journal of the American Statistical Association 99 2004 619 632 (Pubitemid 39332847)
15. H. Ellis Man and Woman: A Study of Human Sexual Characters 1894 Walter Scott London
16. A. Feingold Gender differences in variability in intellectual abilities: a cross-cultural perspective Sex Roles 30 1994 81 92
17. F. Galton Hereditary Genius: An Inquiry into Its Laws and Consequences 1869 Macmillan London
18. R. Genuer, J.M. Poggi, and C. Tuleau-Malot Variable selection using random forests Pattern Recognition Letters 31 2010 2225 2236
19. P. Hall, J.W. Kay, and D.M. Titterington Asymptotically optimal difference-based estimation of variance in nonparametric regression Biometrika 77 1990 521 528
20. P. Hall, and J.S. Marron On variance estimation in nonparametric regression Biometrika 77 1990 415 419
21. T. Hastie, and R. Tibshirani Generalized Additive Models 1990 Chapman & Hall London
22. Hausmann, R., Tyson, L.D., Zahidi, S., 2007. The Global Gender Gap Report. World Economic Forum, Geneva, Switzerland.
23. Hyde, J.S., Mertz, J., 2009. Gender, culture, and mathematics performance. In: Proceedings of the National Academy of Sciences, vol. 106. pp. 88018807.
24. W. Johnson, A. Carothers, and I.J. Dreary Sex differences in variability in general intelligence Perspectives on Psychological Science 3 2008 518 531
25. K.B. Kulasekera, and C. Gallagher Variance estimation in nonparametric multiple regression Communications in Statistics. Theory and Methods 31 2002 1373 1383
26. Liaw, A., Wiener, M., 2002. Classification and regression by randomForest. R News: The Newsletter of the R Project 2, pp. 1822. Available online at http://cran.r-project.org/doc/Rnews/.
27. Y. Lin, and Y. Jeon Random forests and adaptive nearest neighbors Journal of the American Statistical Association 101 2006 578 590 (Pubitemid 43972300)
28. D.F. Lohman, and J.M. Lakin Consistencies in sex differences on the Cognitive Abilities Test across countries, grades, test forms, and cohorts British Journal of Educational Psychology 79 2009 389 407
29. K.L. Lunetta, L.B. Hayward, J. Segal, and P. Van Eerdewegh Screening large-scale association study data: exploiting interactions using random forests BMC Genetics 5 2004 32
30. S. Machin, and T. Pekkarinen Global sex differences in test score variability Science 322 2008 1331 1332 (Pubitemid 352775232)
31. N. Meinshausen Quantile regression forests Journal of Machine Learning Research 7 2006 983 999 (Pubitemid 43902307)
32. Mendez, G., 2008. Tree-based methods to model dependent data. Ph.D. Thesis, Arizona State University.
33. J. Rice Bandwidth choice for nonparametric regression The Annals of Statistics 12 1984 1215 1230
34. R. Romero, S. Mazaki-Tovi, E. Vaisbuch, J.P. Kusanovic, T. Chaiworapongsa, R. Gomez, J.K. Nien, B.H. Yoon, M. Mazor, J. Luo, D. Banks, J. Ryals, and C. Beecher Metabolomics in premature labor: a novel approach to identify patients at risk for preterm delivery Journal of Maternal-Fetal and Neonatal Medicine 23 2010 1344 1359
35. P.J. Rousseeuw, and C. Croux Alternatives to the median absolute deviation Journal of the American Statistical Association 88 1993 1273 1283
36. T. Shi, and S. Horvath Unsupervised learning with random forest predictors Journal of Computational and Graphical Statistics 15 2006 118 138 (Pubitemid 43514414)
37. L.H. Shoemaker Fixing the F test for equal variances The American Statistician 57 2003 105 114 (Pubitemid 36594032)
38. V. Spokoiny Variance estimation in high-dimensional regression models Journal of Multivariate Analysis 82 2002 111 133
39. T. Tong, and Y. Wang Estimating residual variance in nonparametric regression using least squares Biometrika 92 2005 821 830 (Pubitemid 41681236)
40. D.H. Wolpert, and W.G. McCready An efficient method to estimate bagging's generalization error Machine Learning 35 1999 41 55