Out-of-bag estimation of the optimal sample size in bagging

Pattern Recognition

Volumn 43, Issue 1, 2010, Pages 143-152

  Martínez Muñoz, Gonzalo ^a   Suárez, Alberto ^a  

^a UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

Author keywords

Bagging; Bootstrap sampling; Decision trees; Ensembles of classifiers; Optimal sampling ratio; Subagging; Subsampling

Indexed keywords

BAGGING; BOOTSTRAP SAMPLING; ENSEMBLES OF CLASSIFIERS; OPTIMAL SAMPLING RATIO; SUBAGGING; SUBSAMPLING;

CLASSIFIERS; DECISION TREES; LEARNING SYSTEMS; OPTIMIZATION;

SAMPLING;

EID: 68949164781     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.05.010     Document Type: Article

References (28)

1. Breiman L. Bagging predictors. Machine Learning 24 2 (1996) 123-140
2. J.R. Quinlan, Bagging, boosting, and C4.5, in: Proceedings of the 13th National Conference on Artificial Intelligence, Cambridge, MA, 1996, pp. 725-730.
3. Opitz D., and Maclin R. Popular ensemble methods: an empirical study. Journal of Artificial Intelligence Research 11 (1999) 169-198
4. Bauer E., and Kohavi R. An empirical comparison of voting classification algorithms, boosting, and variants: bagging. Machine Learning 36 1-2 (1999) 105-139
5. Dietterich T.G. An experimental comparison of three methods for constructing ensembles of decision trees, boosting, and randomization: bagging. Machine Learning 40 2 (2000) 139-157
6. Webb G.I. Multiboosting: a technique for combining boosting and wagging. Machine Learning 40 2 (2000) 159-196
7. R. Caruana, A. Niculescu-Mizil, An empirical comparison of supervised learning algorithms, in: ICML '06: Proceedings of the 23rd International Conference on Machine Learning, ACM Press, New York, NY, USA, 2006, pp. 161-168. doi: http://doi.acm.org/10.1145/1143844.1143865.
8. Efron B., and Tibshirani R.J. An Introduction to the Bootstrap (1994), Chapman & Hall, CRC, New York, Boca Raton, FL
9. Bühlmann P., and Yu B. Analyzing bagging. Annals of Statistics 30 (2002) 927-961
10. Buja A., and Stuetzle W. Observations on bagging. Statistica Sinica 16 (2006) 323-351
11. Friedman J.H., and Hall P. On bagging and nonlinear estimation. Journal of Statistical Planning and Inference 137 3 (2007) 669-683
12. Hartigan J. Using subsample values as typical values. Journal of the American Statistical Society 64 (1969) 1303-1317
13. L. Breiman, Out-of-bag estimation, Technical Report, Statistics Department, University of California, 1996.
14. Swanepoel J.W.H. A note on proving that the (modified) bootstrap works. Communications in Statistics-Theory and Methods 15 (1986) 3193-3203
15. Bickel P.J., Gtze F., and van Zwet W.R. Resampling fewer then n observations, losses, and remedies for losses: gains. Statistica Sinica 7 (1997) 1-31
16. Chung K.-H., and Lee S.M.S. Optimal bootstrap sample size in construction of percentile confidence bounds. Scandinavian Journal of Statistics 28 (2001) 225-239
17. Politis D., Romano J.P., and Wolf M. Subsampling, Springer Series in Statistics (1999), Springer, Berlin
18. Davison A.C., Hinkley D.V., and Young G.A. Recent developments in bootstrap methodology. Statistical Science 18 (2003) 141-157
19. Breiman L. Pasting small votes for classification in large databases and on-line. Machine Learning 36 1-2 (1999) 85-103
20. Bühlmann P. Bagging subagging and bragging for improving some prediction algorithms. In: Akritas M.G., and Politis D.N. (Eds). Recent Advances and Trends in Nonparametric Statistics (2003), Elsevier, New York 19-34
21. M. Terabe, T. Washio, H. Motoda, The effect of subsampling rate on subagging performance, in: Proceedings of ECML2001/PKDD2001 Workshop on Active Learning, Database Sampling, and Experimental Design: Views on Instance Selection, 2001, pp. 48-55.
22. Hall P., and Samworth R.J. Properties of bagged nearest neighbour classifiers. Journal of the Royal Statistical Society Series B 67 3 (2005) 363-379
23. P.J. McCarthy, Replication: an approach to the analysis of data from complex surveys, Vital Health Statistics, Public Health Service Publication 14 (1979).
24. B. Efron, The jackknife, the bootstrap, and other resampling plans, Society of Industrial and Applied Mathematics CBMS-NSF Monographs 38 (1982).
25. A. Asuncion, D. Newman, UCI machine learning repository, 2007 URL 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉.
26. Breiman L., Friedman J.H., Olshen R.A., and Stone C.J. Classification and Regression Trees (1984), Chapman & Hall, New York
27. Breiman L. Arcing classifiers. Annals of Statistics 26 3 (1998) 801-849
28. Demšar J. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 7 (2006) 1-30