Double-bagging: Combining classifiers by bootstrap aggregation

Pattern Recognition

Volumn 36, Issue 6, 2003, Pages 1303-1309

  Hothorn, Torsten ^a   Lausen, Berthold ^a  

^a UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

Bagging; Classification; Discriminant analysis; Error rate estimation; Method selection bias

Indexed keywords

BENCHMARKING; COMPUTATION THEORY; ERROR ANALYSIS;

BOOTSTRAP SAMPLES;

PATTERN RECOGNITION;

DISCRIMINANT ANALYSIS;

EID: 0037410515     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0031-3203(02)00169-3     Document Type: Article

References (28)

1. B. Efron, R. Tibshirani, Improvements on cross-validation: the 0:632+ bootstrap method, J. Am. Stat. Assoc. 92 (438) (1997) 548-560.
2. J.H. Friedman, On bias, variance, 0/1-loss, and the course-of-dimensionality, Data Mining Knowledge Discovery 1 (1) (1997) 55-77.
3. T. Hothorn, B. Lausen, Bagging tree classifiers for laser scanning images: data and simulation based strategy, Universität Erlangen-Nürnberg, preprint, submitted for publication.
4. B. Lausen, M. Schumacher, Evaluating the effect of optimized cutoff values in the assessment of prognostic factors, Comput. Stat. Data Anal. 21 (3) (1996) 307-326.
5. L. Breiman, J.H. Friedman, R.A. Olshen, C.J. Stone, Classification and Regression Trees, Wadsworth, California, 1984.
6. L. Breiman, Bagging Predictors, Mach. Learning 24 (2) (1996) 123-140.
7. L. Breiman, Arcing classifiers, Ann. Stat. 26 (3) (1998) 801-824.
8. R.E. Schapire, Y. Freund, P. Bartlett, W.S. Lee, Boosting the margin: a new explanation for the effectiveness of voting methods, Ann. Stat. 26 (5) (1998) 1651-1686.
9. L.I. Kuncheva, J.C. Bezdek, R.P.W. Duin, Decision templates for multiple classifier fusion: an experimental comparison, Pattern Recognition 34 (2) (2001) 299-314.
10. A. Saranli, M. Demirekler, A statistical unified framework for rank-based multiple classifier decision combination, Pattern Recognition 34 (4) (2001) 865-884.
11. G. Giacinto, F. Roli, Dynamic classifier selection based on multiple classifier behaviour, Pattern Recognition 34 (9) (2001) 1879-1881.
12. Q. Du, C.-I. Chang, A linear constrained distance-based discriminant analysis for hyperspectral image classification, Pattern Recognition 34 (2) (2001) 361-373.
13. H. Yu, J. Yang, A direct LDA algorithm for high-dimensional data-with application to face recognition, Pattern Recognition 34 (10) (2001) 2067-2070.
14. M. Skurichina, R.P.W. Duin, Bagging for linear classifiers, Pattern Recognition 31 (7) (1998) 909-930.
15. M. Skurichina, R.P.W. Duin, The role of combining rules in bagging and boosting, Lecture Notes in Computer Science, Adv. Pattern Recognition 1876 (2000) 631-640.
16. B. Lausen, W. Sauerbrei, M. Schumacher, Classification and regression trees (CART) used for the exploration of prognostic factors measured on different scales, in: P. Dirschedl, R. Ostermann (Eds.), Computational Statistics, Physica-Verlag, Heidelberg, 1994, pp. 483-496.
17. L. Breiman, Out-of-bag estimation, Technical Report, Statistics Department, University of California Berkeley, Berkeley CA 94708, 1996.
18. B.D. Ripley, Pattern Recognition and Neural Networks, Cambridge University Press, Cambridge, UK, 1996.
19. Heidelberg Engineering, Heidelberg Retina Tomograph: Bedienungsanleitung Software version 2.01, Heidelberg Engineering GmbH, Heidelberg, 1997.
20. N.V. Swindale, G. Stjepanovic, A. Chin, F.S. Mikelberg, Automated analysis of normal and glaucomatous optic nerve head topography images, Invest. Ophthalmol. Visual Sci. 41 (7) (2000) 1730-1742.
21. A. Peters, T. Hothorn, B. Lausen, Ipred: improved predictors, R News 2 (2) (2002) 33-36.
22. R. Ihaka, R. Gentlemen, R: a language for data analysis and graphics, J. Comput. Graphical Stat. 5 (1996) 299-314.
23. T. Therneau, E. Atkinson, An Introduction to recursive partitioning using the rpart routine, Technical Report, Vol. 61, Section of Biostatistics, Mayo Clinic, Rochester, 1997.
24. M. LeBlanc, R. Tibshirani, Combing estimates in regression and classification, J. Amer. Stat. Assoc. 91 (436) (1996) 1641 -1650.
25. G.I. Webb, Multiboosting: a technique for combining boosting and wagging, Mach. Learning 40 (2) (2000) 159-196.
26. C.J. Merz, Using correspondence analysis to combine classifiers, Mach. Learning 36 (1-2) (1999) 33-58.
27. J.S. Rao, R. Tibshirani, The out-of-boostrap method for model averaging and selection, Technical Report, Cleveland Clinic and University of Toronto, 1997.
28. D.H. Wolpert, W.G. Macready, An efficient method to estimate bagging's generalization, Mach. Learning 35 (1) (1999) 41-51.