Bagging equalizes influence

Machine Learning

Volumn 55, Issue 3, 2004, Pages 251-270

  Grandvalet, Yves ^a  

^a UNIVERSITÉ DE TECHNOLOGIE DE COMPIÈGNE   (France)

Author keywords

Bagging; Bias variance; Influence; Leverage

Indexed keywords

ALGORITHMS; ERROR ANALYSIS; PERTURBATION TECHNIQUES; TREES (MATHEMATICS);

BAGGING; BIAS/VARIANCE; INFLUENCE; LEVERAGE;

LEARNING SYSTEMS;

EID: 3543107923     PISSN: 08856125     EISSN: None     Source Type: Journal    
DOI: 10.1023/B:MACH.0000027783.34431.42     Document Type: Article

References (26)

1. Bauer, E., & Kohavi, R. (1999). An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Machine Learning, 36:1/2, 105-139.
2. Breiman, L. (1996a). Bagging predictors. Machine Learning, 24:2, 123-140.
3. Breiman, L. (1996b). Bias, variance, and arcing classifiers. Technical Report 460, Statistics Department, University of California at Berkeley.
4. Breiman, L. (1996c). Heuristics of instability and stabilization in model selection. The Annals of Statistics, 24:6, 2350-2383.
5. Breiman, L. (1998). Arcing classifiers. The Annals of Statistics, 26:3, 801-849.
6. Breiman, L. (1999), Prediction games and arcing algorithms. Neural Computation, 11:7, 1493-1517.
7. Bühlmann, P., & Yu, B. (2000). Explaining Bagging. Technical Report 92, Seminar für Statistik, ETH, Zürich.
8. Buja, A., & Stuetzle, W. (2000). The effect of bagging on variance, bias and mean squared error. Technical Report, AT&T Labs-Research.
9. Burgess, A. N. (1997). Estimating equivalent kernels For neural networks: A data perturbation approach. In M. Mozer, M. Jordan, & T. Petsche (Eds.), Advances in Neural Information Processing Systems 9 (pp. 382-388). MIT Press.
10. Dietterich, T. G. (2000). An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting and randomization. Machine Learning, 40:2, 1-19.
11. Domingos, P. (1997). Why does bagging work? A Bayesian account and its implications. In Proceedings of the Third International Conference on Knowledge Discovery and Data Mining (pp. 155-158). AAAI Press.
12. Drucker, H. (1997). Improving regressors using boosting techniques. In Proceedings of the Fourteenth International Conference on Machine Learning (pp. 107-115). Morgan Kaufmann.
13. Efron, B., & Tibshirani, R. J. (1993). An introduction to the bootstrap, Vol. 57 of monographs on statistics and applied probability. Chapman & Hall.
14. Friedman, J. H., & Hall, P. (2000), On bagging and non-linear estimation. Technical Report, Stanford University, Stanford, CA.
15. Hastie, T. J., & Tibshirani, R. J. (1990). Generalized additive models, Vol. 43 of monographs on statistics and applied probability. Chapman & Hall.
16. Huber, P. J. (1981). Robust statistics. Wiley.
17. Maclin, R., & Opitz, D. (1997). An empirical evaluation of bagging and boosting. In Proceedings of the Fourteenth National Conference on Artificial Intelligence (pp. 546-551). AAAI Press.
18. Quinlan, J. R. (1996). Bagging, boosting, and C4.5. In Proceedings of the Thirteenth National Conference on Artificial Intelligence (pp. 725-730). AAAI Press.
19. Rao, J. S., & Tibshirani, R. J. (1997). The out-of-bootstrap method for model averaging and selection. Technical Report, University of Toronto.
20. Raviv, Y., & Intrator, N. (1996). Bootstrapping with noise: An effective regularization technique. Connection Science, 8:3, 355-372.
21. Rousseeuw, P. J. (1997). Robust regression, positive breakdown. In S. Kotz, C. Read, & D. Banks (Eds.), Encyclopedia of statistical sciences. Wiley.
22. Saporta, G. (1990). Probabilités, analyse des données et statistique. Paris: Editions Technip.
23. Schapire, R., Freund, Y., Bartlett, P., & Lee, W. S. (1998). Boosting the margin: A new explanation for the effectiveness of voting methods. The Annals of Statistics, 26:5, 1651-1686.
24. Taniguchi, M., & Tresp, V. (1997). Averaging regularized estimators. Neural Computation, 9:7, 1163-1178.
25. Tibshirani, R. J., & Knight, K. (1999). The covariance inflation criterion for adaptive model selection. Journal of the Royal Statistical Society, B, 61:3, 529-546.
26. Wolpert, D. H., & Macready, W. G. (1996). Combining stacking with bagging to improve a learning algorithm. Technical Report SFI-TR-96-03-123, Santa Fe Institute.