Performance evaluation of Bagging and Boosting in nonparametric regression

Metron

Volumn 59, Issue 3-4, 2001, Pages 141-156

  Borra, Simone ^a   Di Ciaccio, Agostino ^b  

^a UNIVERSITY OF ROME TOR VERGATA   (Italy)

^b UNIVERSITY OF URBINO   (Italy)

Author keywords

Bagging; Boosting; Nonparametric regression; Prediction error; Projection pursuit regression; Pruning

Indexed keywords

EID: 60449120081     PISSN: 00261424     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (22)

1. Bauer, E. and Kohavi, R. (1998) An empirical comparison of voting classification algorithms: Bagging, Boosting, and variants, Machine Learning, vv:1-38.
2. Borra, S. and Di Ciaccio, A. (2001) Reduction of prediction error by bagging projection pursuit regression, in Advances in Classification and Data Analysis, Borra S., Rocci R., Vichi M., Schader M. eds., Springer Verlag.
3. Breiman, L. (1996) Bagging predictors, Machine Learning, 26, n.2:123-140.
4. Breiman, L. (1998a) Arcing Classifier, discussion paper, Annals of Statistics, 26:801-824.
5. Breiman, L. (1998b) Half and half bagging and hard boundary points, Technical Report n. 534, Statistics Department, University of California, Berkeley.
6. Breiman, L. (1999) Using adaptive bagging to debias regressions, Technical Report n. 547, Statistics Department, University of California, Berkeley.
7. Diaconis, P. and Shahshahani, M. (1984) On non linear functions of linear combinations, SIAM, J. Sci. Statist. Comput., 5: 175-191.
8. Dietterich, T. G. (1997) Machine Learning Research: Four Current Directions, A.I. Magazine, 18 (4): 97-136.
9. Dietterich, T. G. (1998) An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, Boosting, and Randomization, Machine Learning: 1-22.
10. Drucker, H. (1997) Improving Regressors using Boosting Techniques, in Proceedings of the Fourteenth International Conference on Machine Learning, ed. Fisher D.H., Jr., Morgan-Kaufmann: 107-115.
11. Drucker, H. and Cortes, C. (1996) Boosting decision trees, Advances in Neural Information Processing Systems, 8: 479-485.
12. Efron, B. and Tibshirani, R.J. (1993) An Introduction to the Bootstrap, Chapman & Hall, New York.
13. Freunde, Y. and Schapire, R. (1996) Experiments with a new boosting algorithm, in Machine Learning: Proceedings of the Thirteenth International Conference: 148- 156.
14. Freunde, Y. and Schapire, R. (1997) A decision-theoretic generalization of on-line learning and an application to boosting, Journal of Computer and System Sciences, 55(1):119-139.
15. Friedman, J.H. (1985) Classification and multiple regression through projection pursuit, Technical Report n. 12, Dept. of Statistics, Stanford University.
16. Friedman, J.H. (1991) Multivariate adaptive regression splines, The Annals of Statistics, 19:1-141.
17. Friedman, J.H. (1999) Greedy Function Approximation: a Gradient Boosting Machine, Technical report, Dept. of Statistics, Stanford University: in http: //www-stat.stanford.edu/ jhf/.
18. Friedman, J.H. and Hall, P. (1999) On Bagging and Nonlinear Estimation, in http: //www-stat.stanford.edu/ jhf/.
19. Friedman, J.H. and Stuetzle, W. (1981) Projection Pursuit Regression, Journal of the American Statistical Association, 76: 817-823.
20. Quinlan, J. R. (1996) Bagging, boosting, and C4.5, in Proceedings of the Thirteenth National Conference on Artificial Intelligence, 725-730.
21. Ridgeway, G., Madigan, D. and Richardson, T. (1999) Boosting methodology for regression problems, in Proceedings of the 7th International Workshop on Artificial Intelligence and Statistics, January 3-6, Florida.
22. Schwenk, H. and Bengio, Y. (1998) Training methods for adaptive boosting of neural networks for charater recognition, in Advances in Neural Information Processing Systems, 10.