Greedy function approximation: A gradient boosting machine

Annals of Statistics

Volumn 29, Issue 5, 2001, Pages 1189-1232

  Friedman, Jerome H ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Boosting; Decision trees; Function estimation; Robust nonparametric regression

Indexed keywords

EID: 0035470889     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/aos/1013203451     Document Type: Article

References (22)

1. BECKER, R. A. and CLEVELAND, W. S (1996). The design and control of Trellis display. J. Comput. Statist. Graphics 5 123-155.
2. BREIMAN, L. (1997). Pasting bites together for prediction in large data sets and on-line. Technical report, Dept. Statistics, Univ. California, Berkeley.
3. BREIMAN, L. (1999). Prediction games and arcing algorithms. Neural Comp. 11 1493-1517.
4. BREIMAN, L., FRIEDMAN, J. H., OLSHEN, R. and STONE. C. (1983). Classification and Regression Trees. Wadsworth, Belmont, CA.
5. COPAS, J. B. (1983). Regression, prediction, and shrinkage (with discussion). J. Roy. Statist. Soc. Ser. B 45 311-354.
6. DONOHO, D. L. (1993). Nonlinear wavelete methods for recovery of signals, densities, and spectra from indirect and noisy data. In Different Perspectives on Wavelets. Proceedings of Symposium in Applied Mathematics (I. Daubechies, ed.) 47 173-205. Amer. Math. Soc., Providence RI.
7. DRUCKER, H. (1997). Improving regressors using boosting techniques. Proceedings of Fourteenth International Conference on Machine Learning (D. Fisher, Jr., ed.) 107-115. Morgan-Kaufmann, San Francisco.
8. DUFFY, N. and HELMBOLD, D. (1999). A geometric approach to leveraging weak learners. In Computational Learning Theory. Proceedings of 4th European Conference EuroCOLT99 (P. Fischer and H. U. Simon, eds.) 18-33. Springer, New York.
9. FREUND, Y. and SCHAPIRE, R. (1996). Experiments with a new boosting algorithm. In Machine Learning: Proceedings of the Thirteenth International Conference 148-156. Morgan Kaufman, San Francisco.
10. FRIEDMAN, J. H. (1991). Multivariate adaptive regression splines (with discussion). Ann. Statist. 19 1-141.
11. FRIEDMAN J. H., HASTIE, T. and TIBSHIRANI, R. (2000). Additive logistic regression: a statistical view of boosting (with discussion). Ann. Statist. 28 337-407.
12. GRIFFIN, W. L., FISHER, N. I., FRIEDMAN J. H., RYAN, C. G. and O'REILLY, S. (1999). Cr-Pyrope garnets in lithospheric mantle. J. Petrology. 40 679-704.
13. HASTIE, T. and TIBSHIRANI, R. (1990). Generalized Additive Models. Chapman and Hall, London.
14. HUBER, P. (1964). Robust estimation of a location parameter. Ann. Math. Statist. 35 73-101.
15. MALLAT, S. and ZHANG, Z. (1993). Matching pursuits with time frequency dictionaries. IEEE Trans. Signal Processing 41 3397-3415.
16. POWELL, M. J. D. (1987). Radial basis functions for multivariate interpolation: a review. In Algorithms for Approximation (J. C. Mason and M. G. Cox, eds.) 143-167. Clarendon Press, Oxford.
17. RATSCH, G., ONODA, T. and MULLER, K. R. (1998). Soft margins for AdaBoost. NeuroCOLT Technical Report NC-TR-98-021.
18. RIPLEY, B. D. (1996). Pattern Recognition and Neural Networks. Cambridge Univ. Press.
19. RUMELHART, D. E., HINTON, G. E. and WILLIAMS, R. J. (1986). Learning representations by back-propagating errors. Nature 323 533-536.
20. SCHAPIRE, R. and SINGER, Y. (1998). Improved boosting algorithms using confidence-rated predictions. In Proceedings of the Eleventh Annual Conference on Computational Learning Theory. ACM, New York.
21. VAPNIK, V. N. (1995). The Nature of Statistical Learning Theory. Springer, New York.
22. WARNER, J. R., TORONTO, A. E., VEASEY, L. R. and STEPHENSON, R. (1961). A mathematical model for medical diagnosis - application to congenital heart disease. J. Amer. Med. Assoc. 177 177-184.