Conjugate direction boosting

Journal of Computational and Graphical Statistics

Volumn 15, Issue 2, 2006, Pages 287-311

  Lutz, Roman Werner ^a   Bülmann, Peter ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Forward stepwise variable selection; High dimensional linear regression; L0 and L1 penalization; Least angle regression; Orthogonal greedy algorithm

Indexed keywords

EID: 33745303526     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/106186006X113548     Document Type: Article

References (23)

1. Breiman, L. (1998), "Arcing Classifier (Pkg: p801-849)," The Annals of Statistics, 26, 801-824.
2. _ (1999), "Prediction Games and Arcing Algorithms," Neural Computation, 11, 1493-1517.
3. Breiman, L., and Friedman, J. H. (1985), "Estimating Optimal Transformations for Multiple Regression and Correlation (C/R: p598-619)," Journal of the American Statistical Association, 80, 580-598.
4. Bühlmann, P., and Yu, B. (2003), "Boosting with the L2-Loss: Regression and Classification," Journal of the American Statistical Association, 98, 324-339.
5. _ (2005), "Sparse Boosting," to appear in Journal of Machine Learning Research.
6. Duffy, N., and Helmbold, D. (2000), "Leaveraging for Regression," in Proceedings of the Thirteenth Annual Conference on Computational Learning Theory.
7. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), "Least Angle Regression," The Annals of Statistics, 32, 407-451.
8. Freund, Y. (1995), "Boosting a Weak Learning Algorithm by Majority," Information and Computation, 121, 256-285.
9. Freund, Y., and Schapire, R. E. (1996), "Experiments With a New Boosting Algorithm," in Proceedings of the Thirteenth International Conference on Machine Learning, pp. 148-156.
10. Friedman, J. H. (2001), "Greedy Function Approximation: A Gradient Boosting Machine," The Annals of Statistics, 29, 1189-1232.
11. Golub, T., Slonim, D., Tamayo, P., Huard, C., Gassenbeek, M., Mesirov, J., Coller, H., Loh, M., Downing, J., Caligiuri, M., Bloomfield, C., and Lander, E. (1999), "Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring," Science, 286, 531-537.
12. Mallat, S., and Zhang, Z. (1993), "Matching Pursuits With Time-Frequency Dictionaries," IEEE Transactions on Signal Processing, 41, 3397-3415.
13. Meir, R., and Rätsch, G. (2003), "An Introduction to Boosting and Leveraging," in Advanced Lectures on Machine Learning, eds. S. Mendelson and A. Smola, New York: Springer, pp. 119-184.
14. Miller, A. (2002), Subset Selection in Regression, London: Chapman & Hall.
15. Nocedal, J., and Wright, S. J. (1999), Numerical Optimization, New York: Springer Series in Operations Research.
16. Phatak, A., and de Hoog, F. (2002), "Exploiting the Connection Between PLS, Lanczos Methods and Conjugate Gradients: Alternative Proofs of Some Properties of PLS," Journal of Chemometries, 16, 361-367.
17. Rätsch, G., Demiriz, A., and Bennett, K. (2002), "Sparse Regression Ensembles in Infinite and Finite Hypothesis Spaces," Machine Learning, 48, 193-221.
18. Rätsch, G., Onoda, T., and Müller, K.-R. (2001), "Soft Margins for AdaBoost," Machine Learning, 42, 287-320.
19. Schapire, R. E. (1990), "The Strength of Weak Learnability," Machine Learning, 5, 197-227.
20. Temlyakov, V. (2000), "Weak Greedy Algorithms," Advances in Computational Mathematics, 12, 213-227.
21. Tibshirani, R. (1996), "Regression Shrinkage and Selection Via the Lasso," Journal of the Royal Statistical Society, Series B, 58, 267-288.
22. Zemel, R., and Pitassi, T. (2001), "A Gradient-Based Boosting Algorithm for Regression Problems," in NIPS-13: Advances in Neural Information Processing Systems, 13, Cambridge, MA: MIT Press.
23. Zou, H., and Hastie, T. (2005), "Regularization and Variable Selection via the Elastic Net," Journal of the Royal Statistical Society, Series B, 67, 301-320.