Efficient global approximation of generalized nonlinear ℓ1 -Regularized solution paths and its applications

Journal of the American Statistical Association

Volumn 104, Issue 488, 2009, Pages 1562-1574

  Yuan, Ming ^a   Zou, Hui ^b  

^a Georgia Institute of Technology   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

1 regularization; LARS; LASSO; Solution path; Support vector pursuit

Indexed keywords

EID: 74049139014     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2009.tm08287     Document Type: Article

References (25)

1. DeVore, R., and Lorentz, G. (1993), Constructive Approximation,New York: Springer.
2. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), "Least Angle Regression," The Annals of Statistics, 32, 407-499.
3. Fan, J., and Li, R. (2001), "Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties," Journal of the American Statistical Association, 96, 1348-1360.
4. - (2006), "Statistical Challenges With High Dimensionality: Feature Selection in Knowledge Discovery," in Proceedings of the International Congress of Mathematicians, Vol. III, eds. M. Sanz-Sole, J. Soria, J. L. Varona, and J. Verdera, Zurich: European Mathematical Society, pp. 595-622.
5. Friedman, J., Hastie, T., and Tibshirani, R. (2008), "Regularization Paths for Generalized Linear Models via Coordinate Descent," technical report, Stanford University, Dept. of Statistics.
6. Golub, T., Slonim, D., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J., Coller, H., Loh, M., Downing, J., Caligiuri, M., Bloomfield, C., and Lander, E. (1999), "Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring," Science, 286, 531-537.
7. Gorman, R. P., and Sejnowski, T. J. (1988), "Analysis of Hidden Units in a Layered Network Trained to Classify Sonar Targets," Neural Networks,1, 75-89.
8. Hastie, T., Rosset, S., Tibshirani, R., and Zhu, J. (2005), "The Entire Regular- ization Path for the Support Vector Machine," Journal of Machine Learning Research, 5, 1391-1415.
9. Hastie, T., Tibshirani, R., and Friedman, J. (2001), The Elements of Statistical Learning: Data Mining, Inference and Prediction, New York: Springer- Verlag.
10. 1-Norm Quantile Regression," Journal of Computational and Graphical Statistics, 17, 163-185.
11. Lin, X., Wahba, G., Xiang, D., Gao, F., Klein, R., and Klein, B. (2000), "Smoothing Spline ANOVA Models for Large Data Sets With Bernoulli Observations and the Randomized GACV," The Annals of Statistics, 28, 1570-1600.
12. Osborne, M., Presnell, B., and Turlach, B. (2000), "A New Approach to Variable Selection in Least Squares Problems," IMA Journal of Numerical Analysis, 20, 389-403.
13. 1 Regularization Path Algorithm for Generalized Linear Models," Journal of the Royal Statistical Society, Ser. B, 69, 659-677.
14. Rosset, S. (2005), "Following Curved Regularized Optimization Solution Paths," in Advances in Neural Information Processing Systems, Vol. 17, Cambridge, MA: MIT Press.
15. Rosset, S., and Zhu, J. (2007), "Piecewise Linear Regularized Solution Paths," The Annals of Statistics, 35, 1012-1030.
16. Tibshirani, R. (1996), "Regression Shrinkage and Selection via the Lasso," Journal of the Royal Statistical Society, Ser. B, 58, 267-288.
17. Wahba, G. (1990), Spline Models for Observational Data, Philadelphia: SIAM.
18. Williams, C., and Seeger, M. (2001), "Using the Nyström Method to Speed up Kernel Machines," Advances in Neural Information Processing Systems, Vol. 13, Cambridge, MA: MIT Press.
19. Yao, Y., and Lee, Y. (2007), "Another Look at Linear Programming for Feature Selection via Methods of Regularization," Technical Report 800, The Ohio State University, Dept. of Statistics.
20. Zhang, H., Wahba, G., Lin, Y., Voelker, M., Ferris, M., Klein, R., and Klein, B. (2004), "Variable Selection and Model Building via Likelihood Basis Pursuit," Journal of the American Statistical Association, 99, 659-672.
21. Zhao, P., and Yu, B. (2007), "Stagewise Lasso," Journal of Machine Learning Research, 8, 2701-2726.
22. Zhu, J., and Hastie, T. (2002), "Kernel Logistic Regression and the Import Vector Machine," in Advances in Neural Information Processing Systems, Vol. 14, Cambridge, MA: MIT Press.
23. Zhu, J., Rosset, S., Hastie, T., and Tibshirani, R. (2003), "1-Norm Support Vector Machines," in Advances in Neural Information Processing Systems, Vol. 16, Cambridge, MA: MIT Press.
24. Zou, H., and Hastie, T. (2005), "Regression and Variable Election via the Elastic Net," Journal of the Royal Statistical Society, Ser. B, 67, 301-320.
25. Zou, H., and Li, R. (2008), "One-Step Sparse Estimates in Nonconcave Penalized Likelihood Models," The Annals of Statistics, 36, 1509-1533.