The solution path of the generalized lasso

Annals of Statistics

Volumn 39, Issue 3, 2011, Pages 1335-1371

  Tibshirani, R J ^a   Taylor, J ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Degrees of freedom; Lagrange dual; Lars; Lasso; Path algorithm

Indexed keywords

EID: 79954994522     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/11-AOS878     Document Type: Article

References (35)

1. BECKER, S., BOBIN, J. and CANDES, E. J. (2011). NESTA: A fast and accurate first-order method for sparse recovery. SIAM Journal on Imaging Sciences 4 1-39.
2. BERTSEKAS, D. P. (1999). Nonlinear Programming. Athena Scientific, Nashua, NH.
3. BEST, M. J. (1982). An algorithm for the solution of the parametric quadratic programming problem. CORR Report 82-84, Univ. Waterloo.
4. BOYD, S. and VANDENBERGHE, L. (2004). Convex Optimization. Cambridge Univ. Press, Cambridge. MR2061575
5. BREDEL, M., BREDEL, C., JURIC, D., HARSH, G. R., VOGEL, H., RECHT, L. D. and SIKIC, B. I. (2005). High-resolution genome-wide mapping of genetic alterations in human glial brain tumors. Cancer Res. 65 4088-4096. (Pubitemid 40775645)
6. CENTERS FOR DISEASE CONTROL AND PREVENTION. (2009). "Novel H1N1 flu situation update." Available at .
7. CHEN, S. S.,DONOHO, D. L. and SAUNDERS, M. A. (1998). Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20 33-61. MR1639094 (Pubitemid 128689501)
8. CLEVELAND, W., GROSSE, E., SHYU, W. and TERPENNING, I. (1991). Local regression models. In Statistical Models in S (J. Chambers and T. Hastie, eds.).Wadsworth, Belmont, CA.
9. DONOHO, D. L. and JOHNSTONE, I. M. (1995). Adapting to unknown smoothness via wavelet shrinkage. J. Amer. Statist. Assoc. 90 1200-1224. MR1379464 (Pubitemid 126093135)
10. DONOHO, D. L. and TANNER, J. (2010). Counting the faces of randomly-projected hypercubes and orthants, with applications. Discrete Comput. Geom. 43 522-541. MR2587835
11. EFRON, B., HASTIE, T., JOHNSTONE, I. and TIBSHIRANI, R. (2004). Least angle regression. Ann. Statist. 32 407-499. MR2060166 (Pubitemid 41250302)
12. ELAD, M., MILANFAR, P. and RUBINSTEIN, R. (2007). Analysis versus synthesis in signal priors. Inverse Problems 23 947-968. MR2329926 (Pubitemid 46838835)
13. EVANS, L. C. and GARIEPY, R. F. (1992). Measure Theory and Fine Properties of Functions. CRC Press, Boca Raton, FL. MR1158660
14. FRIEDMAN, J., HASTIE, T., HÖFLING, H. and TIBSHIRANI, R. (2007). Pathwise coordinate optimization. Ann. Appl. Statist. 1 302-332. MR2415737
15. GOLUB, G. H. and VAN LOAN, C. F. (1996). Matrix Computations, 3rd ed. Johns Hopkins Univ. Press, Baltimore, MD. MR1417720
16. HASTIE, T., ROSSET, S., TIBSHIRANI, R. and ZHU, J. (2003/04). The entire regularization path for the support vector machine. J. Mach. Learn. Res. 5 1391-1415 (electronic). MR2248021
17. HASTIE, T. and TIBSHIRANI, R. (1990). Generalized Additive Models. Monographs on Statistics and Applied Probability 43. Chapman & Hall, London. MR1082147
18. HASTIE, T. and TIBSHIRANI, R. (1993). Varying-coefficient models. J. Roy. Statist. Soc. Ser. B 55 757-796. MR1229881
19. HOEFLING, H. (2009). A path algorithm for the fused lasso signal approximator. Unpublished manuscript. Available at .
20. JAMES, G.M.,RADCHENKO, P. and LV, J. (2009). DASSO: Connections between the Dantzig selector and lasso. J. R. Stat. Soc. Ser. B Stat. Methodol. 71 127-142. MR2655526
21. KIM, S.-J., KOH, K., BOYD, S. and GORINEVSKY, D. (2009). Trend filtering. SIAM Rev. 51 339-360. MR2505584
22. OSBORNE, M. R., PRESNELL, B. and URLACH, B. A. (2000). On the LASSO and its dual. J. Comput. Graph. Statist. 9 319-337. MR1822089
23. R DEVELOPMENT CORE TEAM (2008). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. Available at http://www.R-project.org.
24. ROSSET, S. and ZHU, J. (2007). Piecewise linear regularized solution paths. Ann. Statist. 35 1012-1030. MR2341696
25. RUDIN, L. I., OSHER, S. and FATERNI, E. (1992). Nonlinear total variation based noise removal algorithms. Phys. D 60 259-268.
26. SCHNEIDER, R. (1993). Convex Bodies: The Brunn-Minkowski Theory. Encyclopedia of Mathematics and Its Applications 44. Cambridge Univ. Press, Cambridge. MR1216521
27. SHE, Y. (2010). Sparse regression with exact clustering. Electron. J. Stat. 4 1055-1096. MR2727453
28. SHE, Y. and OWEN, A. B. (2010). Outlier detection using nonconvex penalized regression. Unpublished manuscript. Available at http://www-stat. stanford.edu/~owen/reports/theta-ipod.pdf.
29. STEIN, C. M. (1981). Estimation of the mean of a multivariate normal distribution. Ann. Statist. 9 1135-1151. MR0630098
30. TIBSHIRANI, R. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 267-288. MR1379242
31. TIBSHIRANI, R., SAUNDERS, M., ROSSET, S., ZHU, J. and KNIGHT, K. (2005). Sparsity and smoothness via the fused lasso. J. R. Stat. Soc. Ser. B Stat. Methodol. 67 91-108. MR2136641 (Pubitemid 40167043)
32. TIBSHIRANI, R. J. and TAYLOR, J. (2011). Supplement to "The solution path of the generalized lasso" DOI:10.1214/11-AOS878SUPP.
33. TSENG, P. (2001). Convergence of a block coordinate descent method for nondifferentiable minimization. J. Optim. Theory Appl. 109 475-494. MR1835069
34. ZOU, H. and HASTIE, T. (2005). Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B Stat. Methodol. 67 301-320. MR2137327 (Pubitemid 40465877)
35. ZOU, H., HASTIE, T. and TIBSHIRANI, R. (2007). On the "degrees of freedom" of the lasso. Ann. Statist. 35 2173-2192. MR2363967