Sparsity with sign-coherent groups of variables via the cooperative-lasso

Annals of Applied Statistics

Volumn 6, Issue 2, 2012, Pages 795-830

  Chiquet, Julien ^a,b   Grandvalet, Yves ^a,b   Charbonnier, Camille ^a,b  

^a UNIVERSITÉ DE TECHNOLOGIE DE COMPIÈGNE   (France)

^b University of Paris 5   (France)

Author keywords

Continuous variables; Grouped variables; Microarray analysis; Ordinal variables; Penalization; Sign coherence; Sparsity

Indexed keywords

EID: 84866235748     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/11-AOAS520     Document Type: Article

References (37)

1. Bach, F. R. (2008). Consistency of the group lasso and multiple kernel learning. J. Mach. Learn. Res. 9 1179-1225. MR2417268
2. Bakin, S. (1999). Adaptive regression and model selection in data mining problems. Ph.D. thesis, Australian National Univ., Canberra.
3. Beck, A. and Teboulle, M. (2009). A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2 183-202. MR2486527
4. Breiman, L. (1995). Better subset regression using the nonnegative garrote. Technometrics 37 373-384. MR1365720
5. Breiman, L. (1996). Heuristics of instability and stabilization in model selection. Ann. Statist. 24 2350-2383. MR1425957
6. Breiman, L., Friedman, J. H., Olshen, R. and Stone, C. J. (1984). Classification and Regression Trees. Wadsworth, Belmont, CA.
7. Chiquet, J., Grandvalet, Y. and Ambroise, C. (2011). Inferring multiple graphical structures. Statistic and Computing 21 537-553.
8. EFRON, B. (2004). The estimation of prediction error: Covariance penalties and cross-validation. J. Amer. Statist. Assoc. 99 619-642. MR2090899
9. Eisen, M. B., Spellman, P. T., Brown, P. O. and Botstein, D. (1998). Cluster analysis and display of genome-wide expression patterns. Proc. Natl. Acad. Sci. USA 95 14863-14868.
10. Foygel, R. and DRTON, M. (2010). Exact block-wise optimization in group lasso for linear regression. Technical report. Available at arXiv:1010.3320.
11. Frank, A. and Asuncion, A. (2010). UCI machine learning repository.
12. Friedman, J., Hastie, T. and TIBSHIRANI, R. (2010). A note on the group Lasso and a sparse group Lasso. Technical report. Available at arXiv:1001.0736.
13. Gertheiss, J. and Tutz, G. (2009). Penalized regression with ordinal predictors. International Statistical Review 77 345-365.
14. Gertheiss, J. and Tutz, G. (2010). Sparse modeling of categorial explanatory variables. Ann. Appl. Stat. 4 2150-2180. MR2829951
15. Grandvalet, Y. and Canu, S. (1999). Outcomes of the equivalence of adaptive ridge with least absolute shrinkage. In Advances in Neural Information Processing Systems 11 (NIPS 1998) 445-451.
16. Hess, K. R., Anderson, K., Symmans, W. F., Valero, V., Ibrahim, N., Mejia, J. A., Booser, D., Theriault, R. L., Buzdar, U., Dempsey, P. J., Rouzier, R., Sneige, N., Ross, J. S., Vidaurre, T., Gómez, H. L., Hortobagyi, G. N. and Pustzai, L. (2006). Pharmacogenomic predictor of sensitivity to preoperative chemotherapy with Paclitaxel and Fluorouracil, Doxorubicin, and Cyclophosphamide in breast cancer. Journal of Clinical Oncology 24, 4236-4244.
17. Hesterberg, T., Choi, N. H., Meier, L. and Fraley, C. (2008). Least angle and l1 penalized regression: A review. Stat. Surv. 2 61-93. MR2520981
18. Huang, J. and Zhang, T. (2010). The benefit of group sparsity. Ann. Statist. 38 1978-2004. MR2676881
19. Jeanmougin, M., Guedj, M. and Ambroise, C. (2011). Defining a robust biological prior from pathway analysis to drive network inference. J. SFdS 152 97-110. MR2821224
20. Knight, K. and Fu, W. (2000). Asymptotics for lasso-type estimators. Ann. Statist. 28 1356-1378.MR1805787
21. Ma, S., Song, X. and Huang, J. (2007). Supervised group Lasso with applications to microarray data analysis. BMC Bioinformatics 8 60.
22. Meier, L., Van De Geer, S. and Bühlmann, P. (2008). The group Lasso for logistic regression. J. R. Stat. Soc. Ser. B Stat. Methodol. 70 53-71. MR2412631
23. Nardi, Y. and Rinaldo, A. (2008). On the asymptotic properties of the group lasso estimator for linear models. Electron. J. Stat. 2 605-633. MR2426104
24. Osborne, M. R., Presnell, B. and Turlach, B. A. (2000). On the LASSO and its dual. J. Comput. Graph. Statist. 9 319-337. MR1822089
25. Park, M. Y., Hastie, T. and Tibshirani, R. (2007). Averaged gene expressions for regression. Biostatistics 8 212-227.
26. Roth, V. and Fischer, B. (2008). The group-Lasso for generalized linear models: Uniqueness of solutions and efficient algorithms. In ICML'08: Proceedings of the 25th International Conference on Machine Learning 848-855.
27. Rufibach, K. (2010). An active set algorithm to estimate parameters in generalized linear models with ordered predictors. Comput. Statist. Data Anal. 54 1442-1456. MR2600846
28. Serlin, R. C. and Levin, J. R. (1985). Teaching how to derive directly interpretable coding schemes for multiple regression analysis. Journal of Educational Statistics 10 223-238.
29. Stein, C. M. (1981). Estimation of the mean of a multivariate normal distribution. Ann. Statist. 9 1135-1151. MR0630098
30. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 267-288. MR1379242
31. Van Der Vaart, A. W. (1998). Asymptotic Statistics. Cambridge Series in Statistical and Probabilistic Mathematics 3. Cambridge Univ. Press, Cambridge. MR1652247
32. Yuan, M. and Lin, Y. (2006).Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. Ser. B Stat. Methodol. 68 49-67. MR2212574
33. Yuan, M. and Lin, Y. (2007). On the non-negative garrote estimator. J. R. Stat. Soc. Ser. B Stat. Methodol. 69 143-161. MR2325269
34. Zhao, P., Rocha, G. and Yu, B. (2009). The composite absolute penalties family for grouped and hierarchical variable selection. Ann. Statist. 37 3468-3497. MR2549566
35. Zhou, H., Sehl, M. E., Sinsheimer, J. S. and LANGE, K. (2010). Association screening of common and rare genetic variants by penalized regression. Bioinformatics 26 2375-2382.
36. Zou, H. and Hastie, T. (2005). Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B Stat. Methodol. 67 301-320. MR2137327
37. Zou, H., Hastie, T. and Tibshirani, R. (2007). On the "degrees of freedom" of the lasso. Ann. Statist. 35 2173-2192. MR2363967