An iterative algorithm for fitting nonconvex penalized generalized linear models with grouped predictors

Computational Statistics and Data Analysis

Volumn 56, Issue 10, 2012, Pages 2976-2990

  She, Yiyuan ^a  

^a FLORIDA STATE UNIVERSITY   (United States)

Author keywords

Gene selection; Generalized linear models; Group LASSO; Nonconvex penalties; Spectral analysis

Indexed keywords

CANCER CLASSIFICATION; COLLINEARITY; GAUSSIAN MODEL; GENE SELECTION; GENERALIZED LINEAR MODEL; GROUP LASSO; HIGH DIMENSIONAL DATA; HIGH-DIMENSIONAL; ITERATIVE ALGORITHM; NONCONVEX; PARAMETER-TUNING; PENALIZED ESTIMATION; PERFORMANCE IMPROVEMENTS; SPECTRUM ESTIMATION; STATISTICAL LEARNING; SUPER RESOLUTION; THEORETICAL RESULT;

ALGORITHMS; BIOINFORMATICS; GENES; SIGNAL PROCESSING; SPECTRUM ANALYSIS;

COMPUTER AIDED DIAGNOSIS;

EID: 84861493991     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2011.11.013     Document Type: Article

References (32)

1. A. Agresti Categorical Data Analysis second ed. Wiley Series in Probability and Statistics 2002 Wiley-Interscience
2. A. Antoniadis Wavelet methods in statistics: Some recent developments and their applications Statistics Surveys 1 2007 16 55
3. F. Bunea, and A. Barbu Dimension reduction and variable selection in case control studies via regularized likelihood optimization Electronic Journal of Statistics 3 2009 1257 1287
4. E.J. Candes, and T. Tao Decoding by linear programming IEEE Transactions on Information Theory 51 12 2005 4203 4215
5. J. Chen, and Z. Chen Extended Bayesian information criterion for model selection with large model space Biometrika 95 2008 759 771
6. S. Chen, D. Donoho, and M. Saunders Atomic decomposition by basis pursuit SIAM Journal of Scientific Computing 20 1 1998 33 61
7. S. Chiaretti, X. Li, R. Gentleman, A. Vitale, M. Vignetti, F. Mandelli, J. Ritz, and R. Foa Gene expression profile of adult t-cell acute lymphocytic leukemia identifies distinct subsets of patients with different response to therapy and survival Blood 103 7 2004 2771 2778
8. I. Daubechies, M. Defrise, and C. De Mol An iterative thresholding algorithm for linear inverse problems with a sparsity constraint Communications on Pure and Applied Mathematics 57 2004 1413 1457
9. B. Efron Empirical Bayes estimates for large-scale prediction problems Journal of the American Statistical Association 104 2009 1015 1028
10. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani Least angle regression Annals of Statistics 32 2004 407 499
11. J. Fan, and R. Li Variable selection via nonconcave penalized likelihood and its oracle properties Journal of the American Statistical Association 96 2001 1348 1360
12. J. Fan, and J. Lv Sure independence screening for ultrahigh dimensional feature space Journal of the Royal Statistical Society: Series B 70 5 2008 849 911
13. J. Friedman, T. Hastie, H. Hofling, and R. Tibshirani Pathwise coordinate optimization Annals of Applied Statistics 1 2007 302 332
14. Friedman, J., Hastie, T., Tibshirani, R., 2010a. A note on the group lasso and a sparse group lasso. arXiv:1001.0736v1.
15. J. Friedman, T. Hastie, and R. Tibshirani Regularized paths for generalized linear models via coordinate descent Journal of Statistical Software 33 1 2010
16. H.-Y. Gao, and A.G. Bruce Waveshrink with firm shrinkage Statistica Sinica 7 4 1997 855 874
17. G. Gasso, A. Rakotomamonjy, and S. Canu Recovering sparse signals with a certain family of nonconvex penalties and DC programming IEEE Transactions on Signal Processing 57 12 2009 4686 4698
18. D. Geman, and G. Reynolds Constrained restoration and the recovery of discontinuities Pattern Analysis and Machine Intelligence, IEEE 14 3 1992 367 383
19. C. Leng, Y. Lin, and G. Wahba A note on the lasso and related procedures in model selection Statistics Sinica 16 4 2006 1273 1284
20. D. Scholtens, and A. von Heydebreck Analysis of differential gene expression studies R. Gentleman, V. Carey, W. Huber, R. Irizarry, S. Dudoit, Bioinformatics and Computational Biology Solutions Using R and Bioconductor 2005 Springer 229 248
21. Y. She Thresholding-based iterative selection procedures for model selection and shrinkage Electronic Journal of Statistics 3 2009 384 415
22. Y. She Sparse regression with exact clustering Electronic Journal of Statistics 4 2010 1055 1096
23. Y. She, and A.B. Owen Outlier detection using nonconvex penalized regression Journal of the American Statistical Association 106 494 2011 626 639
24. R. Tibshirani Regression shrinkage and selection via the lasso Journal of the Royal Statistical Society: Series B 58 1996 267 288
25. R. Tibshirani, T. Hastie, B. Narashiman, and G. Chu Diagnosis of multiple cancer types by shrunken centroids of gene expression Proceedings of the National Academy of Sciences United States of America 99 2002 6567 6572
26. M. Yuan, and Y. Lin Model selection and estimation in regression with grouped variables Journal of the Royal Statistical Society: Series B 68 2006 49 67
27. T. Zhang Some sharp performance bounds for least squares regression with l1 regularization Annals of Statistics 37 2009 2109 2144
28. C.-H. Zhang Nearly unbiased variable selection under minimax concave penalty Annals of Statistics 38 2 2010 894 942
29. C.-H. Zhang, and J. Huang The sparsity and bias of the Lasso selection in high-dimensional linear regression Annals of Statistics 36 2008 1567 1594
30. P. Zhao, and B. Yu On model selection consistency of lasso Journal of Machine Learning Research 7 2006 2541 2563
31. H. Zou, and T. Hastie Regularization and variable selection via the elastic net Journal of the Royal Statistical Society: Series B 67 2 2005 301 320
32. H. Zou, and R. Li One-step sparse estimates in nonconcave penalized likelihood models Annals of Statistics 36 4 2008 1509 1533