Estimation for High-Dimensional Linear Mixed-Effects Models Using ℓ1-Penalization

Scandinavian Journal of Statistics

Volumn 38, Issue 2, 2011, Pages 197-214

  Schelldorfer, Jürg ^a   Bühlmann, Peter ^a   De Geer, Sara Van ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Adaptive Lasso; Coordinate gradient descent; Coordinatewise optimization; Lasso; Random effects model; Variable selection; Variance components

Indexed keywords

EID: 79954986664     PISSN: 03036898     EISSN: 14679469     Source Type: Journal    
DOI: 10.1111/j.1467-9469.2011.00740.x     Document Type: Article

References (33)

1. Bickel, P., Ritov, Y. & Tsybakov, A. (2009). Simultaneous analysis of lasso and dantzig selector. Ann. Statist. 37, 1705-1732.
2. Bondell, H. D., Krishna, A. & Gosh, S. K. (2010). Joint variable selection of fixed and random effects in linear mixed-effects models. Biometrics 66, 1069-1077.
3. Bühlmann, P. & van de Geer, S. (2011). Statistics for high-dimensional data: methods theory and applications. Springer-Verlag, New York, Dordrecht, Heidelberg, London.
4. Bunea, F., Tsybakov, A. & Wegkamp, M. (2007). Sparsity oracle inequalities for the lasso. Electron. J. Statist. 1, 169-194.
5. Candes, E. & Tao, T. (2007). The Dantzig selector: statistical estimation when p is much larger than n. Ann. Statist., 35, 2313-2351.
6. Demidenko, E. (2004). Mixed models, theory and applications. Wiley, Hoboken, New Jersey.
7. Efron, B., Hastie, T., Johnstone, I. & Tibshirani, R. (2004). Least angle regression. Ann. Statist. 32, 407-499.
8. Friedman, J., Hastie, T. & Tibshirani, R. (2010). Regularization paths for generalized linear models via coordinate descent. J. Statist. Softw. 33, 1-22.
9. van de Geer, S. (2008). High-dimensional generalized linear models and the lasso. Ann. Statist. 36, 614-645.
10. van de Geer, S. & Bühlmann, P. (2009). On the conditions used to prove oracle results for the lasso. Electron. J. Stat. 3, 1360-1392.
11. van de Geer, S., Bühlmann, P. & Zhou, S. (2010). The adaptive and the thresholded lasso for potentially misspecified models. Preprint arXiv:1001.5176v3.
12. Greenshtein, E. & Ritov, Y. (2004). Persistence in high-dimensional linear predictor selection and the virtue of overparametrization. Bernoulli 10, 971-988.
13. Huang, J., Ma, S. & Zhang, C.-H. (2008). Adaptive lasso for sparse high-dimensional regression models. Statist. Sinica 18, 1603-1618.
14. Ibrahim, J. G., Zhu, H., Garcia, R. I. & Guo, R. (2010). Fixed and random effects selection in mixed effects models. Biometrics, no. doi: 10.1111/j.1541-0420.2010.01463.x.
15. Laird, N. M. & Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics 83, 1014-1022.
16. Meier, L., van de Geer, S. & Bühlmann, P. (2008). The group lasso for logistic regression. J. Roy. Statist. Soc. Ser. B Statist. Methodol. 70, 53-71.
17. Meinshausen, N. & Bühlmann, P. (2006). High-dimensional graphs and variable selection with the lasso. Ann. Statist. 34, 1436-1462.
18. Meinshausen, N. & Yu, B. (2009). Lasso-type recovery of sparse representations for high-dimensional data. Ann. Statist., 37, 246-270.
19. Meinshausen, N. & Bühlmann, P. (2010). Stability selection (with discussion). J. Roy. Statist. Soc. Ser. B Statist. Methodol. 72, 417-473.
20. Meinshausen, N., Meier, L. & Bühlmann, P. (2009). p-values for high-dimensional regression. J. Amer. Statist. Assoc. 104, 1671-1681.
21. Ni, X., Zhang, D. & Zhang, H. H. (2010). Variable selection for semiparametric mixed models in longitudinal studies. Biometrics 66, 79-88.
22. Osborne, M. R., Presnell, B. & Turlach, B. (2000). A new approach to variable selection in least squares problems. IMA J. Numer. Anal. 20, 389-403.
23. Pinheiro, J. C. & Bates, D. M. (2000). Mixed-effects models in S and S-plus. Springer-Verlag, New York.
24. 1-penalization for mixture regression models (with discussion). TEST 19, 209-285.
25. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B Statist. Methodol. 58, 267-288.
26. Tseng, P. & Yun, S. (2009). A coordinate gradient descent method for nonsmooth separable minimization. Math. Program. 117, 387-423.
27. Verbeke, G. & Molenberghs, G. (2000). Linear mixed models for longitudinal data. Springer-Verlag, New York.
28. Wasserman, L. & Roeder, K. (2009). High-dimensional variable selection. Ann. Statist. 37, 2178-2201.
29. Wu, T. & Lange, K. (2008). Coordinate descent algorithms for lasso penalized regression. Ann. Appl. Stat. 2, 224-244.
30. Zhang, C.-H. & Huang, J. (2008). The sparsity and bias of the lasso selection in high-dimensional linear regression. Ann. Statist. 36, 1567-1594.
31. Zhao, P. & Yu, B. (2006). On model selection consistency of lasso. J. Mach. Learn. Res. 7, 2541-2563.
32. Zou, H. (2006). The adaptive lasso and its oracle properties. J. Amer. Statist. Assoc. 101, 1418-1429.
33. Zou, H., Hastie, T. & Tibshirani, R. (2007). On the ''degrees of freedom'' of the lasso. Ann. Statist. 35, 2173-2192.