Joint Variable Selection for Fixed and Random Effects in Linear Mixed-Effects Models

Biometrics

Volumn 66, Issue 4, 2010, Pages 1069-1077

  Bondell, Howard D ^a   Krishna, Arun ^a   Ghosh, Sujit K ^a  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

Adaptive LASSO; Constrained EM algorithm; Linear mixed model; Modified Cholesky decomposition; Penalized likelihood; Variable selection

Indexed keywords

IMAGE SEGMENTATION; MAXIMUM PRINCIPLE; REGRESSION ANALYSIS;

ADAPTIVE LASSO; CHOLESKY DECOMPOSITION; CONSTRAINED EM ALGORITHM; EM ALGORITHMS; FIXED EFFECTS; LINEAR MIXED MODELS; MODIFIED CHOLESKY DECOMPOSITION; PENALIZED LIKELIHOOD; PENALIZED-LIKELIHOOD; VARIABLES SELECTIONS;

RANDOM PROCESSES;

ALGORITHM; LINEARITY; NUMERICAL MODEL; RANDOM WALK METHOD;

EID: 78650073483     PISSN: 0006341X     EISSN: 15410420     Source Type: Journal    
DOI: 10.1111/j.1541-0420.2010.01391.x     Document Type: Article

References (36)

1. Akaike, H. (1973). Information theory and an extension of maximum likelihood principle. In Second International Symposium on Information Theory, B. N. Petrov and F. Csaki (eds), Budapest Akademiai Kiado.
2. Bondell, H. D. and Reich, B. J. (2008). Simultaneous regression shrinkage, variable selection, and supervised clustering of predictors with OSCAR. Biometrics 64, 115-123.
3. Breiman, L. (1996). Heuristics of instability and stabilization in model selection. Annals of Statistics 24, 2350-2383.
4. Chen, Z. and Dunson, D., B. (2003). Random effects selection in linear mixed models. Biometrics 59, 762-769.
5. Diggle, P., Liang, K., and Zeger, S. (1994). Analysis of Longitudinal Data. New York Oxford University Press.
6. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004). Least angle regression. Annals of Statistics 32, 407-499.
7. Fan, J. and Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96, 1348-1360.
8. Ghosh, S. K., Bhave, P. V., Davis, J. M., and Lee, H. (2010). Spatio-temporal analysis of total nitrate concentrations using dynamic statistical models. To appear in Journal of the American Statistical Association.
9. Hannan, E. J. and Quinn, B. G. (1979). The determination of the order of an autoregression. Journal of the Royal Statistical Society, Series B 41, 190-195.
10. Jiang, J. and Rao, J. S. (2003). Consistent procedures for mixed linear model selection. Sankhya A 65, 23-42.
11. Jiang, J., Rao, J. S., Gu, Z., and Nguyen, T. (2008). Fence methods for mixed models selection. Annals of Statistics 36, 1669-1692.
12. Kinney, S. K. and Dunson, D. B. (2007). Fixed and random effects selection in linear and logistic models. Biometrics 63, 690-698.
13. Kullback, S. and Leibler, R. A. (1951). On information and sufficiency. Annals of Mathematical Statistics 22, 72-86.
14. Laird, N. M. and Ware, J. L. (1982). Random-effects models for longitudinal data. Biometrics 38, 963-974.
15. Laird, N. M., Lange, N., and Stram, D. (1987). Maximum likelihood computations with repeated measures: Application of the EM algorithm. Journal of the American Statistical Association 82, 97-105.
16. Lange, N. and Laird, N. M. (1989). The effect of covariance structures on variance estimation in balance growth-curve models with random parameters. Journal of the American Statistical Association 84, 241-247.
17. Lee, H. and Ghosh, S. K. (2008). A re-parametrization approach for dynamic space-time models. Journal of Statistical Theory and Practice 2, 1-14.
18. Lindstrom, M. J. and Bates, D. M. (1988). Newton-Raphson and EM algorithms for linear mixed-effects models for repeated measures data. Journal of the American Statistical Association 83, 1014-1022.
19. Malm, W. C., Schichtel, B. A., Pitchford, M. L., Ashbaugh, L. L., and Eldred, R. A. (2004). Spatial and monthly trends in speciated fine particle concentration in the United States. Journal of Geophysical Research 109, D03306, doi:
20. Miller, A. (2002). Subset Selection in Regression, 2nd edition. Boca Raton, Florida Chapman & Hall/CRC.
21. Morell, C. H., Pearson, J. D., and Brant, L. J. (1997). Linear transformations of linear mixed-effects models. The American Statistician 51, 338-343.
22. Pauler, D. K. (1998). The Schwarz criterion and related methods for normal linear models. Biometrika 85, 13-27.
23. Pinhiero, J. and Bates, D. (1996). Unconstrained parameterizations for variance-covariance matrices. Statistics and Computing 6, 289-286.
24. Pu, P. and Niu, F. (2006). Selecting mixed-effects models based on generalized information criterion. Journal of Multivariate Analysis 97, 733-758.
25. Rao, C. R. and Wu, Y. (1989). A strongly consistent procedure for model selection in regression problems. Biometrika 76, 369-374.
26. Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics 6, 461-464.
27. Shao, J. (1997). An asymptotic theory for linear model selection. Statistica Sinica 7, 221-264.
28. Smith, M. and Kohn, R. (2002). Parsimonious covariance matrix estimation for longitudinal data. Journal of the American Statistical Association 97, 1141-1153.
29. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B 58, 267-288.
30. Vaida, F. and Blanchard, S. (2005). Conditional Akaike information for mixed-effects models. Biometrika 92, 351-370.
31. Wolfinger, R. D. (1993). Covariance structure selection in general mixed models. Communications in Statistics, Simulation and Computation 22, 1079-1106.
32. Yang, Y. (2005). Can the strengths of AIC and BIC be shared? A conflict between model identification and regression estimation. Biometrika 92, 937-950.
33. Yu, S., Dennis, R., Roselle, S., Nenes, A., Walker, J., Eder, B., Schere, K., Swall, J., and Robarge, W. (2005). An assessment of the ability of three-dimensional air quality models with current thermodynamic equilibrium models to predict aerosol NO-3. Journal of Geophysical Research 110, D07S13, doi:
34. Zou, H. (2006). The adaptive lasso and its oracle properties. Journal of the American Statistical Association 101, 1418-1429.
35. Zou, H. and Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society, Series B 67, 301-320.
36. Zou, H., Hastie, T., and Tibshirani, R. (2007). On the degrees of freedom of the lasso. Annals of Statistics 35, 2173-2192.