Predictive Cross-validation for the Choice of Linear Mixed-Effects Models with Application to Data from the Swiss HIV Cohort Study

Biometrics

Volumn 68, Issue 1, 2012, Pages 53-61

  Braun, Julia ^a   Held, Leonhard ^a   Ledergerber, Bruno ^b  

^a UNIVERSITY OF ZURICH   (Switzerland)

^b UNIVERSITY HOSPITAL ZURICH   (Switzerland)

Author keywords

Cross validation; Linear mixed effects model; Predictive model choice; Proper scoring rules; Serial correlation

Indexed keywords

BIOMETRICS;

AKAIKE'S INFORMATION CRITERIONS; COHORT STUDIES; CROSS VALIDATION; LINEAR MIXED-EFFECTS MODEL; LONGITUDINAL DATA; MODEL CHOICE; PREDICTIVE MODEL CHOICE; PREDICTIVE MODELS; PROPER SCORING RULES; SERIAL CORRELATION;

RANDOM PROCESSES;

AKAIKE INFORMATION CRITERION; BIOMETRY; COHORT ANALYSIS; DATA SET; HUMAN IMMUNODEFICIENCY VIRUS; MODEL VALIDATION; NUMERICAL MODEL; PREDICTION;

SWITZERLAND;

HUMAN IMMUNODEFICIENCY VIRUS;

EID: 84858860574     PISSN: 0006341X     EISSN: 15410420     Source Type: Journal    
DOI: 10.1111/j.1541-0420.2011.01621.x     Document Type: Article

References (36)

1. Akaike, H. (1973). Information theory and extension of the maximum likelihood principle. In International Symposium on Information Theory, B. N. Petrov and F. Csaki (eds), pp. 267-281. Budapest, Hungary: Akademia Kiado.
2. Brier, G. W. (1950). Verification of forecasts expressed in terms of probability. Monthly Weather Review 78, 1-3.
3. Claeskens, G. and Hjort, N. (2008). Model Selection and Model Averaging. Cambridge, U.K.: Cambridge University Press.
4. Dawid, A. P. (1984). Statistical theory: The prequential approach. Journal of the Royal Statistical Society, Series A 147, 278-292.
5. Diggle, P. J., Heagerty, P., Liang, K. Y., and Zeger, S. L. (2002). Analysis of Longitudinal Data, 2nd edition. Oxford: Oxford University Press.
6. Geisser, S. and Eddy, W. (1979). A predictive approach to model selection. Journal of the American Statistical Association 74, 153-160.
7. Gneiting, T. and Raftery, A. E. (2007). Strictly proper scoring rules, prediction and estimation. Journal of the American Statistical Association 102, 359-378.
8. Gneiting, T., Balabdaoui, F., and Raftery, A. E. (2007). Probabilistic forecasts, calibration and sharpness. Journal of the Royal Statistical Society, Series B 69, 243-268.
9. Greven, S. and Kneib, T. (2010). On the behavior of marginal and conditional AIC in linear mixed models. Biometrika 97, 773-789.
10. Hastie, T. and Tibshirani, R. (1990). Generalized Additive Models. London: Chapman & Hall.
11. Held, L., Rufibach, K., and Balabdaoui, F. (2010). A score regression approach to assess calibration of continuous probabilistic predictions. Biometrics 66, 1295-1305.
12. Held, L., Schrödle, B., and Rue, H. (2010). Posterior and cross-validatory predictive checks: A comparison of MCMC and INLA. In Statistical Modelling and Regression Structures-Festschrift in Honour of Ludwig Fahrmeir, T. Kneib and G. Tutz (eds), pp. 91-110. Heidelberg, Germany: Physica-Verlag.
13. Herrmann, E. (2000). Variance estimation and bandwidth selection for kernel regression. In Smoothing and Regression: Approaches, Computation, and Application, M. G. Schimek (ed.), pp. 71-107. New-York: John Wiley & Sons.
14. Hersbach, H. (2000). Decomposition of the continuous ranked probability score for ensemble prediction systems. Weather and Forecasting 15, 559-570.
15. Hodges, J. S. and Sargent, D. J. (2001). Counting degrees of freedom in hierarchical and other richly-parameterised models. Biometrika 88, 367-379.
16. Keramidas, E. M. and Lee, J. C. (1990). Forecasting technological substitutions with concurrent short time series. Journal of the American Statistical Association 85, 625-632.
17. Krnjajic, M., Kottas, A., and Draper, D. (2008). Parametric and nonparametric Bayesian model specification: A case study involving models for count data. Journal of Computational Statistics and Data Analysis 52, 2110-2128.
18. Laird, N. M. and Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics 38, 963-974.
19. Lee, J. C. (1988). Prediction and estimation of growth curves with special covariance structures. Journal of the American Statistical Association 83, 432-440.
20. Liang, H., Wu, H., and Zou, G. (2008). A note on conditional AIC for linear mixed-effects models. Biometrika 95, 773-778.
21. Marshall, E. C. and Spiegelhalter, D. J. (2003). Approximate cross-validatory predictive checks in disease mapping models. Statistics in Medicine 22, 1649-1660.
22. Pauler, D. (1998). The Schwarz criterion and related methods for normal linear models. Biometrika 85, 13-27.
23. Pauler, D., Wakefield, J., and Kass, R. (1999). Bayes factors and approximations for variance component models. Journal of the American Statistical Association 94, 1242-1253.
24. Pawitan, Y. (2001). In All Likelihood-Statistical Modelling and Inference Using Likelihood. Oxford: Oxford University Press.
25. Pinheiro, J. and Bates, D. (2004). Mixed-Effects Models in S and S-PLUS. New York: Springer.
26. Pu, W. and Niu, X. F. (2006). Selecting mixed-effects models based on a generalized information criterion. Journal of Multivariate Analysis 97, 733-758.
27. Riebler, A. and Held, L. (2010). The analysis of heterogeneous time trends in multivariate age-period-cohort models. Biostatistics 11, 57-69.
28. Stone, M. (1977). An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion. Journal of the Royal Statistical Society, Series B 39, 44-47.
29. Taylor, J. M. G. and Law, N. (1998). Does the covariance structure matter in longitudinal modelling for the prediction of future CD4 counts Statistics in Medicine 17, 2381-2394.
30. Vaida, F. and Blanchard, S. (2005). Conditional Akaike information for mixed-effects models. Biometrika 92, 351-370.
31. van der Linde, A. (1994). On cross-validation for smoothing splines in the case of dependent observations. Australian and New Zealand Journal of Statistics 36, 67-73.
32. Verbeke, G. and Molenberghs, G. (1997). Linear Mixed Models in Practice. New York: Springer.
33. Verbeke, G. and Molenberghs, G. (2000). Linear Mixed Models for Longitudinal Data. New York: Springer.
34. Wang, J. and Schaalje, G. B. (2009). Model selection for linear mixed models using predictive criteria. Communications in Statistics---Simulation and Computation 38, 788-801.
35. Winkler, R. (1996). Scoring rules and the evaluation of probabilities. Test 5, 1-60.
36. Wolbers, M., Battegay, M., Hirschel, B., Furrer, H., Cavassini, M. B. H., Vernazza, P. L., Bernasconi, E., Kaufmann, G., Bucher, H. C., and the Swiss HIV Cohort Study. (2007). CD4+ T-cell count increase in HIV-1-infected patients with suppressed viral load within 1 year after start of antiretroviral therapy. Antiviral Therapy 12, 889-897.