Clustering in linear-mixed models with a group fused lasso penalty

Biometrical Journal

Volumn 56, Issue 1, 2014, Pages 44-68

  Heinzl, Felix ^a   Tutz, Gerhard ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

EM algorithm; Fused lasso; Group lasso; Linear mixed models; Longitudinal data

Indexed keywords

CLUSTERING ALGORITHMS; RANDOM PROCESSES;

CLUSTERINGS; EM ALGORITHMS; FINITE MIXTURES; FUSED LASSOS; GROUP LASSOS; LINEAR MIXED MODELS; LONGITUDINAL DATA; PENALISATION; RANDOM EFFECTS; SIMILAR PATTERN;

NORMAL DISTRIBUTION;

HORMONE;

AIR POLLUTION; ALGORITHM; ANIMAL; ARTICLE; BIOMETRY; CHILD; CLUSTER ANALYSIS; EM ALGORITHM; FEMALE; FUSED LASSO; GROUP LASSO; HUMAN; LINEAR-MIXED MODELS; LONGITUDINAL DATA; LUNG FUNCTION TEST; MALE; METHODOLOGY; RAT; STATISTICAL MODEL;

EM ALGORITHM; FUSED LASSO; GROUP LASSO; LINEAR-MIXED MODELS; LONGITUDINAL DATA;

AIR POLLUTION; ALGORITHMS; ANIMALS; BIOMETRY; CHILD; CLUSTER ANALYSIS; FEMALE; HORMONES; HUMANS; LINEAR MODELS; MALE; RATS; RESPIRATORY FUNCTION TESTS;

EID: 84891488746     PISSN: 03233847     EISSN: 15214036     Source Type: Journal    
DOI: 10.1002/bimj.201200111     Document Type: Article

References (44)

1. Basford, K. E., Greenway, D. R., McLachlan, G. J. and Peel, D. (1997). Standard errors of fitted means under normal mixture models. Computational Statistics 12, 1-17.
2. Bates, D. M., Maechler, M. and Bolker, B. (2012). lme4: Linear mixed-effects models using S4 classes. R package version 0.999999-0.
3. Booth, J. G., Casella, G. and Hobert, J. P. (2008). Clustering using objective functions and stochastic search. Journal of the Royal Statistical Society B70, 119-139.
4. Braun, J., Held, L. and Ledergerber, B. (2012). Predictive cross-validation for the choice of linear mixed-effects models with application to data from the swiss HIV cohort study. Biometrics 68, 53-61.
5. Burkhardt, J. (2008). ASA047: Nelder-Mead Minimization Algorithm. C++ library.
6. Celeux, G., Martin, O. and Lavergne, C. (2005). Mixture of linear mixed models for clustering gene expression profiles from repeated microarray experiments. Statistical Modelling 5, 243-267.
7. De la Cruz-Mesía, R., Quintana, F. A. and Marshall, G. (2008). Model-based clustering for longitudinal data. Computational Statistics & Data Analysis 52, 1441-1457.
8. Dempster, A. P., Laired, N. M. and Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society B39, 1-38.
9. Dockery, D. W., Berkey, C. S., Ware, J. H., Speizer, F. E. and Ferris, B. G. (1983). Distribution of fvc and fev1 in children 6 to 11 years old. American Review of Respiratory Disease 128, 405-412.
10. Efron, B. (1979). Bootstrap methods: another look at the jackknife. The Annals of Statistics 7, 1-26.
11. Efron, B. and Tibshirani, R. (1993). An Introduction to the Bootstrap. Chapman & Hall, New York, NY.
12. Fahrmeir, L., Kneib, T. and Lang, S. (2007). Regression-Modelle, Methoden und Anwendungen. Springer, Berlin, DE.
13. Gaffney, S. J. and Smyth, P. (2003). Curve clustering with random effects regression mixtures. In: C. M. Bishop and B. J. Frey (Eds.), Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics. Key West, FL.
14. Greven, S. and Kneib, T. (2010). On the behaviour of marginal and conditional AIC in linear mixed models. Biometrika 97, 773-789.
15. Heinzl, F. (2012). Clustmixed: clustering in linear and additive mixed models. R package version 1.0.
16. Heinzl, F. and Tutz, G. (2013). Clustering in linear mixed models with approximate Dirichlet process mixtures using EM algorithm. Statistical Modelling 13, 41-67.
17. James, G. M. and Sugar, C. A. (2003). Clustering for sparsely sampled functional data. Journal of the American Statistical Association 98, 397-408.
18. Komárek, A., Hansen, B. E., Kuiper, E. M. M., van Buuren, H. R. and Lesaffre, E. (2010). Discriminant analysis using a multivariate linear mixed model with a normal mixture in the random effects distribution. Statistics in Medicine 29, 3267-3283.
19. Komárek, A. and Komárková, L. (2013). Clustering for multivariate continuous and discrete longitudinal data. The Annals of Applied Statistics 7, 177-200.
20. Komárek, A. and Lesaffre, E. (2008). Generalized linear mixed model with a penalized Gaussian mixture as a random effects distribution. Computational Statistics and Data Analysis 52, 3441-3458.
21. Laird, N. M. and Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics 38, 963-974.
22. Lindley, D. V. and Smith, A. F. M. (1972). Bayes estimates for the linear model. Journal of the Royal Statistical Society B 34, 1-41.
23. Lindstrom, M. J. and Bates, D. M. (1988). Newton-Raphson and EM algorithms for linear mixed effects models for repeated measures data. Journal of the American Statistical Association 83, 1014-1022.
24. Liu, X. and Yang, M. C. K. (2009). Simultaneous curve registration and clustering for functional data. Computational Statistics & Data Analysis 53, 1361-1376.
25. Marshall, E. C. and Spiegelhalter, D. J. (2003). Approximate cross-validatory predictive checks in disease mapping models. Statistics in Medicine 22, 1649-1660.
26. McLachlan, G. J. and Krishnan, T. (1997). The EM Algorithm and Extensions. Wiley, New York, NY.
27. McLachlan, G. J., Krishnan, T. and Ng, S. K. (2004). The EM Algorithm. Humboldt-University Berlin: Center for Applied Statistics and Economics, Berlin, Germany.
28. McLachlan, G. J. and Peel, D. (2000). Finite Mixture Models. Wiley, New York, NY.
29. Nelder, J. A. and Mead, R. (1965). A simplex method for function minimization. Computer Journal 7, 308-313.
30. Ng, S. K., McLachlan, G. J., Wang, K., Ben-Tovim Jones, L. and Ng, S.-W. (2006). A mixture model with random-effects components for clustering correlated gene-expression profiles. Bioinformatics 22, 1745-1752.
31. O'Neill, R. (1971). Algorithms AS 47: function minimization using a simplex procedure. Journal of the Royal Statistical Society C20, 338-345.
32. Papageorgiou, G. and Hinde, J. (2012). Multivariate generalized linear mixed models with semi-nonparametric and smooth nonparametric random effects densities. Statistics and Computing 22, 79-92.
33. R Development Core Team (2012). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, ISBN 3-900051-07-0.
34. Ruppert, D., Wand, M. P. and Carroll, R. J. (2003). Semiparametric Regression. Cambridge University Press, Cambridge, NY.
35. Scharl, T., Grün, B. and Leisch, F. (2010). Mixtures of regression models for time course gene expression data: evaluation of initialization and random effects. Bioinformatics 26, 370-377.
36. Stroustrup, B. (1997). The C++ Programming Language (3rd ed.). Addison-Wesley, Amsterdam.
37. Tibshirani, R., Saunders, M., Rosset, S., Zhu, J. and Kneight, K. (2005). Sparsity and smoothness via the fused lasso. Journal of the Royal Statistical Society B67, 91-108.
38. Vaida, F. and Blanchard, S. (2005). Conditional Akaike information for mixed-effects models. Biometrika 92, 351-370.
39. Verbeke, G. and Lesaffre, E. (1996). A linear mixed-effects model with heterogeneity in the random-effects population. Journal of the American Statistical Association 91, 217-221.
40. Verbeke, G. and Lesaffre, E. (1999). The effect of drop-out on the efficiency of longitudinal experiments. Applied Statistics 48, 363-375.
41. Verbeke, G. and Molenberghs, G. (2000). Linear Mixed Models for Longitudinal Data. Springer Series in Statistics. Springer, New York, NY.
42. Verdonck, A., de Ridder, L., Verbeke, G., Bourguignon, J. P., Carels, C., Kuhn, E. R., Darras, V. and de Zegher, F. (1998). Comparative effects of neonatal and prepurbetal castration on craniofacial growth in rats. Archives of Oral Biology 43, 861-871.
43. Villarroel, L., Marshall, G. and Barón, A. E. (2009). Cluster analysis using multivariate mixed effects models. Statistics in Medicine 28, 2552-2565.
44. Yuan, M. and Lin, Y. (2006). Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society B68, 49-67.