Clustering in linear mixed models with approximate Dirichlet process mixtures using EM algorithm

Statistical Modelling

Volumn 13, Issue 1, 2013, Pages 41-67

  Heinzl, Felix ^a   Tutz, Gerhard ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

approximate Dirichlet process mixture; EM algorithm; likelihood inference; linear mixed models; stick breaking

Indexed keywords

EID: 84873948659     PISSN: 1471082X     EISSN: 14770342     Source Type: Journal    
DOI: 10.1177/1471082X12471372     Document Type: Article

References (60)

1. Bates DM,Maechler M,Bolker B.lme4: Linear mixed-effects models using S4 classes. 2012;:.
2. Blackwell D.Discreteness of Ferguson selections.The Annals of Statistics. 1973;1:356-58.
3. Blackwell D,MacQueen JB.Ferguson distributions via Pólya urn schemes.The Annals of Statistics. 1973;1:353-55.
4. Blei DM,Jordan MI.Variational inference for Dirichlet process mixtures.Bayesian Analysis. 2006;1:121-44.
5. Booth JG,Casella G,Hobert JP.Clustering using objective functions and stochastic search.Journal of the Royal Statistical Society, Series B. 2008;70:119-39.
6. Burkhardt JASA047: Nelder-Mead minimization algorithm. C++ library; 2008:.
7. Bush CA,MacEachern SN.A semiparametric Bayesian model for randomised block designs.Biometrika. 1996;83:275-85.
8. Celeux G,Martin O,Lavergne C.Mixture of linear mixed models for clustering gene expression profiles from repeated microarray experiments.Statistical Modelling. 2005;5:243-67.
9. De la Cruz-Mesía R,Quintana FA,Marshall G.Model-based clustering for longitudinal data.Computational Statistics & Data Analysis. 2008;52:1441-57.
10. Dempster AP,Laired NM,Rubin DB.Maximum likelihood from incomplete data via the EM algorithm.Journal of the Royal Statistical Society, Series B. 1977;39:1-38.
11. Dockery DW,Berkey CS,Ware JH,Speizer FE,Ferris BG.Distribution of fvc and fev1 in children 6 to 11 years old.American Review of Respiratory Disease. 1983;128:405-12.
12. Efron B.Bootstrap methods: another look at the jackknife.The Annals of Statistics. 1979;7:1-26.
13. Escobar MD.Estimating normal means with a Dirichlet process prior.Journal of the American Statistical Association. 1994;89:268-77.
14. Escobar MD,West M.Bayesian density estimation and inference using mixtures.Journal of the American Statistical Association. 1995;90:577-88.
15. Ferguson TS.A Bayesian analysis of some nonparametric problems.The Annals of Statistics. 1973;1:209-30.
16. Fritsch A,Ickstadt K.Improved criteria for clustering based on the posterior similarity matrix.Bayesian Analysis. 2009;4:367-92.
17. Gaffney SJ,Smyth PProceedings of the ninth international workshop on artificial intelligence and statistics. Bishop CMFrey BJ, ed. Key West, FL:; 2003:.
18. Gelfand AE,Kottas A.A computational approach for full nonparametric Bayesian inference under Dirichlet process mixture models.Journal of Computational and Graphical Statistics. 2002;11:289-305.
19. Heinzl F.clustmixed: Clustering in linear and additive mixed models. 2012;:.
20. Heinzl F,Fahrmeir L,Kneib T.Additive mixed models with Dirichlet process mixture and P-spline priors.Advances in Statistical Analysis. 2012;96:47-68.
21. Ishwaran H,James LF.Gibbs sampling methods for stick-breaking priors.Journal of the American Statistical Association. 2001;96:161-73.
22. Ishwaran H,James LF.Approximate Dirichlet process computing in finite normal mixtures: smoothing and prior information.Journal of Computational and Graphical Statistics. 2002;11:508-32.
23. James GM,Sugar CA.Clustering for sparsely sampled functional data.Journal of the American Statistical Association. 2003;98:397-408.
24. Jara A,Hanson TE,Lesaffre E.Robustifying generalized linear mixed models using a new class of mixtures of multivariate Polya trees.Journal of Computational and Graphical Statistics. 2009;18:838-60.
25. Komárek A,Hansen BE,Kuiper EMM,van Buuren HR,Lesaffre E.Discriminant analysis using a multivariate linear mixed model with a normal mixture in the random effects distribution.Statistics in Medicine. 2010;29:3267-83.
26. Komárek A,Komárková L.Clustering for multivariate continuous and discrete longitudinal data.The Annals of Applied Statistics. 2013;:.
27. Komárek A,Lesaffre E.Generalized linear mixed model with a penalized Gaussian mixture as a random effects distribution.Computational Statistics and Data Analysis. 2008;52:3441-58.
28. Kottas A,Gelfand AE.Bayesian semiparametric median regression modeling.Journal of the American Statistical Association. 2001;96:1458-68.
29. Laird NM,Ware JH.Random-effects models for longitudinal data.Biometrics. 1982;38:963-74.
30. Li Y,Müller P,Lin X.Center-adjusted inference for a nonparametric Bayesian random effect distribution.Statistica Sinica. 2011;21:1201-23.
31. Lindley DV,Smith AFM.Bayes estimates for the linear model.Journal of the Royal Statistical Society, Series B. 1972;34:1-41.
32. Lindstrom MJ,Bates DM.Newton-Raphson and EM algorithms for linear mixed effects models for repeated measures data.Journal of the American Statistical Association. 1988;83:1014-22.
33. Liu X,Yang MCK.Simultaneous curve registration and clustering for functional data.Computational Statistics & Data Analysis. 2009;53:1361-76.
34. MacEachern SN.Estimating normal means with a conjugate style Dirichlet process prior.Communications in Statistics - Simulation and Computation. 1994;23:727-41.
35. MacEachern SN,Müller P.Estimating mixtures of Dirichlet process models.Journal of Computational and Graphical Statistics. 1998;7:223-38.
36. Magder LS,Zeger SL.A smooth nonparametric estimate of a mixing distribution using mixtures of Gaussians.Journal of the American Statistical Association. 1996;91:1141-51.
37. Maritz JS,Lwin TEmpirical Bayes methods. Monographs on statistics and applied probability. London: Chapman & Hall; 1989:.
38. McAuliffe JD,Blei DM,Jordan MI.Nonparametric empirical Bayes for the Dirichlet process mixture model.Statistics and Computing. 2006;16:5-14.
39. McLachlan GJ,Krishnan TThe EM algorithm and extensions. New York: Wiley; 1997:.
40. McLachlan GJ,Peel DFinite mixture models. New York: Wiley; 2000:.
41. Muliere P,Tardella L.Approximating distributions of random functionals of Ferguson-Dirichlet priors.The Canadian Journal of Statistics. 1998;26:283-97.
42. Müller P,Rosner GL.A Bayesian population model with hierarchical mixture priors applied to blood count data.Journal of the American Statistical Association. 1997;92:1279-92.
43. Nelder JA,Mead R.A simplex method for function minimization.Computer Journal. 1965;7:308-13.
44. Newton MA,Zhang Y.A recursive algorithm for nonparametric analysis with missing data.Biometrika. 1999;86:15-26.
45. Ng SK,McLachlan GJ,Wang K,Ben-Tovim Jones L,Ng SW.A mixture model with random-effects components for clustering correlated gene-expression profiles.Bioinformatics. 2006;22:1745-52.
46. Ohlssen DI,Sharples LD,Spiegelhalter DJ.Flexible random-effects models using Bayesian semi-parametric models: Applications to institutional comparisons.Statistics in Medicine. 2007;26:2088-112.
47. O'Neill R.Algorithms AS 47: function minimization using a simplex procedure.Journal of the Royal Statistical Society, Series C. 1971;20:338-45.
48. Papageorgiou G,Hinde J.Multivariate generalized linear mixed models with semi-nonparametric and smooth nonparametric random effects densities.Statistics and Computing. 2012;22:79-92.
49. Papaspiliopoulos O,Roberts GO.Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models.Biometrika. 2008;95:169-86.
50. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2012:.
51. Ruppert D,Wand MP,Carroll RJSemiparametric regression. Cambridge: Cambridge University Press; 2003:.
52. Scharl T,Grün B,Leisch F.Mixtures of regression models for time course gene expression data: evaluation of initialization and random effects.Bioinformatics. 2010;26:370-77.
53. Sethuraman J.A constructive definition of Dirichlet priors.Statistica Sinica. 1994;4:639-50.
54. Stroustrup BThe C++ programming language. 1997) The C++ programming language (3rd ed). Amsterdam: Addison-Wesley.Amsterdam: Addison-Wesley; 1997:.
55. Verbeke G,Lesaffre E.A linear mixed-effects model with heterogeneity in the random-effects population.Journal of the American Statistical Association. 1996;91:217-21.
56. Verbeke G,Molenberghs GLinear mixed models for longitudinal data. New York: Springer; 2000:.
57. Villarroel L,Marshall G,Barón AE.Cluster analysis using multivariate mixed effects models.Statistics in Medicine. 2009;28:2552-65.
58. Walker SG.Sampling the Dirichlet mixture model with slices.Communications in Statistics - Simulation and Computation. 2007;36:45-54.
59. Arbeitsmarkt in Zahlen. Weise FJAlt HBecker R, ed. Nürnberg: Statistik der Bundesagentur für Arbeit; 2011:.
60. Yao C,Holmes C.Hierarchical Bayesian nonparametric mixture models for clustering with variable relevance determination.Bayesian Analysis. 2011;6:329-51.