Learning from incomplete data via parameterized t mixture models through eigenvalue decomposition

Computational Statistics and Data Analysis

Volumn 71, Issue , 2014, Pages 183-195

  Lin, Tsung I ^a,b  

^a NATIONAL CHUNG HSING UNIVERSITY   (Taiwan)

^b CHINA MEDICAL UNIVERSITY   (Taiwan)

Author keywords

Eigenvalue decomposition; EM type algorithms; F G algorithm; Integrated completed likelihood; Model based clustering; Multivariate t mixture models

Indexed keywords

EIGENVALUE DECOMPOSITION; EM-TYPE ALGORITHMS; INTEGRATED COMPLETED LIKELIHOOD; MODEL-BASED CLUSTERING; MULTIVARIATE T;

EIGENVALUES AND EIGENFUNCTIONS; MIXTURES;

CLUSTERING ALGORITHMS;

EID: 84889102495     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2013.02.020     Document Type: Article

References (59)

1. J.L. Andrews, and P.D. McNicholas Extending mixtures of multivariate t-factor analyzers Stat. Comput. 21 2011 361 373
2. J.L. Andrews, and P.D. McNicholas Model-based clustering, classification, and discriminant analysis via mixtures of multivariate t-distributions Stat. Comput. 22 2012 1021 1029
3. J.D. Banfield, and A.E. Raftery Model-based Gaussian and non-Gaussian clustering Biometrics 49 1993 803 821 (Pubitemid 23298358)
4. H. Bensmail, and G. Celeux Regularized Gaussian discriminant analysis through eigenvalue decomposition J. Amer. Statist. Assoc. 91 1996 1743 1748
5. H. Bensmail, G. Celeux, A.E. Raftery, and C.P. Robert Inference in model-based cluster analysis Stat. Comput. 7 1997 1 10
6. C. Biernacki, G. Celeux, and G. Govaert Assessing a mixture model for clustering with the integrated completed likelihood IEEE Trans. Pattern Anal. Mach. Intell. 22 2000 719 725
7. C. Biernacki, G. Celeux, G. Govaert, and F. Langrognet Model-based clustering and discriminant analysis with the MIXMOD software Comput. Statist. Data Anal. 51 2006 587 600 (Pubitemid 44635895)
8. C.M. Bishop Pattern Recognition and Machine Learning 2006 Springer Singapore
9. D. Böhning, E. Dietz, R. Schaub, P. Schlattmann, and B. Lindsay The distribution of the likelihood ratio for mixtures of densities from the one-parameter exponential family Ann. Inst. Statist. Math. 46 1994 373 388
10. J.G. Booth, and J.P. Hobert Maximizing generalized linear mixed model likelihoods with an automated Monte Carlo EM algorithm J. Roy. Statist. Soc. Ser. B 61 1999 265 285
11. G. Celeux, and G. Govaert A classification EM algorithm for clustering and two stochastic versions Comput. Statist. Data Anal. 14 1992 315 332
12. G. Celeux, and G. Govaert Gaussian parsimonious clustering models Pattern Recognit. 28 1995 781 793
13. D.B. Clarkson A remark on algorithm AS 211. The F-G diagonalization algorithm Appl. Stat. 37 1988 147 151
14. D.B. Clarkson A least squares version of algorithm AS 211: the F-G diagonalization algorithm Appl. Stat. 37 1988 317 321
15. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm (with discussion) J. Roy. Statist. Soc. Ser. B 39 1977 1 38
16. J. Diebolt, and C.P. Robert Estimation of finite mixture distributions through Bayesian sampling J. Roy. Statist. Soc. Ser. B 56 1994 363 375
17. M.D. Escobar, and M. West Bayesian density estimation and inference using mixtures J. Amer. Statist. Assoc. 90 1995 577 588
18. B.S. Everitt, and D.J. Hand Finite Mixture Distributions Monographs on Statistics and Applied Probability 1981 Chapman & Hall London, New York
19. B. Flury Common principal component in k groups J. Amer. Statist. Assoc. 79 1984 892 898
20. B.N. Flury, and W. Gautschi An algorithm for simultaneous orthogonal transformation of several positive definite symmetric matrices to nearly diagonal form J. Sci. Statist. Comput. 7 1986 169 184
21. C. Fraley, and A.E. Raftery How many clusters? which clustering method? answers via model-based cluster analysis Comput. J. 41 1998 578 588
22. C. Fraley, and A.E. Raftery Model-based clustering, discriminant analysis, and density estimation J. Amer. Statist. Assoc. 97 2002 611 612
23. C. Fraley, and A.E Raftery Enhanced model-based clustering, density estimation, and discriminant analysis software: MCLUST J. Classification 20 2003 263 286 (Pubitemid 38157158)
24. Frank, A., Asuncion, A., 2010. UCI machine learning repository. http://archive.ics.uci.edu/ml.
25. H.P. Friedman, and J. Rubin On some invariant criteria for grouping data J. Amer. Statist. Assoc. 62 1967 1159 1178
26. S. Frühwirth-Schnatter Finite Mixture and Markov Switching Models 2006 Springer New York
27. Z. Ghahramani, and M.I. Jordan Supervised learning from incomplete data via an EM approach JD Cowan, G Tesarro, J Alspector, Advances in Neural Information Processing Systems, Vol. 6 1994 Morgan Kaufmann San Francisco 120 127
28. W.K. Hastings Monte Carlo sampling methods using Markov chains and their applications Biometrika 57 1970 97 109
29. C. Hurley Clustering visualizations of multivariate data J. Comput. Graph. Statist. 13 2004 788 806
30. C. Keribin Consistent estimation of the order of mixture models Sankhyā Ser. A 62 2000 49 66
31. T.I. Lin Maximum likelihood estimation for multivariate skew normal mixture models J. Multivariate Anal. 100 2009 257 265
32. T.I. Lin Robust mixture modeling using multivariate skew t distributions Stat. Comput. 20 2010 343 356
33. T.I. Lin, H.J. Ho, and P.S. Shen Computationally efficient learning of multivariate t mixture models with missing information Comput. Stat. 24 2009 375 392
34. T.I. Lin, J.C. Lee, and H.J. Ho On fast supervised learning for normal mixture models with missing information Pattern Recognit. 39 2006 1177 1187
35. T.I. Lin, J.C. Lee, and H.F. Ni Bayesian analysis of mixture modelling using the multivariate t distribution Stat. Comput. 14 2004 119 130 (Pubitemid 39051295)
36. R.J.A. Little, and D.B. Rubin Statistical Analysis with Missing Data second ed. 2002 Wiley New York
37. C.H. Liu, and D.B. Rubin The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence Biometrika 81 1994 633 648
38. C.H. Liu, D.B. Rubin, and Y.N. Wu Parameter expansion to accelerate EM: the PX-EM algorithm Biometrika 85 1998 755 770
39. G.J. McLachlan, and K.E. Basford Mixture Models: Inference and Application to Clustering 1988 Marcel Dekker New York
40. G.J. McLachlan, and T. Krishnan The EM Algorithm and Extensions second ed. 2008 John Wiley & Sons New York
41. G.J. McLachlan, and D. Peel Robust cluster analysis via mixtures of multivariate t-distributions Lecture Notes in Computer Science vol. 1451 1998 Springer Berlin 658 666 (Pubitemid 128117168)
42. G.J. McLachlan, and D. Peel Finite Mixture Models 2000 Wiely New York
43. P.D. McNicholas Model-based classification using latent Gaussian mixture models J. Statist. Plann. Inference 140 2010 1175 1181
44. P.D. McNicholas, T.B. Murphy, A.F. McDaid, and D. Frost Serial and parallel implementations of model-based clustering via parsimonious Gaussian mixture models Comput. Statist. Data Anal. 54 2010 711 723
45. X.L. Meng, and D.B. Rubin Maximum likelihood estimation via the ECM algorithm: a general framework Biometrika 80 1993 267 278
46. X.L. Meng, and D. van Dyk The EM algorithm-an old folk song sung to a fast new tune (with discussion) J. Roy. Statist. Soc. Ser. B 59 1997 511 567 (Pubitemid 127686967)
47. D. Peel, and G.J. McLachlan Robust mixture modeling using the t distribution Stat. Comput. 10 2000 339 348
48. S. Pyne, X. Hu, K. Wang, E. Rossin, T.I. Lin, L.M. Maier, C. Baecher-Allan, G.J. McLachlan, P. Tamayo, D.A. Hafler, P.L. De Jager, and J.P. Mesirov Automated high-dimensional flow cytometric data analysis Proc. Natl. Acad. Sci. USA 106 2009 8519 8524
49. R Development Core Team R: A Language and Environment for Statistical Computing 2011 R Foundation for Statistical Computing Vienna
50. R.A. Redner, and H.F. Walker Mixture densities, maximum likelihood and the EM algorithm SIAM Rev. 26 1984 195 239
51. D.B. Rubin Inference and missing data Biometrika 63 1976 581 592
52. D.B. Rubin Multiple Imputation for Nonresponse in Surveys 1987 John Wiley & Sons New York
53. J.L. Schafer Analysis of Incomplete Multivariate Data 1997 Chapman and Hall London
54. G. Schwarz Estimating the dimension of a model Ann. Statist. 6 1978 461 464
55. S. Shoham Robust clustering by deterministic agglomeration EM of mixtures of multivariate t-distributions Pattern Recognit. 35 2002 1127 1142 (Pubitemid 34188968)
56. M.A. Tanner, and W.H. Wong The calculation of posterior distributions by data augmentation (with discussion) J. Amer. Statist. Assoc. 82 1987 528 550
57. D.M. Titterington, A.F.M. Smith, and U.E. Makov Statistical Analysis of Finite Mixture Distributions 1985 Wiley New York
58. H.X. Wang, and Z. Hu On EM estimation for mixture of multivariate t-distributions Neural Process. Lett. 30 2009 243 256
59. H.X. Wang, Q.B. Zhang, B. Luo, and S. Wei Robust mixture modelling using multivariate t distribution with missing information Pattern Recognit. Lett. 25 2004 701 710 (Pubitemid 38473630)