The infinite Students t-factor mixture analyzer for robust clustering and classification

Pattern Recognition

Volumn 45, Issue 12, 2012, Pages 4346-4357

  Wei, Xin ^a   Yang, Zhen ^a  

^a The National and Local Joint Engineering Laboratory of RF Integration and Micro Assembly Technology   (China)

Author keywords

Classification; Clustering; Infinite Students t factor mixture analyzer; Nonparametric Bayesian statistics; Variational inference

Indexed keywords

APPROPRIATE MODELS; CLUSTERING; FINITE MIXTURES; GENERALIZATION CAPACITY; HIGH DIMENSIONAL DATA; INFINITE NUMBERS; INFINITE STUDENTS T-FACTOR MIXTURE ANALYZER; MAXIMUM LIKELIHOOD CRITERIA; NON-PARAMETRIC BAYESIAN; NUMBER OF COMPONENTS; OBSERVED DATA; OVERFITTING; PARAMETER ESTIMATION METHOD; ROBUST CLUSTERING; VARIATIONAL INFERENCE;

CLASSIFICATION (OF INFORMATION); CLUSTERING ALGORITHMS; IDENTIFICATION (CONTROL SYSTEMS); INFERENCE ENGINES; PARAMETER ESTIMATION; STUDENTS;

MIXTURES;

EID: 84864278926     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.05.003     Document Type: Article

References (42)

1. C. Spearman The proof and measurement of association between two things American Journal of Psychology 15 1904 72 101
2. M.S. Bartlett, Factor analysis in psychology as a statistician sees it, in: Uppsala Symposium on Psychological Factor Analysis, Number 3 in Nordisk Psykologis Monograph Series, 1953, pp. 23-43.
3. D. Bartholomew, M. Knott, I. Moustaki Latent Variable Models and Factor Analysis: A Unified Approach 3rd ed. 2011 John Wiley series in Probability and Statistics
4. Z. Ghahramani, G.E. Hinton, The EM algorithm for mixtures of factor analyzers, Technical Report, CRG-TR-96-1, Department of Computer Science, University of Toronto, 1997.
5. L. Carin, R.G. Baraniuk, V. Cevher, D. Dunson, M.I. Jordan, G. Sapiro, M.B. Wakin Learning low-dimensional signal models IEEE Signal Processing Magazine 28 2 2011 381 396
6. A. Montanari, C. Viroli Maximum likelihood estimation of mixture of factor analyzers Computational Statistics and Data Analysis 55 9 2011 2712 2723
7. G.J. McLachlan, D. Peel Finite Mixture Models 2000 Wiley New York
8. G.J. McLachlan, D. Peel Robust cluster analysis via mixtures of multivariate t-distributions Lecture Notes in Computer Science 1451 1998 658 666
9. D. Peel, G.J. McLachlan Robust mixture modelling using the t distribution Statistics and Computing 10 4 2000 339 348
10. G.J. McLachlan, R.W. Bean, B.J. Jones Extension of the mixture of factor analyzers model to incorporate the multivariate t-distribution Computational Statistics and Data Analysis 51 11 2007 5327 5338
11. S. Chatzis, D. Kosmopoulos, T. Varvarigou Signal modeling and classification using a robust latent space model based on t distributions IEEE Transactions on Signal Processing 56 3 2008 949 963
12. J.L. Andrews, P.D. McNicholas Mixtures of modified t-factor analyzers for model-based clustering, classification, discriminant analysis Journal of Statistical Planning and Inference 141 4 2011 1479 1486
13. J.L. Andrews, P.D. McNicholas Extending mixtures of multivariate t-factor analyzers Statistics and Computing 21 3 2011 361 373
14. P.D. McNicholas, T.B. Murphy Parsimonious Gaussian mixture models Statistics and Computing 18 3 2008 285 296
15. P.D. McNicholas, T.B. Murphy Model-based clustering of microarray expression data via latent Gaussian mixture models Bioinformatics 26 21 2010 2705 2712
16. J. Baek, G.J. McLachlan Mixtures of common t-factor analyzers for clustering high-dimensional microarray data Bioinformatics 27 9 2011 1269 1276
17. A. Montanari, C. Viroli Heteroscedastic factor mixture analysis Statistical Modelling 10 4 2010 441 460
18. C. Viroli Dimensionally reduced model-based clustering through mixtures of factor mixture analyzers Journal of Classification 27 3 2010 363 388
19. J. Baek, G.J. McLachlan, L.K. Flack Mixtures of factor analyzers with common factor loadings: applications to the clustering and visualization of high-dimensional data IEEE Transactions on Pattern Analysis and Machine Intelligence 32 7 2010 1298 1309
20. V. Melnykov, R. Maitra Finite mixture models and model-based clustering Statistics Surveys 4 2010 80 116
21. Y. Xiong, D.Y. Yeung Time series clustering with ARMA mixtures Pattern Recognition 37 8 2004 1675 1689
22. K. Yamazaki, S. Watanabe Singularities in mixture models and upper bounds of stochastic complexity Neural Networks 16 7 2003 1029 1038
23. N. Hjort, C. Holmes, P. Muller Bayesian Nonparametrics: Principles and Practice 2010 Cambridge University Press
24. S.J. Gershman, D.M. Blei A tutorial on Bayesian nonparametric models Journal of Mathematical Psychology 56 1 2012 1 12
25. C. Antoniak Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems Annals of Statistics 2 1974 1152 1174
26. N. Bouguila, D. Ziou A Dirichlet process mixture of generalized Dirichlet distributions for proportional data modeling IEEE Transactions on Neural Networks 21 1 2010 107 122
27. X. Wei, C. Li The infinite Students t-mixture for robust modeling Signal Processing 92 1 2012 224 234
28. M.I. Jordan A introduction to variational methods for graphical models Machine Learning 37 2 1999 183 233
29. P. Bruneau, M. Gelgon, F. Picarougne Parsimonious reduction of Gaussian mixture models with a variational-Bayes approach Pattern Recognition 43 3 2010 850 858
30. D.M. Blei, M.I. Jordan Variational inference for Dirichlet process mixtures Bayesian Analysis 1 1 2006 121 144
31. H. Ishwaran, L. James Gibbs sampling methods for stick-breaking priors Journal of the American Statistical Association 96 453 2001 161 173
32. A. Gelman, J.B. Carlin, H.S. Stern, D.B. Rubin Bayesian Data Analysis 2004 Chapman& Hall/CRC London, UK
33. M. Opper, D. Saad (Eds.), Advanced Mean Field Methods: Theory and Practice, MIT Press, Cambridge, MA, 2001.
34. X. Wei, C. Li The Students t-hidden Markov model with truncated stick-breaking priors IEEE Signal Processing Letters 18 6 2011 355 358
35. P.D. McNicholas, T.B. Murphy, A.F. McDaid, D. Frost Serial and parallel implementations of model-based clustering via parsimonious Gaussian mixture models Computational Statistics and Data Analysis 54 3 2010 711 723
36. B.G. Lindsay, Mixture models: theory, geometry and applications, Vol. 5 of NSF-CBMS Regional Conference Series in Probability and Statistics, Institute of Mathematical Statistics, Hayward, CA, 1995.
37. D. Bohning, E. Dietz, R. Schaub, P. Schlattmann, B.G. Lindsay The distribution of the likelihood ratio for mixtures of densities from the one-parameter exponential family Annals of the Institute of Statistical Mathematics 46 2 1994 373 388
38. T. Hastie, R. Tibshirani Discriminant analysis by Gaussian mixtures Journal of the Royal Statistical Society: Series B 58 1 1996 155 176
39. L. Hubert, P. Arabie Comparing partitions Journal of Classification 2 1 1985 193 218
40. E.J. Yeoh Classification, subtype discovery, prediction of outcome in pediatric acute lymphoblastic leukemia by gene expression profiling Cancer Cell 1 2 2002 133 143
41. G.J. McLachlan, R.W. Bean, D. Peel A mixture model-based approach to the clustering of microarray expression data Bioinformatics 18 3 2002 413 422
42. A. Asuncion, D.J. Newman, UCI Machine Learning Repository [ 〈 http://www.ics.uci.edu/∼mlearn/MLRepository.html 〉 ]. University of California, Department of Information and Computer Science, 2007.