Mixtures of factor analyzers with common factor loadings: Applications to the clustering and visualization of high-dimensional data

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 32, Issue 7, 2010, Pages 1298-1309

  Baek, Jangsun ^a   McLachlan, Geoffrey J ^b   Flack, Lloyd K ^b  

^a Chonnam National University   (South Korea)

^b UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

Common factor loadings; Mixtures of factor analyzers; Model based clustering; Normal mixture models

Indexed keywords

COMMON FACTOR LOADINGS; COMMON FACTORS; FACTOR ANALYZERS; MODEL-BASED CLUSTERING; NORMAL MIXTURE MODELS;

COVARIANCE MATRIX; DATA VISUALIZATION; VISUALIZATION;

MIXTURES;

EID: 77952666333     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2009.149     Document Type: Article

References (25)

1. G.J. McLachlan and D. Peel, Finite Mixture Models. Wiley, 2000.
2. A.P. Dempster, N.M. Laird, and D.B. Rubin, "Maximum Likelihood from Incomplete Data via the EM Algorithm (with Discussion)," J. Royal Statistical Soc.: Series B, vol.39, pp. 1-38, 1977.
3. G.J. McLachlan and T. Krishnan, The EM Algorithm and Extensions, second ed. Wiley, 2008.
4. J.D. Banfield and A.E. Raftery, "Model-Based Gaussian and Non-Gaussian Clustering," Biometrics, vol.49, pp. 803-821, 1993.
5. G.J. McLachlan, D. Peel, and R.W. Bean, "Modelling High-Dimensional Data by Mixtures of Factor Analyzers," Computational Statistics & Data Analysis, vol.41, pp. 379-388, 2003. (Pubitemid 36065383)
6. G.J. McLachlan, R.W. Bean, and L. Ben-Tovim Jones, "Extension of the Mixture of Factor Analyzers Model to Incorporate the Multivariate t Distribution," Computational Statistics & Data Analysis, vol.51, pp. 5327-5338, 2007. (Pubitemid 46694022)
7. G.E. Hinton, P. Dayan, and M. Revow, "Modeling the Manifolds of Images of Handwritten Digits," IEEE Trans. Neural Networks, vol.8, no.1, pp. 65-74, Jan. 1997. (Pubitemid 127767781)
8. J. Baek and G.J. McLachlan, "Mixtures of Factor Analyzers with Common Factor Loadings for the Clustering and Visualisation of High-Dimensional Data," Technical Report NI08018-SCH, Preprint Series of the Isaac Newton Inst. for Math. Sciences, 2008.
9. R. Yoshida, T. Higuchi, and S. Imoto, "A Mixed Factors Model for Dimension Reduction and Extraction of a Group Structure in Gene Expression Data," Proc. 2004 IEEE Computational Systems Bioinfor-matics Conf., pp. 161-172, 2004. (Pubitemid 40276249)
10. R. Yoshida, T. Higuchi, S. Imoto, and S. Miyano, "ArrayCluster: An Analytic Tool for Clustering, Data Visualization and Module Finder on Gene Expression Profiles," Bioinformatics, vol.22, pp. 1538-1539, 2006. (Pubitemid 43985329)
11. A.-V.I. Rosti and M.J.F. Gales, "Factor Analysis Hidden Markov Models for Speech Recognition," Computer Speech and Language, vol.18, pp. 181-200, 2004.
12. N. Kumar, "Investigation of Silicon-Auditory Models and Generalization of Linear Discriminant Analysis for Improved Speech Recognition," doctoral dissertation, Johns Hopkins Univ., 1997.
13. R. Gopinath, B. Ramabhadran, and S. Dharanipragada, "Factor Analysis Invariant to Linear Transformations of Data," Proc. Int'l Conf. Speech and Language Processing, pp. 397-400, 1998.
14. M. Gales, "Semi-Tied Covariance Matrices for Hidden Markov Models," IEEE Trans. Speech and Audio Processing, vol.7, no.3, pp. 272-281, May 1999.
15. S. Axelrod, R. Gopinath, and P. Olsen, "Modeling with a Subspace Constraint on Inverse Covariance Matrices," Proc. Int'l Conf. Spoken Language Processing, 2002.
16. P. Olsen and R. Gopinath, "Modeling Inverse Covariance Matrices by Basis Expansion," Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, vol.1, pp. 945-948, 2002. (Pubitemid 34710447)
17. G. Galimberti, A. Montanari, and C. Viroli, "Latent Classes of Objects and Variable Selection," Proc. Int'l Conf. Computational Statistics, P. Brito, ed., pp. 373-383, 2008.
18. G. Sanguinetti, "Dimensionality Reduction of Clustered Data Sets," IEEE Trans. Pattern Analysis and Machine Intelligence, vol.30, no.3, pp. 535-540, Mar. 2008. (Pubitemid 351280059)
19. G. Schwarz, "Estimating the Dimension of a Model," Annals of Statistics, vol.6, pp. 461-464, 1978.
20. L. Hubert and P. Arabie, "Comparing Partitions," J. Classification, vol.2, pp. 193-218, 1985.
21. E. Yeoh et al., "Classification, Subtype Discovery, and Prediction of Outcome in Pediatric Acute Lymphoblastic Leukemia by Gene Expression Profiling," Cancer Cell, vol.1, pp. 133-143, 2002. (Pubitemid 41039160)
22. G.J. McLachlan, R.W. Bean, and D. Peel, "Mixture Model-Based Approach to the Clustering of Microarray Expression Data," Bioinformatics, vol.18, pp. 413-422, 2002. (Pubitemid 34284942)
23. P. Jaccard, "Distribution de la Florine Alpine dans la Bassin de Dranses et dans Quelques Regiones Voisines," Bull. de la Société Vaudoise des Sciences Naturelles, vol.37, pp. 241-272, 1901.
24. C. Smyth, D. Coomans, and Y. Everingham, "Clustering Noisy Data in a Reduced Dimension Space via Multivariate Regression Trees," Pattern Recognition, vol.39, pp. 424-431, 2006.
25. M.E. Tipping and C.M. Bishop, "Mixtures of Probabilistic Principal Component Analysers," Neural Computation, vol.11, pp. 443-482, 1999.