Mixtures of factor analysers for the analysis of high-dimensional data

Mixtures: Estimation and Applications

Volumn , Issue , 2011, Pages 189-212

  McLachlan, Geoffrey J ^a   Baek, Jangsun ^b   Rathnayake, Suren I ^a  

^a UNIVERSITY OF QUEENSLAND   (Australia)

^b Chonnam National University   (South Korea)

Author keywords

Choice of number of factors q; Fitting of factor analytic models as with MFA approach; Low dimensional plots via MCFA approach results of a clustering in low dimensional space; MFA and MCFA approaches for implied clustering versus true membership of Vietnam data; Mixture of factor analysers model sensitive to outliers, multivariate normal family for distributions of errors and latent factors; Mixtures of factor analysers for analysis of high dimensional data; Mixtures of factor analysers mixtures of common factor analysers (MCFA); Restriction of sphericity of errors of diagonal covariance matrices, distributions of factors; Single factor analysis model factor analysis, used for explaining data; Use of mixtures of factor analysers reducing parameters, specification of component covariance matrices

Indexed keywords

CLUSTER ANALYSIS; CLUSTERING ALGORITHMS; COVARIANCE MATRIX; MIXTURES; MULTIVARIANT ANALYSIS;

ANALYTIC MODELS; COMMON FACTORS; COMPONENT-COVARIANCE MATRICES; COVARIANCE MATRICES; FACTOR ANALYSIS MODEL; HIGH DIMENSIONAL DATA; LOW-DIMENSIONAL SPACES; MODEL-SENSITIVE; NUMBER OF FACTORS; VIET NAM;

FACTOR ANALYSIS;

EID: 84955365480     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781119995678.ch9     Document Type: Chapter

References (38)

1. Baek, J. and McLachlan, G. J. (2010) Mixtures of common t-factor analyzers for clustering high-dimensional microarray data (Submitted for publication).
2. Baek, J. and McLachlan, G. J. (2008) Mixtures of factor analyzers with common factor loadings for the clustering and visualisation of high-dimensional data, Technical Report NI08018-SCH, Preprint Series of the Isaac Newton Institute for Mathematical Sciences, Cambridge.
3. Baek, J. McLachlan, G. J. and Flack L. K. (2010) Mixtures of factor analyzers with common factor loadings: applications to the clustering and visualisation of high-dimensional data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 1298-1309.
4. Banfield, J. D. and Raftery,A. E. (1993) Model-based Gaussian and non-Gaussian clustering. Biometrics, 49, 803-821.
5. Chang, W. C. (1983) On using principal components before separating a mixture of two multivariate normal distributions. Applied Statistics, 32, 267-275.
6. Dempster,A. P., Laird, N. M. and Rubin, D. B. (1977) Maximum likelihood from incomplete data via theEMalgorithm (with discussion). Journal of the Royal Statistical Society, Series B, 39, 1-38.
7. Gales, M. (1999) Semi-tied covariance matrices for hidden Markov models. IEEE Transactions on Speech and Audio Processing, 7, 272-281.
8. Galimberti, G., Montanari, A. and Viroli, C. (2008) Latent classes of objects and variable selection. In Proceedings of COMPSTAT 2008 (ed. P. Brito), pp. 373-383. Springer-Verlag.
9. Geweke, J. F. and Singleton, K. J. (1980) Interpreting the likelihood ratio statistic in factor models when sample size is small. Journal of the American Statistical Association, 75, 133-137.
10. Ghahramani, Z. and Hinton, G. E. (1997) The EM algorithm for factor analyzers. Technical Report CRG-TR-96-1, The University of Toronto, Toronto.
11. Gopinath, R., Ramabhadran, B. and Dharanipragada, S. (1998) Factor analysis invariant to linear transformations of data. In Proceedings of the International Conference on Speech and Language Processing, pp. 397-400.
12. Hennig, C. (2004) Breakdown points for maximum likelihood-estimators of location-scale mixtures. Annals of Statistics, 32, 1313-1340.
13. Hinton, G. E., Dayan, P. and Revow, M. (1997) Modeling the manifolds of images of handwritten digits. IEEE Transactions on Neural Networks, 8, 65-73.
14. Hubert, L. and Arabie, P. (1985) Comparing partitions. Journal of Classification, 2, 193-218.
15. Jaccard, P. (1901) Distribution de la florine alpine dans la Bassin de Dranses et dans quelques regions voisines. Bulletin de la Societe Vaudoise des Sciences Naturelles, 37, 241-272.
16. Kotz, S. and Nadarajah, S. (2004) Multivariate t-Distributions and Their Applications. Cambridge University Press.
17. Kumar, N. (1997) Investigation of silicon-auditory models and generalization of linear discriminant analysis for improved speech recognition. PhD Thesis, Johns Hopkins University, Maryland.
18. Lawley, D. N. and Maxwell, A. E. (1971) Factor Analysis as a Statistical Method. Butterworths, London.
19. McLachlan, G. J. and Krishnan, T. (2008) The EM Algorithm and Extensions, 2nd edn. John Wiley & Sons, Ltd.
20. McLachlan, G. J. and Peel, D. (2000a) Finite Mixture Models. John Wiley & Sons, Ltd.
21. McLachlan, G. J. and Peel, D. (2000b) Mixtures of factor analyzers. In Proceedings of the Seventeenth International Conference on Machine Learning (ed. P. Langley), pp. 599-606.
22. McLachlan, G. J., Bean, R. W. and Peel, D. (2002) Mixture model-based approach to the clustering of microarray expression data. Bioinformatics, 18, 413-422.
23. McLachlan, G. J., Peel, D. and Bean, R. W. (2003) Modelling high-dimensional data by mixtures of factor analyzers. Computational Statistics and Data Analysis, 41, 379-388.
24. McLachlan, G. J., Bean, R. W. and Ben-Tovim Jones, L. (2007) Extension of the mixture of factor analyzers model to incorporate the multivariate t distribution. Computational Statistics and Data Analysis, 51, 5327-5338.
25. McNicholas, P. D. and Murphy, T. B. (2008) Parsimonious Gaussian mixture models. Statistics and Computing, 18, 285-296.
26. Montanari, A. and Viroli, C. (2010) Heteroscedastic factor mixture analysis. Statistical Modelling (in press).
27. Olsen, P. and Gopinath, R. (2002) Modeling inverse covariance matrices by basis expansion. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Vol. 1, pp. 945-948.
28. Sanguinetti, G. (2008) Dimensionality reduction of clustered data sets. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 535-540.
29. Schwarz, G. (1978) Estimating the dimension of a model. Annals of Statistics, 6, 461-464.
30. Smyth, C., Coomans, C. and Everingham, Y. (2006) Clustering noisy data in a reduced dimension space via multivariate regression trees. Pattern Recognition, 39, 424-431.
31. Tipping, M. E. and Bishop, C. M. (1997) Mixtures of probabilistic principal component analysers. Technical Report NCRG/97/003, Neural Computing Research Group, Aston University, Birmingham.
32. Tipping, M. E. and Bishop, C. M. (1999) Mixtures of probabilistic principal component analysers. Neural Computation, 11, 443-482.
33. Rosti, A.-V. I. and Gales, M. J. F. (2001) Generalised linear Gaussian models. Technical Report CUED/F-INFENG/TR.420, Cambridge University Engineering Department.
34. Rosti, A.-V. I. and Gales, M. J. F. (2004) Factor analysis hidden Markov models for speech recognition. Computer Speech and Language, 18, 181-200.
35. Viroli, C. (2010) Dimensionally reduced model-based clustering through mixtures of factor mixture analyzers Journal of Classification (in press).
36. Xie, B., Pan,W. and Shen, X. (2010) Penalized mixtures of factor analyzers with application to clustering high-dimensional microarray data. Bioinformatics, 26, 501-508.
37. Yoshida, R., Higuchi, T. and Imoto, S. (2004)Amixed factors model for dimension reduction and extraction of a group structure in gene expression data. In Proceedings of the 2004 IEEE Computational Systems Bioinformatics Conference, pp.161-172.
38. Yoshida, R., Higuchi, T. Imoto, S. and Miyano, S. (2006) ArrayCluster: an analytic tool for clustering, data visualization and model finder on gene expression profiles. Bioinformatics, 22, 1538-1539.