Intrinsic dimension estimation by maximum likelihood in isotropic probabilistic PCA

Pattern Recognition Letters

Volumn 32, Issue 14, 2011, Pages 1706-1713

  Bouveyron, Charles ^a   Celeux, Gilles ^b   Girard, Stéphane ^c  

^a Université Paris 1 Panthéon Sorbonne   (France)

^b UNIVERSITÉ PARIS SUD   (France)

^c INRIA RHÔNE ALPES   (France)

Author keywords

Asymptotic consistency; Dimension reduction; Intrinsic dimension; Isotropic model; Maximum likelihood; Probabilistic PCA

Indexed keywords

MAXIMUM LIKELIHOOD; PRINCIPAL COMPONENT ANALYSIS;

ASYMPTOTIC CONSISTENCIES; DIMENSION REDUCTION; INTRINSIC DIMENSIONS; ISOTROPIC MODELS; PROBABILISTIC PCA;

MAXIMUM LIKELIHOOD ESTIMATION;

EID: 80053500222     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2011.07.017     Document Type: Article

References (37)

1. H. Akaike A new look at the statistical model identification IEEE Trans. Autom. Control 19 6 1974 716 723
2. T. Alexandrov, J. Decker, B. Mertens, A.M. Deelder, R.A. Tollenaar, P. Maass, and H. Thiele Biomarker discovery in MALDI-TOF serum protein profiles using discrete wavelet transformation Bioinformatics 25 5 2009 643 649
3. D.J. Bartholomew Latent Variable Models and Factor Analysis 1987 Charles Griffin & Co. Ltd London
4. A. Basilevsky Statistical Factor Analysis and Related Methods 1994 Wiley New York
5. Bishop, C., 1999. Bayesian PCA. In: 11th Annual Conf. on Neural Information Processing Systems.
6. G. Bouchard, and G. Celeux Selection of generative models in classification IEEE Trans. Pattern Anal. Machine Intell. 28 4 2006 544 554 (Pubitemid 43264653)
7. C. Bouveyron, and S. Girard Robust supervised classification with mixture models: Learning from data with uncertain labels Pattern Recognition 42 11 2009 2649 2658
8. C. Bouveyron, S. Girard, and C. Schmid High dimensional discriminant analysis Comm. Statist.: Theory Methods 36 14 2007 2607 2623
9. J. Bruske, and G. Sommer Intrinsic dimensionality estimation with optimally topology preserving maps IEEE Trans. Pattern Anal. Machine Intell. 20 5 1998 572 575 (Pubitemid 128741339)
10. F. Camastra Data dimensionality estimation methods: A survey Pattern Recognition 36 2003 2945 2954 (Pubitemid 37293405)
11. F. Camastra, and A. Vinciarelli Estimating the intrinsic dimension of data with a fractal-based method IEEE Trans. Pattern Anal. Machine Intell. 24 10 2002 1404 1407 (Pubitemid 35327462)
12. R. Cattell The scree test for the number of factors Multivariate Behav. Res. 1 2 1966 245 276
13. B. Chalmond, and S. Girard Nonlinear modeling of scattered multivariate data and its application to shape change IEEE Trans. Pattern Anal. Machine Intell. 21 5 1999 422 432
14. R. Everson, and S. Roberts Inferring the eigenvalues of covariance matrices from limited, noisy data IEEE Trans. Signal Process. 48 7 2000 2083 2091
15. M. Fan, H. Qiao, and B. Zhang Intrinsic dimension estimation of manifolds by incising balls Pattern Recognition 42 5 2009 780 787
16. C. Fraley, and A. Raftery Bayesian regularization for normal mixture estimation and model-based clustering J. Classif. 24 2007 155 181
17. K. Fukunaga, and D.R. Olsen An algorithm for finding intrinsic dimensionality of data IEEE Trans. Comput. 20 2 1971 176 183
18. I. Jolliffe Principal Component Analysis 1986 Springer-Verlag New York
19. J. Karhunen, and J. Joutsensalo Representation and separation of signals using nonlinear PCA type learning Neural Netw. 7 1 1994 113 127
20. Kegl, B., 2002. Intrinsic dimension estimation using packing numbers. In: 15th Annual Conf. on Neural Information Processing Systems.
21. Levina, E., Bickel, P., 2005. Maximum likelihood estimation of intrinsic dimension. In: 17th Annual Conf. on Neural Information Processing Systems.
22. MacKay, D., Ghahramani, Z., 2005. Comments on 'maximum likelihood estimation of intrinsic dimension' by E. Levina and P. Bickel, Technical report. inference.phy.cam.ac.uk/mackay/dimension.
23. Minka, T., 2000. Automatic choice of dimensionality for PCA. In: 13th Annual Conf. on Neural Information Processing Systems.
24. G. Nyamundanda, L. Brennan, and I.C. Gormley Probabilistic principal component analysis for metabolomic data BMC Bioinform. 11 2010 571 581
25. E. Pettis, T. Bailey, A. Jain, and R. Dubes An intrinsic dimensionality estimator from nearest-neighbor information IEEE Trans. Pattern Anal. Machine Intell. 1 1979 25 37 (Pubitemid 9468506)
26. J.J. Rajan, and P.J.W. Rayner Model order selection for the singular value decomposition and the discrete Karhunen-Love transform using a Bayesian approach IEE Proc. Vision Image Signal Proces. 144 2 1997 116 123
27. Roweis, S., 1998. EM algorithms for PCA and SPCA. In: 10th Annual Conf. on Neural Information Processing Systems.
28. S. Roweis, and L. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 5500 2000 2323 2326 (Pubitemid 32041578)
29. B. Schölkopf, A. Smola, and K.-R. Müller Nonlinear component analysis as a kernel eigenvalue problem Neural Comput. 10 5 1998 1299 1319 (Pubitemid 128463674)
30. G. Schwarz Estimating the dimension of a model Ann. Statist. 6 1978 461 464
31. J. Tenenbaum, V. De Silva, and J. Langford A global geometric framework for non-linear dimensionality reduction Science 290 5500 2000 2319 2323 (Pubitemid 32041577)
32. M. Tipping, and C. Bishop Mixtures of probabilistic principal component analyzers Neural Comput. 11 2 1999 443 482
33. M. Tipping, and C. Bishop Probabilistic principal component analysis J. Roy. Statist. Soc., Ser. B 3 61 1999 611 6222
34. D. Tyler Asymptotic inference for eigenvectors Ann. Statist. 9 4 1981 725 736
35. P. Verveer, and R. Duin An evaluation of intrinsic dimensionality estimators IEEE Trans. Pattern Anal. Machine Intell. 17 1 1995 81 86
36. Welling, M., Agakov, F., Williams, C., 2003. Extreme components analysis. In: 16th Annual Conf. on Neural Information Processing Systems.
37. C. Williams, and F. Agakov Products of Gaussians and probabilistic minor component analysis Neural Comput. 14 5 2002 1169 1182