Determining the number of components in a factor model from limited noisy data

Chemometrics and Intelligent Laboratory Systems

Volumn 94, Issue 1, 2008, Pages 19-32

  Kritchman, Shira ^a   Nadler, Boaz ^a  

^a WEIZMANN INSTITUTE OF SCIENCE   (Israel)

Author keywords

Number of components in a mixture; Principal component analysis; Pseudorank estimation; Random matrix theory; Tracy Widom distribution

Indexed keywords

ALGORITHM; ARTICLE; CHEMOMETRICS; MATHEMATICAL MODEL; NOISE MEASUREMENT; PRIORITY JOURNAL; SIGNAL NOISE RATIO; SIMULATION; STRUCTURAL EQUATION MODELING; THEORETICAL STUDY;

EID: 50249159453     PISSN: 01697439     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chemolab.2008.06.002     Document Type: Article

References (37)

1. Anderson T.W. An Introduction to Multivariate Statistical Analysis (1984), Wiley, New York
2. Baik J., and Silverstein J.W. Eigenvalues of large sample covariance matrices of spiked population models. Journal of Multivariate Analysis 97 6 (2006) 1382-1408
3. Elbergali A., Nygren J., and Kubista M. An automated procedure to predict the number of components in spectroscopic data. Analytica Chimica Acta 379 (1999) 143-158
4. Faber K., and Kowalski B.R. Modification of Malinowski's F-test for abstract factor analysis applied to the quail roost ii data sets. Journal of Chemometrics 11 (1997) 53-72
5. Faber N.M., Buydens L.M.C., and Kateman G. Aspects of pseudorank estimation methods based on the eigenvalues of principal component analysis of random matrices. Chemometrics and Intelligent Laboratory Systems 25 (1994) 203-226
6. Fishler E., Grosmann M., and Messer H. Detection of signals by information theoretic criteria: general asymptotic performance analysis. IEEE Transactions on Signal Processing 50 (2002) 1027-1036
7. Henry R.C., Park E.S., and Spiegelman C.H. Comparing a new algorithm with the classic methods for estimating the number of factors. Chemometrics and Intelligent Laboratory Systems 48 (1999) 91-97
8. James A.T. Inference on latent roots by calculation of hypergeometric functions of matrix argument. Multivariate Analysis (1966) 209-235
9. Jiang J.-H., Liang Y., and Ozaki Y. Principles and methodologies in self-modeling curve resolution. Chemometrics and Intelligent Laboratory Systems 71 (2004) 1-12
10. Johansson K. Shape fluctuations and random matrices. Communications in Mathematical Physics 209 2 (2000) 437-476
11. Johnstone I.M. On the distribution of the largest eigenvalue in principal components analysis. Annals of Statistics 29 2 (2001) 295-327
12. Johnstone I.M. High dimensional statistical inference and random matrices. Proc. International Congress of Mathematicians (2006)
13. Jolliffe I.T. Principal Component Analysis (2002), Springer, New York
14. El Karoui N. A rate of convergence result for the largest eigenvalue of complex white wishart matrices. Annals of Probability 34 6 (2006) 2077-2117
15. Konstantinides K., and Yao K. Statistical analysis of effective singular values in matrix rank determination. IEEE Transactions on Acoustics, Speech and Signal Processing 36 5 (1988) 757-763
16. Krzanowski W.J. Principles of Multivariate Analysis (1988), Oxford University Press
17. Lawley D.N. Tests of significance for the latent roots of covariance and correlation matrices. Biometrika 43 (1956) 128-136
18. Levina E., Wagaman A.S., Callender A.F., Mandair G.S., and Morris M.D. Estimating the number of pure chemical components in a mixture by maximum likelihood. Journal of Chemometrics 21 1-2 (2007) 24-34
19. Malinowski E.R. Determination of the number of factors and the experimental error in a data matrix. Analytical Chemistry 49 (1977) 612-617
20. Malinowski E.R. Theory of error in factor analysis. Analytical Chemistry 49 (1977) 606-612
21. Malinowski E.R. Statistical F-tests for abstract factor analysis and target testing. Journal of Chemometrics 3 (1989) 49-60
22. Marcenko V.A., and Pastur L.A. Distribution for some sets of random matrices. Math USSR-Sb (1967) 457-483
23. Meloun M., Capek J., Miksik P., and Brereton R.G. Critical comparison of methods predicting the number of components in spectroscopic data. Analytica Chimica Acta 423 (2000) 51-68
24. Minka T.P. Automatic choice of dimensionality for PCA. In: Leen T.K., Dietterich T.G., and Muller K.-R. (Eds). Advanced in Neural Information Processing Systems vol. 13 (2001) 598604
25. B. Nadler. Finite sample approximation results for principal component analysis: A matrix perturbation approach. to appear, Annals of Statistics, 2008.
26. Nadler B., and Coifman R.R. Partial least squares, Beer law and the net analyte signal: statistical modeling and analysis. Journal of Chemometrics 19 (2005) 45-54
27. Nadler B., and Coifman R.R. The prediction error in CLS and PLS: the importance of feature selection prior to multivariate calibration. Journal of Chemometrics 19 (2005) 107-118
28. Naes T., Isaksson T., Fearn T., and Davies T. User-friendly Guide to Multivariate Calibration and Classification (2002), NIR Publications, Chichester
29. Paul D. Asymptotics of sample eigenstructure for a large dimensional spiked covariance model. Statistica Sinica 17 (2007) 1617-1642
30. Raj Rao D., and Edelman A. Sample eigenvalue based detection of high-dimensional signals in white noise using relatively few samples. IEEE Transactions of Signal Processing 56 7 (2008) 2625-2638
31. Roy S.N. On a heuristic method of test construction and its use in multivariate analysis. Annals of Mathematical Statistics 24 2 (1953) 220-238
32. Schott J.R. A high-dimensional test for the equality of the smallest eigenvalues of a covariance matrix. Journal of Multivariate Analysis 97 4 (2006) 827-843
33. Spiegelman C.H., McShane M.J., Goetz M.J., Motamedi M., Yue Q.L., and Cote G.L. Theoretical justification of wavelength selection in pls calibration: development of a new algorithm. Analytical Chemistry 70 1 (1998) 35-44
34. Wax M., and Kailath T. Detection of signals by information theoretic criteria. IEEE Transactions on Acoustics, Speech and Signal Processing 33 2 (1985) 387-392
35. Jiang J.-H., Li Y., Qian J.-Y., Chen Z.-P., Liang Y.-Z., and Yu R.-Q. Determination of the number of components in mixtures using a new approach incorporating chemical information. Journal of Chemometrics 13 (1999) 15-30
36. Zhao L.C., Krishnaiah P.R., and Bai Z.D. On detection of the number of signals in presence of white noise. Journal of Multivariate Analysis 20 (1986) 1-25
37. S. Kritchman, B. Nadler, Detection of the number of signals, statistical hypothesis testing and random matrix theory (in preparation).