Consistency of restricted maximum likelihood estimators of principal components

Annals of Statistics

Volumn 37, Issue 3, 2009, Pages 1229-1271

  Paul, Debashis ^a   Peng, Jie ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Consistency; Functional data analysis; High dimensional data; Intrinsic geometry; Principal component analysis; Stiefel manifold

Indexed keywords

EID: 68649118122     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/08-AOS608     Document Type: Article

References (26)

1. ANTONIADIS, A. and SAPATINAS, T. (2007). Estimation and inference in functional mixedeffects models. Comput. Statist. Data Anal. 51 4793-4813. MR2364541
2. BICKEL, P. J. and LEVINA, E. (2008). Covariance regularization by thresholding. Ann. Statist. 36 2577-2604.
3. BICKEL, P. J. and LEVINA, E. (2008). Regularized estimation of large covariance matrices. Ann. Statist. 36 199-227. MR2387969
4. BURMAN, P. (1985). A data dependent approach to density estimation. Z. Wahrsch. Verw. Gebiete 69 609-628. MR0791915
5. CHEN, A. and BICKEL, P. J. (2006). Efficient independent component analysis. Ann. Statist. 34 2825-2855. MR2329469
6. DE BOOR, C. (1974). Bounding the error in spline interpolation. SIAM Rev. 16 531-544. MR0361531
7. DE BOOR, C. (1978). A Practical Guide to Splines. Applied Mathematical Sciences 27. Springer, New York. MR0507062
8. DEVORE, R. A. and LORENTZ, G. G. (1993). Constructive Approximation. Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences] 303. Springer, Berlin. MR1261635
9. EL KAROUI, N. (2008). Operator norm consistent estimation of large-dimensional sparse covariance matrices. Ann. Statist. To appear.
10. DAVIDSON, K. R. and SZAREK, S. (2001). Local operator theory, random matrices and Banach spaces. In Handbook on the Geometry of Banach spaces (W. B. Johnson and J. Lendenstrauss, eds.) 1 317-366. North-Holland, Amsterdam. MR1863696
11. EDELMAN, A., ARIAS, T. A. and SMITH, S. T. (1998). The geometry of algorithms with orthogonality constraints. SIAM J. Matrix Anal. Appl. 20 303-353. MR1646856
12. FAN, J., FAN, Y. and LV, J. (2008). High-dimensional covariance matrix estimation using a factor model. J. Econometrics 147 186-197.
13. FERRATY, F. and VIEU, P. (2006). Nonparametric Functional Data Analysis: Theory and Practice. Springer, New York. MR2229687
14. HALL, P. and HOSSEINI-NASAB, M. (2006). On properties of functional principal components analysis. J. R. Stat. Soc. Ser. B Stat. Methodol. 68 109-126. MR2212577
15. HALL, P.,MÜLLER, H.-G. and WANG, J.-L. (2006). Properties of principal component methods for functional and longitudinal data analysis. Ann. Statist. 34 1493-1517. MR2278365
16. HORN, R. A. and JOHNSON, C. R. (1994). Topics in Matrix Analysis. Cambridge Univ. Press, Cambridge. MR1288752
17. JAMES, G. M., HASTIE, T. J. and SUGAR, C. A. (2000). Principal component models for sparse functional data. Biometrika 87 587-602. MR1789811
18. KATO, T. (1980). Perturbation Theory of Linear Operators, 2nd ed. Springer, Berlin. MR0407617
19. MUIRHEAD, R. J. (1982). Aspects of Multivariate Statistical Theory. Wiley, New York. MR0652932
20. OLLER, J. M. and CORCUERA, J. M. (1995). Intrinsic analysis of statistical estimation. Ann. Statist. 23 1562-1581. MR1370296
21. PAUL, D. (2005). Nonparametric estimation of principal components. Ph.D. dissertation, Stanford Univ.
22. PAUL, D. and JOHNSTONE, I. M. (2007). Augmented sparse principal component analysis for high-dimensional data. Working paper. Available at http://anson.ucdavis.edu/̃debashis/techrep/augmented-spca.pdf.
23. PENG, J. and PAUL, D. (2007). A geometric approach to maximum likelihood estimation of covariance kernel from sparse irregular longitudinal data. Technical report. arXiv:0710.5343v1. Avaialble at http://anson.ucdavis.edu/̃jie/pd-cov-likelihood-technical.pdf.
24. RAMSAY, J. and SILVERMAN, B. W. (2005). Functional Data Analysis, 2nd ed. Springer, New York. MR2168993
25. YANG, A. and BARRON, A. (1999). Information-theoretic determination of minimax rates of convergence. Ann. Statist. 27 1564-1599. MR1742500
26. YAO, F.,MÜLLER, H.-G. and WANG, J.-L. (2005). Functional data analysis for sparse longitudinal data. J. Amer. Statist. Assoc. 100 577-590. MR2160561