Consistency of sparse PCA in High Dimension, Low Sample Size contexts

Journal of Multivariate Analysis

Volumn 115, Issue , 2013, Pages 317-333

  Shen, Dan ^a   Shen, Haipeng ^a   Marron, J S ^a  

^a The University of North Carolina at Chapel Hill   (United States)

Author keywords

Consistency; High dimension; Low sample size; Sparse PCA

Indexed keywords

EID: 84869784137     PISSN: 0047259X     EISSN: 10957243     Source Type: Journal    
DOI: 10.1016/j.jmva.2012.10.007     Document Type: Article

References (43)

1. Acker A.F. Absolute continuity of eigenvectors of time-varying operators. Proceedings of the American Mathematical Society 1974, 42(1):198-201.
2. Ahn J., Lee M.H., Yoon Y.J. Clustering high dimension, low sample size data using the maximal data piling distance. Statistica Sinica 2012, 22(2):443-464.
3. Ahn J., Marron J.S., Muller K.M., Chi Y.Y. The high-dimension, low-sample-size geometric representation holds under mild conditions. Biometrika 2007, 94(3):760-766.
4. Amini A.A., Wainwright M.J. High-dimensional analysis of semidefinite relaxations for sparse principal components. The Annals of Statistics 2009, 37(5B):2877-2921.
5. Bickel P.J., Levina E. Covariance regularization by thresholding. The Annals of Statistics 2008, 36(6):2577-2604.
6. Bickel P.J., Levina E. Regularized estimation of large covariance matrices. The Annals of Statistics 2008, 36(1):199-227.
7. Bickel P.J., Ritov Y., Tsybakov A.B. Simultaneous analysis of Lasso and Dantzig selector. The Annals of Statistics 2009, 37(4):1705-1732.
8. Bühlmann P. Boosting for high-dimensional linear models. The Annals of Statistics 2006, 34(2):559-583.
9. Bunea F., Tsybakov A.B., Wegkamp M.H., Barbu A. Spades and mixture models. The Annals of Statistics 2010, 38(4):2525-2558.
10. Candes E., Tao T. The Dantzig selector: statistical estimation when p is much larger than n. The Annals of Statistics 2007, 35(6):2313-2351.
11. Casella G., Hwang J.T. Limit expressions for the risk of James-Stein estimators. Canadian Journal of Statistics 1982, 10(4):305-309.
12. d'Aspremont A., El Ghaoui L., Jordan M.I., Lanckriet G.R.G. A direct formulation for sparse PCA using semidefinite programming. SIAM Review 2007, 49(3):434-448.
13. Donoho D.L., Johnstone J.M. Ideal spatial adaptation by wavelet shrinkage. Biometrika 1994, 81(3):425-455.
14. Eckart C., Young G. The approximation of one matrix by another of lower rank. Psychometrika 1936, 1(3):211-218.
15. El Karoui N. Operator norm consistent estimation of large-dimensional sparse covariance matrices. The Annals of Statistics 2008, 36(6):2717-2756.
16. Fan J., Li R. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 2001, 96(456):1348-1360.
17. Hall P., Marron J.S., Neeman A. Geometric representation of high dimension, low sample size data. Journal of the Royal Statistical Society. Series B 2005, 67(3):427-444.
18. Johnstone I.M. On the distribution of the largest eigenvalue in principal components analysis. The Annals of Statistics 2001, 29(2):295-327.
19. Johnstone I.M., Lu A.Y. On consistency and sparsity for principal components analysis in high dimensions. Journal of the American Statistical Association 2009, 104(486):682-693.
20. Jung S., Marron J.S. PCA consistency in high dimension. Low sample size context. The Annals of Statistics 2009, 37(6B):4104-4130.
21. S. Jung, A. Sen, J.S. Marron, Boundary behavior in high dimension, low sample size asymptotics of PCA, Technical Report, UNC-CH, 2012.
22. Leadbetter M.R., Lindgren G., Rootzén H. Extremes and Related Properties of Random Sequences and Processes 1983, Springer-Verlag, New York.
23. Lee Y.K., Lee E.R., Park B.U. Principal component analysis in very high-dimensional spaces. Statistica Sinica 2012, 22:933-956.
24. Lee M., Shen H., Huang J.Z., Marron J.S. Biclustering via sparse singular value decomposition. Biometrics 2010, 66(4):1087-1095.
25. Lee S., Zou F., Wright F.A. Convergence and prediction of principal component scores in high-dimensional settings. Annals of Statistics 2010, 38(6):3605-3629.
26. Leng C., Wang H. On general adaptive sparse principal component analysis. Journal of Computational and Graphical Statistics 2009, 18(1):201-215.
27. Z. Ma, Sparse principal component analysis and iterative thresholding, Technical Report, UPenn, 2012.
28. Meier L., van de Geer S., Bühlmann P. High-dimensional additive modeling. The Annals of Statistics 2009, 37(6B):3779-3821.
29. Meinshausen N., Bühlmann P. High-dimensional graphs and variable selection with the lasso. The Annals of Statistics 2006, 34(3):1436-1462.
30. Obozinski G., Wainwright M.J., Jordan M.I. Support union recovery in high-dimensional multivariate regression. The Annals of Statistics 2011, 39(1):1-47.
31. Omidiran D., Wainwright M.J. High-dimensional variable selection with sparse random projections: measurement sparsity and statistical efficiency. The Journal of Machine Learning Research 2010, 99:2361-2386.
32. Paul D. Asymptotics of sample eigenstructure for a large dimensional spiked covariance model. Statistica Sinica 2007, 17(4):1617-1642.
33. D. Paul, I. Johnstone, Augmented sparse principal component analysis for high-dimensional data, Technical Report, UC Davis, 2007.
34. Schwarz G. Estimating the dimension of a model. The Annals of Statistics 1978, 6(2):461-464.
35. Shen H., Huang J.Z. Sparse principal component analysis via regularized low rank matrix approximation. Journal of Multivariate Analysis 2008, 99(6):1015-1034.
36. D. Shen, H. Shen, J.S. Marron, Consistency of sparse PCA in high dimension, low sample size contexts: additional simulation results, 2012. Available online at: http://www.unc.edu/~dshen/RSPCA/SupplementB.html.
37. D. Shen, H. Shen, J.S. Marron, Consistency of sparse PCA in high dimension, low sample size contexts: supplement materials, 2012. Available online at: http://www.unc.edu/~dshen/RSPCA/SupplementA.pdf.
38. Tibshirani R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B 1996, 58:267-288.
39. van de Geer S.A. High-dimensional generalized linear models and the lasso. The Annals of Statistics 2008, 36(2):614-645.
40. Witten D.M., Tibshirani R., Hastie T. A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis. Biostatistics 2009, 10(3):515-534.
41. Yata K., Aoshima M. Effective PCA for high-dimension, low-sample-size data with noise reduction via geometric representations. Journal of Multivariate Analysis 2012, 105(1):193-215.
42. Zou H., Hastie T., Tibshirani R. Sparse principal component analysis. Journal of Computational and Graphical Statistics 2006, 15(2):265-286.
43. Zou H., Hastie T., Tibshirani R. On the "degrees of freedom" of the lasso. The Annals of Statistics 2007, 35(5):2173-2192.