Minimax rates of estimation for sparse PCA in high dimensions

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 1278-1286

  Vu, Vincent Q ^a   Lei, Jing ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

CLASS OF DISTRIBUTIONS; CONVERGENCE RATES; HIGH DIMENSIONS; HIGH-DIMENSIONAL; LOWER AND UPPER BOUNDS; MINIMAX ESTIMATIONS; NON-ASYMPTOTIC; PRINCIPAL COMPONENTS ANALYSIS;

PRINCIPAL COMPONENT ANALYSIS;

EID: 84898952632     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (27)

1. A. A. Amini and M. J. Wainwright. "Highdimensional analysis of semidefinite relaxations for sparse principal components". In: Annals of Statistics 37.5B (2009), pp. 2877-2921.
2. P. J. Bickel and E. Levina. "Covariance Regularization by Thresholding". In: Annals of Statistics 36.6 (2008), pp. 2577-2604.
3. P. J. Bickel and E. Levina. "Regularized estimation of large covariance matrices". In: Annals of Statistics 36.1 (2008), pp. 199-227.
4. L Birgé and P Massart. "Minimum contrast estimators on sieves: exponential bounds and rates of convergence". In: Bernoulli 4.3 (1998), pp. 329-375.
5. T. T. Cai, C.-H. Zhang, and H. H. Zhou. "Optimal rates of convergence for covariance matrix estimation". In: Annals of Statistics 38.4 (2010), pp. 2118-2144.
6. A. d'Aspremont, L. El Ghaoui, M. I. Jordan, and G. R. G. Lanckriet. "A direct formulation for sparse PCA using semidefinite programming". In: SIAM Review 49.3 (2007), pp. 434-448.
7. N. El Karoui. "Operator norm consistent estimation of large-dimensional sparse covariance matrices". In: Annals of Statistics 36.6 (2008), pp. 2717-2756.
8. Y. Gordon, A. Litvak, S. Mendelson, and A. Pajor. "Gaussian averages of interpolated bodies and applications to approximate reconstruction". In: Journal of Approximation Theory 149 (2007), pp. 59-73.
9. T. S. Han and S Verdú. "Generalizing the Fano inequality". In: IEEE Transactions on Information Theory 40 (1994), pp. 1247-1251.
10. A. J. Izenman. Modern Multivariate Statistical Techniques: Regression, Classification, and Manifold Learning. New York, NY: Springer, 2008.
11. I. M. Johnstone. "On the distribution of the largest eigenvalue in principal components analysis". In: Annals of Statistics 29.2 (2001), pp. 295-327.
12. I. M. Johnstone and A. Y. Lu. "On consistency and sparsity for principal components analysis in high dimensions". In: Journal of the American Statistical Association 104.486 (2009), pp. 682-693.
13. I. T. Jolliffe, N. T. Trendafilov, and M. Uddin. "A modified principal component technique based on the Lasso". In: Journal of Computational and Graphical Statistics 12 (2003), pp. 531-547.
14. L. Mackey. "Deflation methods for sparse PCA". In: Advances in Neural Information Processing Systems 21. Ed. by D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou. 2009, pp. 1017-1024.
15. P. Massart. Concentration Inequalities and Model Selection. Ed. by J. Picard. Springer-Verlag, 2007.
16. S. Mendelson. "Empirical processes with a bounded !1 diameter". In: Geometric and Functional Analysis 20.4 (2010), pp. 988-1027.
17. B. Nadler. "Finite sample approximation results for principal component analysis: A matrix perturbation approach". In: Annals of Statistics 36.6 (2008), pp. 2791-2817.
18. D. Paul. "Asymptotics of sample eigenstructure for a large dimensional spiked covariance model". In: Statistica Sinica 17 (2007), pp. 1617-1642.
19. D. Paul and I. Johnstone. "Augmented sparse principal component analysis for high dimensional Data". manuscript. 2007.
20. G. Raskutti,M. J. Wainwright, and B. Yu. "Minimax rates of estimation for high-dimensional linear regression over "q-balls". In: IEEE Transactions on Information Theory (2011). to appear.
21. H. Shen and J. Z. Huang. "Sparse principal component analysis via regularized low rank matrix approximation". In: Journal of Multivariate Analysis 99 (2008), pp. 1015-1034.
22. G. W. Stewart and J. Sun. Matrix Perturbation Theory. Academic Press, 1990.
23. M. Talagrand. The Generic Chaining. Springer-Verlag, 2005.
24. A. W. van der Vaart and J. A. Wellner. Weak Convergence and Empirical Processes. Springer-Verlag, 1996.
25. D. M. Witten, R. Tibshirani, and T. Hastie. "A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis". In: Biostatistics 10 (2009), pp. 515-534.
26. B. Yu. "Assouad, Fano, and Le Cam". In: Festschrift for Lucien Le Cam: Research Papers in Probability and Statistics. 1997, pp. 423-435.
27. H. Zou, T. Hastie, and R. Tibshirani. "Sparse principal component analysis". In: Journal of Computational and Graphical Statistics 15.2 (2006), pp. 265-286.