On information plus noise kernel random matrices

Annals of Statistics

Volumn 38, Issue 5, 2010, Pages 3191-3216

  Karoui, Noureddine El ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Concentration of measure.; High dimensional inference; Kernel matrices; Machine learning; Multivariate statistical analysis; Random matrix theory

Indexed keywords

EID: 77957606259     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/10-AOS801     Document Type: Article

References (24)

1. ANDERSON, T.W. (2003). An Introduction to Multivariate Statistical Analysis, 3rd ed.Wiley, Hoboken, NJ. MR1990662
2. BACH, F. R. and JORDAN, M. I. (2003). Kernel independent component analysis. J. Mach. Learn. Res. 3 1-48. MR1966051
3. BAI, Z. D. (1999). Methodologies in spectral analysis of large-dimensional random matrices, a review. Statist. Sinica 9 611-677. MR1711663
4. BELKIN, M. and NIYOGI, P. (2003). Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15 1373-1396. Available at http://www.mitpressjournals.org/doi/abs/10.1162/089976603321780317.
5. BELKIN, M. and NIYOGI, P. (2008). Towards a theoretical foundation for Laplacian-based manifold methods. J. Comput. System Sci. 74 1289-1308. MR2460286
6. BHATIA, R. (1997). Matrix Analysis. Graduate Texts in Mathematics 169. Springer, New York. MR1477662
7. CRESSIE, N. A. C. (1993). Statistics for Spatial Data. Wiley, New York. MR1239641
8. EL KAROUI, N. (2008). Operator norm consistent estimation of large dimensional sparse covariance matrices. Ann. Statist. 36 2717-2756. MR2485011
9. EL KAROUI, N. (2009). Concentration of measure and spectra of random matrices: Applications to correlation matrices, elliptical distributions and beyond. Ann. Appl. Probab. 19 2362-2405. MR2588248
10. EL KAROUI, N. (2010). The spectrum of kernel random matrices. Ann. Statist. 38 1-50.
11. IZENMAN, A. J. (2008). Modern Multivariate Statistical Techniques. Springer, New York. MR2445017
12. JOHNSTONE, I. (2001). On the distribution of the largest eigenvalue in principal component analysis. Ann. Statist. 29 295-327. MR1863961
13. JOHNSTONE, I. M. (2007). High dimensional statistical inference and random matrices. In International Congress of Mathematicians I 307-333. Eur. Math. Soc., Zürich. MR2334195
14. KOLTCHINSKII, V. and GINÉ, E. (2000). Random matrix approximation of spectra of integral operators. Bernoulli 6 113-167. MR1781185
15. LEDOUX, M. (2001). The Concentration of Measure Phenomenon. Mathematical Surveys and Monographs 89. Amer. Math. Soc., Providence, RI. MR1849347
16. MARČENKO, V. A. and PASTUR, L. A. (1967). Distribution of eigenvalues in certain sets of random matrices. Mat. Sb. (N.S.) 72 507-536. MR0208649
17. RASMUSSEN, C. E. and WILLIAMS, C. K. I. (2006). Gaussian Processes for Machine Learning. MIT Press, Cambridge, MA. MR2514435
18. SCHECHTMAN, G. and ZINN, J. (2000). Concentration on the lnp ball. In Geometric Aspects of Functional Analysis. Lecture Notes in Math. 1745 245-256. Springer, Berlin. MR1796723
19. SCHÖLKOPF, B. and SMOLA, A. J. (2002). Learning with Kernels. MIT Press, Cambridge, MA.
20. STEWART, G.W. and SUN, J. G. (1990). Matrix Perturbation Theory. Academic Press, Boston, MA. MR1061154
21. VAN DER VAART, A. W. (1998). Asymptotic Statistics. Cambridge Univ. Press, Cambridge. MR1652247
22. VON LUXBURG, U., BELKIN, M. and BOUSQUET, O. (2008). Consistency of spectral clustering. Ann. Statist. 36 555-586. Available at http://dx.doi.org/ 10.1214/009053607000000640. MR2396807
23. WILLIAMS, C. and SEEGER, M. (2000). The effect of the input density distribution on kernel-based classifiers. International Conference on Machine Learning 17 1159-1166.
24. ZWALD, L., BOUSQUET, O. and BLANCHARD, G. (2004). Statistical properties of kernel principal component analysis. In Learning Theory. Lecture Notes in Computer Science 3120 594-608. Springer, Berlin. MR2177937