The spectrum of kernel random matrices

Annals of Statistics

Volumn 38, Issue 1, 2010, Pages 1-50

  Karoui, Noureddine El ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Concentration of measure; Covariance matrices; Eigenvalues of covariance matrices; Hadamard matrix functions; High dimensional inference; Kernel matrices; Machine learning; Multivariate statistical analysis; Random matrix theory

Indexed keywords

EID: 73949087548     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/08-AOS648     Document Type: Article

References (45)

1. ANDERSON, T. W. (2003). An Introduction to Multivariate Statistical Analysis, 3rd ed. Wiley, Hoboken, NJ. MR1990662
2. BACH, F. R. and JORDAN, M. I. (2003). Kernel independent component analysis. J. Mach. Learn. Res. 3 1-48. MR1966051
3. BAI, Z. D. (1999). Methodologies in spectral analysis of large-dimensional random matrices, a review. Statist. Sinica 9 611-677. MR1711663
4. BAI, Z. D., MIAO, B. Q. and PAN, G. M. (2007). On asymptotics of eigenvectors of large sample covariance matrix. Ann. Probab. 35 1532-1572. MR2330979
5. BAI, Z. D. and SILVERSTEIN, J. W. (1998). No eigenvalues outside the support of the limiting spectral distribution of large-dimensional sample covariance matrices. Ann. Probab. 26 316-345. MR1617051
6. BAI, Z. D. and SILVERSTEIN, J. W. (1999). Exact separation of eigenvalues of largedimensional sample covariance matrices. Ann. Probab. 27 1536-1555. MR1733159
7. BAIK, J., BEN AROUS, G. and PÉCHÉ, S. (2005). Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices. Ann. Probab. 33 1643-1697. MR2165575
8. BAIK, J. and SILVERSTEIN, J. (2006). Eigenvalues of large sample covariance matrices of spiked population models. J. Multivariate Anal. 97 1382-1408. MR2279680
9. BELKIN, M. and NIYOGI, P. (2009). Convergence of Laplacian eigenmaps. Preprint.
10. BHATIA, R. (1997). Matrix Analysis. Graduate Texts in Mathematics 169. Springer, New York. MR1477662
11. BOGOMOLNY, E., BOHIGAS, O. and SCHMIT, C. (2003). Spectral properties of distance matrices. J. Phys. A 36 3595-3616. MR1986436
12. BORDENAVE, C. (2008). Eigenvalues of Euclidean random matrices. Random Structures Algorithms 33 515-532. Available at http://arxiv.org/abs/math/ 0606624. MR2462254
13. BOUTET DE MONVEL, A., KHORUNZHY, A. and VASILCHUK, V. (1996). Limiting eigenvalue distribution of random matrices with correlated entries. Markov Process. Related Fields 2 607-636. MR1431189
14. BURDA, Z., JURKIEWICZ, J. andWACłAW, B. (2005). Spectral moments of correlated Wishart matrices. Phys. Rev. E 71 026111.
15. CRESSIE, N. A. C. (1993). Statistics for Spatial Data. Wiley, New York. MR1239641
16. EL KAROUI, N. (2003). On the largest eigenvalue of Wishart matrices with identity covariance when n,p and p/n→∞. Available at arXiv:math.ST/0309355.
17. EL KAROUI, N. (2007). Tracy-Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices. Ann. Probab. 35 663-714. MR2308592
18. EL KAROUI, N. (2008). Operator norm consistent estimation of large-dimensional sparse covariance matrices. Ann. Statist. 36 2717-2756. MR2485011
19. EL KAROUI, N. (2009). Concentration of measure and spectra of random matrices:With applications to correlation matrices, elliptical distributions and beyond. Ann. Appl. Probab. 19 2362-2405.
20. FORRESTER, P. J. (1993). The spectrum edge of random matrix ensembles. Nuclear Phys. B 402 709-728. MR1236195
21. GEMAN, S. (1980). A limit theorem for the norm of random matrices. Ann. Probab. 8 252-261. MR0566592
22. GERONIMO, J. S. and HILL, T. P. (2003). Necessary and sufficient condition that the limit of Stieltjes transforms is a Stieltjes transform. J. Approx. Theory 121 54-60. MR1962995
23. GOHBERG, I., GOLDBERG, S. and KRUPNIK, N. (2000). Traces and Determinants of Linear Operators. Operator Theory: Advances and Applications. 116 Birkhäuser, Basel. MR1744872
24. HORN, R. A. and JOHNSON, C. R. (1990). Matrix Analysis. Cambridge Univ. Press, Cambridge. MR1084815
25. HORN, R. A. and JOHNSON, C. R. (1994). Topics in Matrix Analysis. Cambridge Univ. Press, Cambridge. MR1288752
26. JOHANSSON, K. (2000). Shape fluctuations and random matrices. Comm. Math. Phys. 209 437-476. MR1737991
27. JOHNSTONE, I. (2001). On the distribution of the largest eigenvalue in principal component analysis. Ann. Statist. 29 295-327. MR1863961
28. KOLTCHINSKII, V. and GINÉ, E. (2000). Random matrix approximation of spectra of integral operators. Bernoulli 6 113-167. MR1781185
29. LEDOUX, M. (2001). The concentration of measure phenomenon. Mathematical Surveys and Monographs 89. Amer. Math. Soc., Providence, RI. MR1849347
30. MARČENKO, V. A. and PASTUR, L. A. (1967). Distribution of eigenvalues in certain sets of random matrices. Mat. Sb. (N.S.) 72 507-536. MR0208649
31. PAUL, D. (2007). Asymptotics of sample eigenstructure for a large-dimensional spiked covariance model. Statist. Sinica 17 1617-1642. MR2399865
32. PAUL, D. and SILVERSTEIN, J. (2009). No eigenvalues outside the support of the limiting empirical spectral distribution of a separable covariance matrix. J. Multivariate Anal. 100 37-57. MR2460475
33. RASMUSSEN, C. E. andWILLIAMS, C. K. I. (2006). Gaussian Processes for Machine Learning. MIT Press, Cambridge, MA. MR2514435
34. SCHECHTMAN, G. and ZINN, J. (2000). Concentration on the lpn ball. In Geometric Aspects of Functional Analysis. Lecture Notes in Mathematics 1745 245-256. Springer, Berlin. MR1796723
35. SCHÖLKOPF, B. and SMOLA, A. J. (2002). Learning with Kernels. MIT Press, Cambridge, MA. MR1949972
36. SCHÖLKOPF, B., TSUDA, K. and VERT, J. P. (2004). Kernel Methods in Computational Biology. MIT Press, Cambridge, MA.
37. SILVERSTEIN, J. W. (1995). Strong convergence of the empirical distribution of eigenvalues of large-dimensional random matrices. J. Multivariate Anal. 55 331-339. MR1370408
38. TRACY, C. and WIDOM, H. (1994). Level-spacing distribution and the Airy kernel. Comm. Math. Phys. 159 151-174. MR1257246
39. TRACY, C. and WIDOM, H. (1996). On orthogonal and symplectic matrix ensembles. Comm. Math. Phys. 177 727-754. MR1385083
40. TRACY, C. andWIDOM, H. (1998). Correlation functions, cluster functions and spacing distributions for random matrices. J. Stat. Phys. 92 809-835. MR1657844 (Pubitemid 128361701)
41. VOICULESCU, D. (2000). Lectures on free probability theory. In Lectures on Probability Theory and Statistics (Saint-Flour, 1998). Lecture Notes in Mathematics 1738 279-349. Springer, Berlin. MR1775641
42. WACHTER, K. W. (1978). The strong limits of random matrix spectra for sample matrices of independent elements. Ann. Probab. 6 1-18. MR0467894
43. WIGNER, E. (1955). Characteristic vectors of bordered matrices with infinite dimensions. Ann. of Math. (2) 62 548-564. MR0077805
44. WILLIAMS, C. and SEEGER, M. (2000). The effect of the input density distribution on kernelbased classifiers. International Conference on Machine Learning 17 1159-1166.
45. YIN, Y. Q., BAI, Z. D. and KRISHNAIAH, P. R. (1988). On the limit of the largest eigenvalue of the large-dimensional sample covariance matrix. Probab. Theory Related Fields 78 509-521. MR0950344