Introduction to the non-asymptotic analysis of random matrices

Compressed Sensing: Theory and Applications

Volumn , Issue , 2009, Pages 210-268

  Vershynin, Roman ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COVARIANCE MATRIX; EIGENVALUES AND EIGENFUNCTIONS; GAUSSIAN DISTRIBUTION; MATRIX ALGEBRA; RANDOM VARIABLES; SIGNAL PROCESSING; STUDENTS;

CENTRAL LIMIT THEOREM; COMPUTER SCIENTISTS; COVARIANCE MATRICES; EXTREME EIGENVALUES; GRADUATE STUDENTS; RANDOM MATRIX THEORY; SINGULAR VALUES OF RANDOM MATRICES; THEORETICAL COMPUTER SCIENCE;

ASYMPTOTIC ANALYSIS;

EID: 84938533326     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9780511794308.006     Document Type: Chapter

References (84)

1. D. Achlioptas. Database-friendly random projections: Johnson-Lindenstrauss with binary coins, in: Special issue on PODS 2001 (Santa Barbara, CA). J Comput Syst Sci, 66:671-687, 2003.
2. R. Adamczak, A. Litvak, A. Pajor, and N. Tomczak-Jaegermann. Quantitative estimates of the convergence of the empirical covariance matrix in log-concave ensembles. J Am Math Soc, 23:535-561, 2010.
3. R. Adamczak, A. Litvak, A. Pajor, and N. Tomczak-Jaegermann. Restricted isometry property of matrices with independent columns and neighborly polytopes by random sampling. Const. Approx., to appear, 2010.
4. R. Ahlswede and A. Winter. Strong converse for identification via quantum channels. IEEE Trans. Inform. Theory, 48:569-579, 2002.
5. G. Anderson, A. Guionnet, and O. Zeitouni. An Introduction to Random Matrices. Cambridge: Cambridge University Press, 2009.
6. Z. Bai and J. Silverstein. Spectral Analysis of Large Dimensional Random Matrices. Second edition. New York: Springer, 2010.
7. Z. Bai, J. Silverstein, and Y. Yin. A note on the largest eigenvalue of a large-dimensional sample covariance matrix. J Multivariate Anal, 26:166-168, 1988.
8. Z. Bai and Y. Yin. Limit of the smallest eigenvalue of a large-dimensional sample covariance matrix. Ann Probab, 21:1275-1294, 1993.
9. K. Ball. An elementary introduction to modern convex geometry. Flavors of Geometry, pp. 1-58. Math. Sci. Res. Inst. Publ., 31, Cambridge: Cambridge University Press., 1997.
10. R. Baraniuk, M. Davenport, R. DeVore, and M. Wakin. A simple proof of the restricted isometry property for random matrices. Constr. Approx., 28:253-263, 2008.
11. S. Boucheron, O. Bousquet, and G. Lugosi. Concentration inequalities. Advanced Lectures in Machine Learning, eds. O. Bousquet, U. Luxburg, and G. Ratsch, 208-240. Springer, 2004.
12. J. Bourgain. Random points in isotropic convex sets, in: Convex Geometric Analysis, Berkeley, CA, 1996, pp. 53-58. Math. Sci. Res. Inst. Publ., 34, Cambridge: Cambridge University Press, 1999.
13. A. Buchholz. Operator Khintchine inequality in non-commutative probability. Math Ann, 319:1-16, 2001.
14. A. Buchholz. Optimal constants in Khintchine type inequalities for fermions, Rademachers and q-Gaussian operators. Bull Pol Acad Sci Math, 53:315-321, 2005.
15. V. V. Buldygin and Ju. V. Kozachenko. Sub-Gaussian random variables. Ukrainian Math J, 32:483-489, 1980.
16. E. Candes. The restricted isometry property and its implications for compressed sensing. C. R. Acad. Sci. Paris Ser. I, 346:589-592.
17. E. Candès and T. Tao. Decoding by linear programming. IEEE Trans Inform Theory, 51:4203-4215, 2005.
18. E. Candès and T. Tao. Near-optimal signal recovery from random projections: universal encoding strategies? IEEE Trans Inform Theory, 52:5406-5425, 2006.
19. O. Christensen. Frames and Bases. An Introductory Course. Applied and Numerical Harmonic Analysis. Boston, MA: Birkhauser Boston, Inc., 2008.
20. Compressive Sensing Resources, http://dsp.rice.edu/cs
21. K. R. Davidson and S. J. Szarek. Local operator theory, random matrices andBanach spaces, Handbook of the Geometry of Banach Spaces, vol. 1, pp. 317-366. Amsterdam: North- Holland, 2001.
22. V. de la Peña and E. Giné. Decoupling. From Dependence to Independence. Randomly Stopped Processes. U-statistics and Processes. Martingales and Beyond. New York: Springer-Verlag, 1999.
23. P. Deift and D. Gioev. Random Matrix Theory: Invariant Ensembles and Universality. Courant Lecture Notes in Mathematics, 18. Courant Institute of Mathematical Sciences, New York; Providence, RI: American Mathematical Society, 2009.
24. A. Dembo and O. Zeitouni. Large Deviations Techniques and Applications. Boston, MA: Jones and Bartlett Publishers, 1993.
25. P. Drineas, R. Kannan, and M. Mahoney. Fast Monte Carlo algorithms for matrices. I, IIIII. SIAM J Comput, 36:132-206, 2006.
26. R. Durrett. Probability: Theory and Examples. Belmont: Duxbury Press, 2005.
27. O. Feldheimand S. Sodin. A universality result for the smallest eigenvalues of certain sample covariance matrices. Geom Funct Anal, to appear, 2008.
28. M. Fornasier and H. Rauhut. Compressive sensing, in Handbook of Mathematical Methods in Imaging, eds. O. Scherzer, Springer, to appear, 2010.
29. Z. Furedi and J. Komlos. The eigenvalues of random symmetric matrices. Combinatorica, 1:233-241, 1981.
30. S. Geman. A limit theorem for the norm of random matrices. Ann. Probab., 8:252-261, 1980.
31. A. Giannopoulos. Notes on Isotropic Convex Bodies. Warsaw, 2003.
32. A. Giannopoulos and V. Milman. Concentration property on probability spaces. Adv. Math., 156:77-106, 2000.
33. A. Giannopoulos and V. Milman. Euclidean structure in finite dimensional normed spaces, in Handbook of the Geometry of Banach Spaces, vol. 1, pp. 707-779. Amsterdam: North- Holland, 2001.
34. G. Golub, M. Mahoney, P. Drineas, and L.-H. Lim. Bridging the gap between numerical linear algebra, theoretical computer science, and data applications. SIAM News, 9: Number 8, 2006.
35. Y. Gordon. On Dvoretzky's theorem and extensions of Slepian's lemma, in Israel Seminar on geometrical Aspects of Functional Analysis (1983/84), II. Tel Aviv: Tel Aviv University, 1984.
36. Y. Gordon. Some inequalities for Gaussian processes and applications. Israel JMath, 50:265-289, 1985.
37. Y. Gordon. Majorization of Gaussian processes and geometric applications. Probab. Theory Related Fields, 91:251-267, 1992.
38. I. Johnstone. On the distribution of the largest eigenvalue in principal components analysis. Ann Statist, 29:295-327, 2001.
39. J.-P. Kahane. Proprietes locales des fonctions a series de Fourier aleatoires. Studia Math, 19:1-25, 1960.
40. R. Kannan, L. Lovasz, and M. Simonovits. Isoperimetric problems for convex bodies and a localization lemma. Discrete Comput Geom, 13:541-559, 1995.
41. J. Kovacevic and A. Chebira. An Introduction to Frames. Foundations and Trends in Signal Processing. Now Publishers, 2008.
42. R. Latala. Some estimates of norms of random matrices. Proc Am Math Soc, 133, 1273-1282, 2005.
43. M. Ledoux. The Concentration of Measure Phenomenon. Mathematical Surveys and Monographs, 89. Providence: American Mathematical Society, 2005.
44. M. Ledoux. Deviation inequalities on largest eigenvalues, in Geometric Aspects of Functional Analysis, pp. 167-219. Lecture Notes in Math., 1910. Berlin: Springer, 2007.
45. M. Ledoux and M. Talagrand. Probability in Banach Spaces. Berlin: Springer-Verlag, 1991.
46. A. Litvak, A. Pajor, M. Rudelson, and N. Tomczak-Jaegermann. Smallest singular value of random matrices and geometry of random polytopes. Adv Math, 195:491-523, 2005.
47. F. Lust-Piquard and G. Pisier. Noncommutative Khintchine and Paley inequalities. Ark Mat, 29:241-260, 1991.
48. F. Lust-Piquard. Inegalites de Khintchine dans Cp(1 < p < ¥). C RAcad Sci Paris Ser I Math, 303:289-292, 1986.
49. J. Matousek. Lectures on Discrete Geometry. Graduate Texts in Mathematics, 212. New York: Springer-Verlag, 2002.
50. M. Meckes. Concentration of norms and eigenvalues of random matrices. J Funct Anal, 211:508-524, 2004.
51. M. L. Mehta. Random Matrices. Pure and Applied Mathematics (Amsterdam), 142. Amsterdam: Elsevier/Academic Press, 2004.
52. S. Mendelson. On weakly bounded empirical processes. Math. Ann., 340:293-314, 2008.
53. S. Mendelson, A. Pajor, and N. Tomczak-Jaegermann. Reconstruction and subgaussian operators in asymptotic geometric analysis. Geom Funct Anal, 17:1248-1282, 2007.
54. S. Mendelson, A. Pajor, and N. Tomczak-Jaegermann. Uniform uncertainty principle for Bernoulli and subgaussian ensembles. Constr Approx, 28:277-289, 2008.
55. V. D. Milman. A new proof of A. Dvoretzky's theorem on cross-sections of convex bodies. Funkcional Anal i Prilozhen, 5:28-37, 1974.
56. V. Milman and G. Schechtman. Asymptotic Theory of Finite-Dimensional Normed Spaces. With an appendix by M. Gromov. Lecture Notes in Mathematics, 1200. Berlin: Springer- Verlag, 1986.
57. G. Paouris. Concentration of mass on convex bodies. Geom Funct Anal, 16:1021-1049, 2006.
58. S. Peche and A. Soshnikov. On the lower bound of the spectral norm of symmetric random matrices with independent entries. Electron. Commun. Probab., 13:280-290, 2008.
59. V. V. Petrov. Sums of Independent Random Variables. New York-Heidelberg: Springer-Verlag, 1975.
60. G. Pisier. The Volume of Convex Bodies and Banach Space Geometry. Cambridge Tracts in Mathematics, 94. Cambridge: Cambridge University Press, 1989.
61. G. Pisier. Introduction to Operator Space Theory. London Mathematical Society Lecture Note Series, 294. Cambridge: Cambridge University Press, 2003.
62. H. Rauhut. Compressive sensing and structured random matrices, in Theoretical Foundations and Numerical Methods for Sparse Recovery, eds. M. Fornasier, Radon Series Comp Appl Math, vol 9, pp. 1-92. deGruyter, 2010.
63. M. Rudelson. Contact points of convex bodies. Israel J. Math., 101:93-124, 1997.
64. M. Rudelson. Almost orthogonal submatrices of an orthogonal matrix. Israel J Math, 111:143-155, 1999.
65. M. Rudelson. Random vectors in the isotropic position. J. Funct. Anal., 164:60-72, 1999.
66. M. Rudelson and R. Vershynin. Sampling from large matrices: an approach through geometric functional analysis. J ACM, 54, Art. 21, 2007.
67. M. Rudelson and R. Vershynin. On sparse reconstruction from Fourier and Gaussian measurements. Comm Pure Appl Math, 61:1025-1045, 2008.
68. M. Rudelson and R. Vershynin. Smallest singular value of a random rectangular matrix. Comm. Pure Appl Math, 62:1707-1739, 2009.
69. M. Rudelson and R. Vershynin. Non-asymptotic theory of random matrices: extreme singular values. Proce Int CongrMath, Hyderabad, India, to appear, 2010.
70. J. Silverstein. The smallest eigenvalue of a large-dimensional Wishart matrix. Ann Probab, 13:1364-1368, 1985.
71. A. Soshnikov. A note on universality of the distribution of the largest eigenvalues in certain sample covariance matrices. J Statist Phys, 108:1033-1056, 2002.
72. M. Talagrand. The supremum of some canonical processes. Am Math, 116:283-325, 1994.
73. M. Talagrand. Concentration of measure and isoperimetric inequalities in product spaces. Inst Hautes Etudes Sci Publ Math, 81:73-205, 1995.
74. M. Talagrand. A new look at independence. Ann. of Probab., 24:1-34, 1996.
75. M. Talagrand. The Generic Chaining. Upper and Lower Bounds of Stochastic Processes. Springer Monographs in Mathematics. Berlin: Springer-Verlag, 2005.
76. T. Tao and V. Vu. From the Littlewood-Offord problem to the circular law: universality of the spectral distribution of random matrices. Bull Am Math Soc (NS), 46:377-396, 2009.
77. J. Tropp. User-friendly tail bounds for sums of random matrices, submitted, 2010.
78. S. Vempala. Geometric random walks: a survey, in Combinatorial and Computational Geometry, pp. 577-616. Math Sci Res Inst Publ, 52. Cambridge: Cambridge University Press, 2005.
79. R. Vershynin. John's decompositions: selecting a large part. Israel J Math, 122:253-277, 2001.
80. R. Vershynin. Frame expansions with erasures: an approach through the non-commutative operator theory. Appl Comput Harmon Anal, 18:167-176, 2005.
81. R. Vershynin. Approximating the moments of marginals of high-dimensional distributions. Ann Probab, to appear, 2010.
82. R. Vershynin. How close is the sample covariance matrix to the actual covariance matrix? J Theor Probab, to appear, 2010.
83. V. Vu. Spectral norm of random matrices. Combinatorica, 27:721-736, 2007.
84. Y. Q. Yin, Z. D. Bai, and P. R. Krishnaiah. On the limit of the largest eigenvalue of the large-dimensional sample covariance matrix. Probab Theory Related Fields, 78:509-521, 1998.