Reconstruction from anisotropic random measurements

IEEE Transactions on Information Theory

Volumn 59, Issue 6, 2013, Pages 3434-3447

  Rudelson, Mark ^a   Zhou, Shuheng ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

1 minimization; Design matrices with uniformly bounded entries; restricted eigenvalue (RE) conditions; sparsity; sub Gaussian random matrices

Indexed keywords

COVARIANCE STRUCTURES; EIGEN-VALUE; LOW-DIMENSIONAL SUBSPACE; RANDOM MATRICES; REDUCTION PRINCIPLE; RESTRICTED ISOMETRIES; SPARSITY; UNIFORMLY BOUNDED;

COMPUTER APPLICATIONS; INFORMATION THEORY;

EIGENVALUES AND EIGENFUNCTIONS;

EID: 84877881209     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2013.2243201     Document Type: Article

References (33)

1. E. Candès and T. Tao, "Decoding by linear programming," IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4203-4215, Dec. 2005. (Pubitemid 41800353)
2. E. Candès and T. Tao, "Near optimal signal recovery from random projections: Universal encoding strategies?," IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5406-5425, Dec. 2006. (Pubitemid 46445381)
3. E. Candès and T. Tao, "The Dantzig selector: Statistical estimation when p is much larger than n," Ann. Statist., vol. 35, no. 6, pp. 2313-2351, 2007.
4. S. Chen, D. Donoho, and M. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Statist. Comput., vol. 20, pp. 33-61, 1998. (Pubitemid 128689501)
5. D. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
6. E. Candès, J. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Commun. Pure Appl. Math., vol. 59, no. 8, pp. 1207-1223, Aug. 2006. (Pubitemid 43988295)
7. D. Donoho, "For most large underdetermined systems of equations, the minimal-norm solution is also the sparsest solution," Commun. Pure Appl. Math., vol. 59, no. 6, pp. 797-829, 2006. (Pubitemid 43667226)
8. M. Rudelson and R. Vershynin, "Sparse reconstruction by convex relaxation: Fourier and Gaussian measurements," in Proc. 40th Annu. Conf. Inf. Sci. Syst., Mar. 2006, pp. 207-212.
9. M. Rudelson and R. Vershynin, "On sparse reconstruction fromFourier and Gaussian measurements," Commun. Pure Appl. Math., vol. 61, pp. 1025-1045, 2008.
10. M. Rudelson and R. Vershynin, "Geometric approach to error correcting codes and reconstruction of signals," Int. Math. Res. Notices, vol. 64, pp. 4019-4041, 2005. (Pubitemid 44178240)
11. R. G. Baraniuk, M. Davenport, R. A. DeVore, and M. B. Wakin, "A simple proof of the restricted isometry property for random matrices," Construct. Approx., vol. 28, no. 3, pp. 253-263, 2008.
12. S. Mendelson, A. Pajor, and N. Tomczak-Jaegermann, "Uniform uncertainty principle for Bernoulli and sub-Gaussian ensembles," Construct. Approx., vol. 28, no. 3, pp. 277-289, 2008.
13. R. Adamczak, A. E. Litvak, A. Pajor, and N. Tomczak-Jaegermann, Restricted Isometry Property of Matrices With Independent Columns and Neighborly Polytopes by Random Sampling 2009, 0904.4723v1.
14. P. Bickel, Y. Ritov, and A. Tsybakov, "Simultaneous analysis of Lasso and Dantzig selector," Ann. Statist., vol. 37, no. 4, pp. 1705-1732, 2009.
15. R. Tibshirani, "Regression shrinkage and selection via the Lasso," J. Roy. Statist. Soc. Ser. B, vol. 58, no. 1, pp. 267-288, 1996.
16. S. van de Geer and P. Buhlmann, "On the conditions used to prove oracle results for the Lasso," Electron. J. Statist., vol. 3, pp. 1360-1392, 2009.
17. G. Raskutti, M. Wainwright, and B. Yu, "Restricted nullspace and eigenvalue properties for correlated Gaussian designs," J. Mach. Learn. Res., vol. 11, pp. 2241-2259, 2010.
18. S. Zhou, Restricted Eigenvalue Conditions on Subgaussian Random Matrices 2009 [Online]. Available: http://arxiv.org/pdf/0912. 4045v2.pdf
19. Y. Gordon, "Some inequalities for Gaussian processes and applications," Israel J. Math., vol. 50, no. 4, pp. 265-289, 1985.
20. S. Zhou, S. van de Geer, and P. Bühlmann, Adaptive Lasso for High Dimensional Regression and Gaussian Graphical Modeling 2009, arXiv:0903.2515.
21. S. Mendelson, A. Pajor, and N. Tomczak-Jaegermann, "Reconstruction and subgaussian operators in asymptotic geometric analysis," Geometr. Funct. Anal., vol. 17, no. 4, pp. 1248-1282, 2007.
22. S. Zhou, P. Rütimann, M. Xu, and P. Bühlmann, "High-dimensional covariance estimation based on Gaussian graphical models," J. Mach. Learn. Res., vol. 12, pp. 2975-3026, 2011.
23. S. Zhou, J. Lafferty, and L.Wasserman, "Compressed and privacy sensitive sparse regression," IEEE Trans. Inf. Theory, vol. 55, no. 2, pp. 846-866, Feb. 2009.
24. G. Duncan and R. Pearson, "Enhancing access to microdata while protecting confidentiality: Prospects for the future," Statist. Sci., vol. 6, no. 3, pp. 219-232, Aug. 1991.
25. R. Vershynin, "Approximating the moments of marginals of high dimensional distributions," Ann. Probabil., vol. 39, pp. 1591-1606, 2011.
26. R. Vershynin, "How close is the sample covariance matrix to the actual covariance matrix?," J. Theor. Probabil., vol. 25, pp. 655-686, 2012.
27. R. Adamczak, R. Latala, A. E. Litvak, A. Pajor, and N. Tomczak-Jaegermann, Geometry of Log-Concave Ensembles of Random Matrices and Approximate Reconstruction 2011, 1103.0401v1.
28. G. Pisier, "Remarques sur un résultat non publié de b.Maurey," Semin. Funct. Anal.,École Polytech., Palaiseau, vol. 5, 1981.
29. M. Talagrand, "New concentration inequalities in product spaces," Invent. Math., vol. 126, pp. 505-563, 1996. (Pubitemid 126323770)
30. M. Ledoux and M. Talagrand, Probability in Banach Spaces: Isoperimetry and Processes. New York, NY, USA: Springer-Verlag, 1991.
31. V. D.Milman and G. Schechtman, Asymptotic Theory of Finite Dimensional Normed Spaces, ser. LectureNotes in Mathematics 1200. New York, NY, USA: Springer-Verlag, 1986.
32. M. Ledoux, The Concentration of Measure Phenomenon, ser. Mathematical Surveys and Monographs, 89. Providence, RI, USA: Amer. Math. Soc., 2001.
33. M. Talagrand, The Generic Chaining: Upper and Lower Bounds of Stochastic Processes. New York, NY, USA: Springer-Verlag, 2000.