Support recovery with sparsely sampled free random matrices

IEEE Transactions on Information Theory

Volumn 59, Issue 7, 2013, Pages 4243-4271

  Tulino, Antonia M ^a   Caire, Giuseppe ^b   Verdu, Sergio ^c   Shamai, Shlomo ^d  

^a LUCENT TECHNOLOGIES   (United States)

^b University of Southern California ^*  (United States)

^c Princeton University   (United States)

^d TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Compressed sensing; free probability; random matrices; rate distortion theory; sparse models; support recovery

Indexed keywords

FREE PROBABILITIES; RANDOM MATRICES; RATE-DISTORTION THEORY; SPARSE MODELS; SUPPORT RECOVERIES;

COMPRESSED SENSING; GAUSSIAN NOISE (ELECTRONIC); RECOVERY;

MATRIX ALGEBRA;

EID: 84879984876     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2013.2250578     Document Type: Article

References (41)

1. A. M. Tulino and S.Verdú, "Randommatrix theory and wireless communications," Found. Trends Commun. Inf. Theory, vol. 1, no. 1, pp. 1-184, 2004.
2. S. Aeron, V. Saligrama, and M. Zhao, "Information theoretic bounds for compressed sensing," IEEE Trans. Inf. Theory, vol. 56, no. 10, pp. 5111-5130, Oct. 2010.
3. M. Akcakaya and V. Tarokh, "Shannon-theoretic limits on noisy compressive sampling," IEEE Trans. Inf. Theory, vol. 56, no. 1, pp. 492-504, Jan. 2009.
4. A. K. Fletcher, S. Rangan, and V. K. Goyal, "Necessary and sufficient conditions for sparsity pattern recovery," IEEE Trans. Inf. Theory, vol. 55, no. 12, pp. 5758-5772, Dec. 2009.
5. K. R.Rad, "Nearly sharp sufficient conditions on exact sparsity pattern recovery," IEEE Trans. Inf. Theory, vol. 57, no. 7, pp. 4672-4679, Jul. 2011.
6. M. J. Wainwright, "Information theoretic limitations on sparsity recovery in the high-dimensional and noisy setting," IEEE Trans. Inf. Theory, vol. 55, no. 12, pp. 5728-5741, Dec. 2009.
7. W. Wang, M. J. Wainwright, and K. Ramchandran, "Information- theoretic limits on sparse signal recovery: Dense versus sparse measurement matrices," IEEE Trans. Inf. Theory, vol. 56, no. 6, pp. 2967-2979, Jun. 2010.
8. G. Reeves, "Sparsity pattern recovery in compressed sensing," Ph.D. dissertation, Dept. Electr. Eng. Comput. Sci., Univ. California, Berkeley, CA, USA, 2011.
9. G. Reeves and M. Gastpar, "Fundamental Tradeoffs for Sparsity Pattern Recovery," Jun. 2010 [Online]. Available: Arxiv 1006.3128v1
10. G. Reeves and M. Gastpar, "The sampling rate-distortion tradeoff for sparsity pattern recovery in compressed sensing," IEEE Trans. Inf. Theory, vol. 58, no. 5, pp. 3065-3092, May 2012.
11. G. Reeves and M. Gastpar, "Approximate Sparsity Pattern Recovery: Information-Theoretic Lower Bounds," Feb. 2010 [Online]. Available: arXiv:1002.4458v1 [cs.IT]
12. M. Bayati and A. Montanari, "The dynamics of message passing on dense graphs, with applications to compressed sensing," IEEE Trans. Inf. Theory, vol. 57, no. 2, pp. 764-785, Feb. 2011.
13. D. Guo and S. Verdú, "Randomly spread CDMA: Asymptotics via statistical physics," IEEE Trans. Inf. Theory, vol. 51, no. 6, pp. 1983-2010, Jun. 2005. (Pubitemid 40843621)
14. D. L. Donoho, "Precise optimality in compressed sensing: Rigorous theory and ultra fast algorithms," presented at the Workshop Inf. Theory Appl., La Jolla, CA, USA, 2011.
15. Y. Wu and S. Verdú, "Optimal phase transitions in compressed sensing," IEEE Trans. Inf. Theory, vol. 58, no. 10, pp. 6241-6263, Oct. 2012.
16. A.M. Tulino, G. Caire, S. Shamai, and S. Verdú, "Capacity of channels with frequency-selective and time-selective fading," IEEE Trans. Inf. Theory, vol. 56, no. 3, pp. 1187-1215, Mar. 2010.
17. T. Tanaka, "A statistical-mechanics approach to large-system analysis of CDMA multiuser detectors," IEEE Trans. Inf. Theory, vol. 48, no. 11, pp. 2888-2910, Nov. 2002. (Pubitemid 35327603)
18. S. Rangan, A. K. Fletcher, and V. K. Goyal, "Asymptotic analysis of MAP estimation via the replica method and applications to compressed sensing," IEEE Trans. Inf. Theory, vol. 58, no. 3, pp. 1902-1923, Mar. 2012.
19. D. Guo, D. Baron, and S. Shamai (Shitz), "A single-letter characterization of optimal noisy compressed sensing," presented at the 47th Annu. Aller. Conf. Commun., Control, Comput., Monticello, IL, USA, Sep./Oct. 30-2, 2009.
20. S. Shamai and S. Verdú, "The effect of frequency-flat fading on the spectral efficiency of CDMA," IEEE Trans. Inf. Theory, vol. 47, no. 4, pp. 1302-1327, May 2001. (Pubitemid 32508475)
21. Y. Wu and S. Verdú, "Rényi information dimension: Fundamental limits of almost lossless analog compression," IEEE Trans. Inf. Theory, vol. 56, no. 8, pp. 3721-3747, Aug. 2010.
22. R. Tibshirani, "Regression shrinkage and selection via the Lasso," J. Roy. Statist. Soc. Ser. B (Methodological), vol. 58, no. 1, pp. 267-288, 1996.
23. D. L. Donoho, A. Maleki, and A. Montanari, "Message passing algorithms for compressed sensing," Proc. Nat. Acad. Sci., vol. 106, no. 45, pp. 18914-18915, 2009.
24. Y. Wu and S. Verdú, "MMSE dimension," IEEE Trans. Inf. Theory, vol. 57, no. 8, pp. 4857-4879, Aug. 2011.
25. B. Wohlberg, "Noise sensitivity of sparse signal representations: Reconstruction error bounds for the inverse problem," IEEE Trans. Signal Process., vol. 51, no. 12, pp. 3053-3060, Dec. 2003.
26. D. L. Donoho, M. Elad, and V. N. Temlyakov, "Stable recovery of sparse overcomplete representations in the presence of noise," IEEE Trans. Inf. Theory, vol. 52, no. 1, pp. 6-18, Jan. 2006. (Pubitemid 43263116)
27. G. N. Lilis, D. Angelosante, and G. B. Giannakis, "Sound Field Reproduction using the Lasso," IEEE Trans. Audio, Speech Lang. Process., vol. 18, no. 8, pp. 1902-1912, Nov. 2010.
28. S. Sardy, A. Bruce, and P. Tseng, "Block coordinate relaxationmethods for nonparametric wavelet denoising," J. Comput. Graph. Statist., vol. 9, pp. 361-379, 2000.
29. D. Guo and T. Tanaka, "Generic multiuser detection and statistical physics," in Advances in Multiuser Detection, M. L. Honig, Ed. New York, NY, USA: Wiley-IEEE Press, 2009.
30. M. Mezard and A. Montanari, Information, Physics, and Computation. Oxford, U.K.: Oxford Univ. Press, 2009.
31. H. Nishimori, Statistical Physics of Spin Glasses and Information Processing: An Introduction. Oxford, U.K.: Oxford Univ. Press, 2001.
32. Harish-Chandra, "Differential operators on a semi-simple Lie algebra," Amer. J. Math., vol. 79, pp. 87-120, 1957.
33. C. Itzykson and J. B. Zuber, "Planar approximation 2," J. Math. Phys., vol. 21, pp. 411-421, 1980.
34. A. Guionnet and M. Maïda, "A Fourier view on the R-transform and related asymptotics of spherical integrals," J. Funct. Anal., vol. 222, pp. 435-490, 2005.
35. T. Tanaka, "Asymptotics of Harish-Chandra-Itzykson-Zuber integrals and free probability theory," J. Phys.: Conf. Ser., vol. 95, pp. 012002- 1-012002-19, Jan. 2008.
36. H. Cramér, "Sur un nouveau théorème-limite de la théorie des probabilités," Actualités Scientifiques et Industrielles, vol. 736, pp. 5-23, 1938.
37. J. Hubbard, "Calculation of partition functions," Phys. Rev. Lett., vol. 3, no. 2, pp. 77-78, 1959.
38. R. L. Stratonovich, "On a method of calculating quantum distribution functions," Soviet Phys. Doklady, vol. 2, p. 416, 1958.
39. D. Guo, S. Shamai, and S. Verdú, "Mutual information and minimum mean-square error in Gaussian channels," IEEE Trans. Inf. Theory, vol. 51, no. 4, pp. 1261-1283, Apr. 2005.
40. W. Feller, An Introduction to Probability Theory and Its Applications. New York, NY, USA: Wiley, 1968.
41. M. Abramowitz and I. A. Stegun, Handbook of Mathematical Functions: With Formulas, Graphs, and Mathematical Tables. NewYork, NY, USA: Dover, 1972.