Exact and Stable Covariance Estimation From Quadratic Sampling via Convex Programming

IEEE Transactions on Information Theory

Volumn 61, Issue 7, 2015, Pages 4034-4059

  Chen, Yuxin ^a   Chi, Yuejie ^b   Goldsmith, Andrea J ^b  

^a STANFORD UNIVERSITY   (United States)

^b The Ohio State University   (United States)

Author keywords

Covariance sketching; Energy measurements; Low rank; Phase retrieval; Phase tomography, RIP '2='1; Quadratic measurements; Rank one measurements; Sparsity; Toeplitz

Indexed keywords

CLUSTERING ALGORITHMS; COMMUNICATION CHANNELS (INFORMATION THEORY); CONVEX OPTIMIZATION; COVARIANCE MATRIX; DATA MINING; DIGITAL STORAGE; ELECTRIC POWER MEASUREMENT; INFORMATION THEORY; MATRIX ALGEBRA; PHASE SHIFTERS; PHASE SPACE METHODS; RELAXATION PROCESSES; TOMOGRAPHY; WIRELESS TELECOMMUNICATION SYSTEMS;

COVARIANCE SKETCHING; LOW RANK; PHASE RETRIEVAL; PHASE TOMOGRAPHY; SPARSITY; TOEPLITZ;

DATA HANDLING;

EID: 84933059585     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2015.2429594     Document Type: Article

References (61)

1. Y. Chen, Y. Chi, and A. J. Goldsmith, "Estimation of simultaneously structured covariance matrices from quadratic measurements", in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Florence, Italy, May 2014, pp. 7669-7673.
2. Y. Chen, Y. Chi, and A. J. Goldsmith, "Robust and universal covariance estimation from quadratic measurements via convex programming", in Proc. IEEE Int. Symp. Inf. Theory (ISIT), Honolulu, HI, USA, Jun./Jul. 2014, pp. 2017-2021.
3. R. Roy and T. Kailath, "ESPRIT-estimation of signal parameters via rotational invariance techniques", IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 7, pp. 984-995, Jul. 1989.
4. N. E. Karoui, "Operator norm consistent estimation of large-dimensional sparse covariance matrices", Ann. Statist., vol. 36, no. 6, pp. 2717-2756, 2008.
5. S. Muthukrishnan, Data Streams: Algorithms and Applications. Norwell, MA, USA: NOW Pub., 2005.
6. R. C. Daniels and R. W. Heath, "60 GHz wireless communications: Emerging requirements and design recommendations", IEEE Veh. Technol. Mag., vol. 2, no. 3, pp. 41-50, Sep. 2007.
7. A. Jung, G. Taubock, and F. Hlawatsch, "Compressive spectral estimation for nonstationary random processes", IEEE Trans. Inf. Theory, vol. 59, no. 5, pp. 3117-3138, May 2013.
8. G. Leus and Z. Tian, "Recovering second-order statistics from compressive measurements", in Proc. 4th IEEE Int. Workshop Comput. Adv. Multi-Sensor Adapt. Process. (CAMSAP), Dec. 2011, pp. 337-340.
9. D. D. Ariananda and G. Leus, "Compressive wideband power spectrum estimation", IEEE Trans. Signal Process., vol. 60, no. 9, pp. 4775-4789, Sep. 2012.
10. R. G. Gallager, Information Theory and Reliable Communication. New York, NY, USA: Wiley, 1968.
11. J. A. Tropp, J. N. Laska, M. F. Duarte, J. K. Romberg, and R. G. Baraniuk, "Beyond Nyquist: Efficient sampling of sparse bandlimited signals", IEEE Trans. Inf. Theory, vol. 56, no. 1, pp. 520-544, Jan. 2010.
12. L. L. Scharf and B. Friedlander, "Matched subspace detectors", IEEE Trans. Signal Process., vol. 42, no. 8, pp. 2146-2157, Aug. 1994.
13. M. G. Raymer, M. Beck, and D. McAlister, "Complex wave-field reconstruction using phase-space tomography", Phys. Rev. Lett., vol. 72, no. 8, p. 1137, Feb. 1994.
14. L. Tian, J. Lee, S. B. Oh, and G. Barbastathis, "Experimental compressive phase space tomography", Opt. Exp., vol. 20, no. 8, pp. 8296-8308, 2012.
15. E. J. Candès, T. Strohmer, and V. Voroninski, "PhaseLift: Exact and stable signal recovery from magnitude measurements via convex programming", Commun. Pure Appl. Math., vol. 66, no. 8, pp. 1241-1274, Aug. 2013.
16. Y. Shechtman, Y. C. Eldar, A. Szameit, and M. Segev, "Sparsity based sub-wavelength imaging with partially incoherent light via quadratic compressed sensing", Opt. Exp., vol. 19, no. 16, pp. 14807-14822, 2011.
17. I. Waldspurger, A. D'Aspremont, and S. Mallat. (2012). "Phase recovery, MaxCut and complex semidefinite programming." [Online]. Available: http://arxiv.org/abs/1206.0102
18. E. J. Candes, X. Li, and M. Soltanolkotabi, "Phase retrieval via Wirtinger flow: Theory and algorithms", IEEE Trans. Inf. Theory, vol. 61, no. 4, pp. 1985-2007, Apr. 2015.
19. Y. Shechtman, A. Beck, and Y. C. Eldar. (2013). "GESPAR: Efficient phase retrieval of sparse signals." [Online]. Available: http://arxiv.org/abs/1301.1018
20. P. Netrapalli, P. Jain, and S. Sanghavi, "Phase retrieval using alternating minimization", in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2013, pp. 2796-2804.
21. P. Schniter and S. Rangan, "Compressive phase retrieval via generalized approximate message passing", IEEE Trans. Signal Process., vol. 63, no. 4, pp. 1043-1055, Feb. 2015.
22. Y. Chen, X. Yi, and C. Caramanis, "A convex formulation for mixed regression with two components: Minimax optimal rates", in Proc. Conf. Learn. Theory (COLT), 2014, pp. 1-45.
23. E. J. Candès and X. Li, "Solving quadratic equations via PhaseLift when there are about as many equations as unknowns", Found. Comput. Math., vol. 14, no. 5, pp. 1017-1026, Oct. 2013.
24. X. Li and V. Voroninski, "Sparse signal recovery from quadratic measurements via convex programming", SIAM J. Math. Anal., vol. 45, no. 5, pp. 3019-3033, 2013.
25. M. Rudelson and R. Vershynin, "On sparse reconstruction from Fourier and Gaussian measurements", Commun. Pure Appl. Math., vol. 61, no. 8, pp. 1025-1045, Aug. 2008.
26. D. Gross, "Recovering low-rank matrices from few coefficients in any basis", IEEE Trans. Inf. Theory, vol. 57, no. 3, pp. 1548-1566, Mar. 2011.
27. Y.-K. Liu, "Universal low-rank matrix recovery from Pauli measurements", in Proc. Adv. Neural Inf. Process. Syst., 2011, pp. 1638-1646.
28. E. J. Candès and B. Recht, "Exact matrix completion via convex optimization", Found. Comput. Math., vol. 9, no. 6, pp. 717-772, Dec. 2009.
29. Y. Chen and Y. Chi, "Robust spectral compressed sensing via structured matrix completion", IEEE Trans. Inf. Theory, vol. 60, no. 10, pp. 6576-6601, Oct. 2014.
30. I. M. Johnstone, "High dimensional statistical inference and random matrices", in Proc. Int. Congr. Math., Madrid, Spain, Aug. 2006, pp. 307-333.
31. D. L. Donoho, "Compressed sensing", IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
32. E. J. Candes and T. Tao, "Near-optimal signal recovery from random projections: Universal encoding strategies?" IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5406-5425, Dec. 2006.
33. Z. Tian, Y. Tafesse, and B. M. Sadler, "Cyclic feature detection with sub-Nyquist sampling for wideband spectrum sensing", IEEE J. Sel. Topics Signal Process., vol. 6, no. 1, pp. 58-69, Feb. 2012.
34. D. Romero and G. Leus, "Wideband spectrum sensing from compressed measurements using spectral prior information", IEEE Trans. Signal Process., vol. 61, no. 24, pp. 6232-6246, Dec. 2013.
35. G. Dasarathy, P. Shah, B. N. Bhaskar, and R. Nowak. (2013). "Sketching sparse matrices." [Online]. Available: http://arxiv.org/abs/1303.6544
36. A. Beck and Y. C. Eldar, "Sparsity constrained nonlinear optimization: Optimality conditions and algorithms", SIAM J. Optim., vol. 23, no. 3, pp. 1480-1509, 2013.
37. K. Jaganathan, S. Oymak, and B. Hassibi, "Recovery of sparse 1-D signals from the magnitudes of their Fourier transform", in Proc. IEEE ISIT, Jul. 2012, pp. 1473-1477.
38. E. Oja, Subspace Methods of Pattern Recognition, vol. 4. U. K.: Research Studies Press, 1983.
39. I. Mitliagkas, C. Caramanis, and P. Jain, "Memory limited, streaming PCA", in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2013, pp. 2886-2894.
40. L. Balzano, R. Nowak, and B. Recht, "Online identification and tracking of subspaces from highly incomplete information", in Proc. Allerton, Sep./Oct. 2010, pp. 704-711.
41. Y. Chi, Y. C. Eldar, and R. Calderbank, "PETRELS: Parallel subspace estimation and tracking by recursive least squares from partial observations", IEEE Trans. Signal Process., vol. 61, no. 23, pp. 5947-5959, Dec. 2013.
42. M. Brand, "Incremental singular value decomposition of uncertain data with missing values", in Computer Vision-ECCV. Berlin, Germany: Springer-Verlag, 2002, pp. 707-720.
43. T. T. Cai and A. Zhang. (2014). "ROP: Matrix recovery via rank-one projections." [Online]. Available: http://arxiv.org/abs/1310.5791
44. B. Recht, M. Fazel, and P. A. Parrilo, "Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization", SIAM Rev., vol. 52, no. 3, pp. 471-501, 2010.
45. H. Ohlsson, A. Y. Yang, R. Dong, and S. S. Sastry. (2011). "Compressive phase retrieval from squared output measurements via semidefinite programming." [Online]. Available: http://arxiv.org/abs/1111.6323
46. E. J. Candès, "The restricted isometry property and its implications for compressed sensing", Comp. Rendus Math., vol. 346, nos. 9-10, pp. 589-592, May 2008.
47. G. W. Stewart and J.-G. Sun, "Matrix perturbation theory", 1990.
48. S. Jafarpour, W. Xu, B. Hassibi, and R. Calderbank, "Efficient and robust compressed sensing using optimized expander graphs", IEEE Trans. Inf. Theory, vol. 55, no. 9, pp. 4299-4308, Sep. 2009.
49. E. J. Candes and Y. Plan, "Tight Oracle inequalities for low-rank matrix recovery from a minimal number of noisy random measurements", IEEE Trans. Inf. Theory, vol. 57, no. 4, pp. 2342-2359, Apr. 2011.
50. R. Baraniuk, M. Davenport, R. De Vore, and M. Wakin, "A simple proof of the restricted isometry property for random matrices", Constructive Approx., vol. 28, no. 3, pp. 253-263, Dec. 2008.
51. M. Talagrand, "Majorizing measures: The generic chaining", Ann. Probab., vol. 24, no. 3, pp. 1049-1103, Jul. 1996.
52. E. J. Candes and Y. Plan, "A probabilistic and RIPless theory of compressed sensing", IEEE Trans. Inf. Theory, vol. 57, no. 11, pp. 7235-7254, Nov. 2011.
53. T. Tao, Topics in Random Matrix Theory (Graduate Studies in Mathematics). Providence, RI, USA: AMS, 2012.
54. L. Demanet and P. Hand. (2012). "Stable optimizationless recovery from phaseless linear measurements." [Online]. Available: http://arxiv.org/abs/1208.1803
55. U. Grenander and G. Szego, Toeplitz Forms and Their Applications. Oakland, CA, USA: Univ. California Press, 1958.
56. R. Vershynin, "Introduction to the non-asymptotic analysis of random matrices", Compress. Sens., Theory Appl., pp. 210-268, 2012.
57. D. L. Hanson and F. T. Wright, "A bound on tail probabilities for quadratic forms in independent random variables", Ann. Math. Statist., vol. 42, no. 3, pp. 1079-1083, 1971.
58. M. Rudelson and R. Vershynin. (Jun. 2013). "Hanson-Wright inequality and sub-Gaussian concentration. " [Online]. Available: http://arxiv.org/abs/1306.2872
59. D. Hsu, S. M. Kakade, and T. Zhang, "A tail inequality for quadratic forms of sub-Gaussian random vectors", Electron. Commun. Probab., vol. 17, no. 52, pp. 1-6, Nov. 2012.
60. M. Ledoux and M. Talagrand, Probability in Banach Spaces: Isoperimetry and Processes, vol. 23. New York, NY, USA: Springer-Verlag, 1991.
61. G. Aubrun, "On almost randomizing channels with a short Kraus decomposition", Commun. Math. Phys., vol. 288, no. 3, pp. 1103-1116, Jun. 2009.