Lower bounds on the mean-squared error of low-rank matrix reconstruction

IEEE Transactions on Signal Processing

Volumn 59, Issue 10, 2011, Pages 4559-4571

  Tang, Gongguo ^a   Nehorai, Arye ^a  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

Barankin bound; Chapman Robbins bound; constrained Cram r Rao bound; low rank matrix reconstruction; matrix completion; maximum likelihood estimator; mean square error

Indexed keywords

BARANKIN BOUNDS; CHAPMAN-ROBBINS BOUND; LOW-RANK MATRICES; MATRIX COMPLETION; MAXIMUM LIKELIHOOD ESTIMATOR;

MAXIMUM LIKELIHOOD ESTIMATION; SIGNAL TO NOISE RATIO;

ESTIMATION;

EID: 80052884614     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2011.2161471     Document Type: Article

References (38)

1. L. El Ghaoui and P. Gahinet, "Rank minimization under LMI constraints: A framework for output feedback problems," presented at the Eur. Control Conf., Groningen, The Netherlands, Jun. 28, 1993.
2. M. Fazel, H. Hindi, and S. Boyd, "A rank minimization heuristic with application to minimum order system approximation," in Proc. Amer. Control Conf., 2001, vol. 6, pp. 4734-4739. (Pubitemid 32837075)
3. E. J. Candés and B. Recht, "Exact matrix completion via convex optimization," Found. Comput. Math., vol. 9, no. 6, pp. 717-772, 2009.
4. E. J. Candes and Y. Plan, "Matrix completion with noise," Proc. IEEE, vol. 98, no. 6, pp. 925-936, Jun. 2010.
5. D. Gross, Y. Liu, S. T. Flammia, S. Becker, and J. Eisert, "Quantum state tomography via compressed sensing," Phys. Rev. Lett., vol. 105, no. 15, pp. 150401-150404, Oct. 2010.
6. R. Basri and D. W. Jacobs, "Lambertian reflectance and linear subspaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 2, pp. 218-233, Feb. 2003.
7. E. J. Candés, X. Li, Y. Ma, and J. Wright, "Robust principal component analysis?," J. ACM, vol. 58, no. 3, pp. 1-37, Jun. 2011.
8. N. Linial, E. London, and Y. Rabinovich, "The geometry of graphs and some of its algorithmic applications," Combinatorica, vol. 15, pp. 215-245, 1995.
9. B. Recht, M. Fazel, and P. A. Parrilo, "Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization," SIAM Rev., vol. 52, no. 3, pp. 471-501, 2010.
10. M. Fazel, "Matrix rank minimization with applications," Ph.D. dissertation, Stanford Univ., Stanford, CA, 2002.
11. E. J. Candés and Y. Plan, "Tight oracle inequalities for low-rank matrix recovery from a minimal number of noisy random measurements," IEEE Trans. Inf. Theory, vol. 57, no. 4, pp. 2342-2359, Apr. 2011.
12. S. Ma, D. Goldfarb, and L. Chen, "Fixed point and Bregman iterative methods for matrix rank minimization," Math. Programm., vol. 120, no. 2, pp. 1-33, 2009.
13. P. Stoica and A. Nehorai, "MUSIC, maximum likelihood, and Cramér-Rao bound: Further results and comparisons," IEEE Trans. Acoust., Speech, Signal Process., vol. 38, no. 12, pp. 2140-2150, Dec. 1990.
14. J. D. Gorman and A. O. Hero, "Lower bounds for parametric estimation with constraints," IEEE Trans. Inf. Theory, vol. 36, no. 6, pp. 1285-1301, Nov. 1990.
15. T. L. Marzetta, "A simple derivation of the constrained multiple parameter Cramér-Rao bound," IEEE Trans. Signal Process., vol. 41, no. 6, pp. 2247-2249, Jun. 1993.
16. P. Stoica and B. C. Ng, "On the Cramér-Rao bound under parametric constraints," IEEE Signal Process. Lett., vol. 5, no. 7, pp. 177-179, Jul. 1998.
17. Z. Ben-Haim and Y. C. Eldar, "The Cramér-Rao bound for estimating a sparse parameter vector," IEEE Trans. Signal Process., vol. 58, no. 6, pp. 3384-3389, Jun. 2010.
18. Z. Ben-Haim and Y. C. Eldar, "On the constrained Cramér-Rao bound with a singular fisher information matrix," IEEE Signal Process. Lett., vol. 16, no. 6, pp. 453-456, Jun. 2009.
19. A. Jung, Z. Ben-Haim, F. Hlawatsch, and Y. C. Eldar, "Unbiased estimation of a sparse vector in white Gaussian noise," ArXiv E-Prints May 2010 [Online]. Available: http://arxiv.org/abs/1005.5697
20. J. M. Hammersley, "On estimating restricted parameters," J. Roy. Stat. Soc. Series B, vol. 12, no. 2, pp. 192-240, 1950.
21. D. G. Chapman and H. Robbins, "Minimum variance estimation without regularity assumptions," Ann. Math. Stat., vol. 22, no. 4, pp. 581-586, 1951.
22. R. McAulay and E. Hofstetter, "Barankin bounds on parameter estimation," IEEE Trans. Inf. Theory, vol. 17, no. 6, pp. 669-676, Nov. 1971.
23. J. Pilz, "Minimax linear regression estimation with symmetric parameter restrictions," J. Stat. Planning Inference, vol. 13, pp. 297-318, 1986.
24. Y. C. Eldar, A. Ben-Tal, and A. Nemirovski, "Robust mean-squared error estimation in the presence of model uncertainties," IEEE Trans. Signal Process., vol. 53, no. 1, pp. 168-181, Jan. 2005. (Pubitemid 40085343)
25. Y. Guo and B. C. Levy, "Worst-case MSE precoder design for imperfectly known mimo communications channels," IEEE Trans. Signal Process., vol. 53, no. 8, pp. 2918-2930, Aug. 2005.
26. Y. C. Eldar, "Minimax MSE estimation of deterministic parameters with noise covariance uncertainties," IEEE Trans. Signal Process., vol. 54, no. 1, pp. 138-145, Jan. 2006. (Pubitemid 43065788)
27. P. A. Parker, P. Mitran, D. W. Bliss, and V. Tarokh, "On bounds and algorithms for frequency synchronization for collaborative communication systems," IEEE Trans. Signal Process., vol. 56, no. 8, pp. 3742-3752, Aug. 2008.
28. A. Funai and J. A. Fessler, "Cramér Rao bound analysis of joint b1/t1 mapping methods in MRI," in IEEE Int. Symp. Biomed. Imaging: From Nano to Macro, Apr. 2010, pp. 712-715.
29. D. S. Bernstein, Matrix Mathematics: Theory, Facts, and Formulas With Application to Linear Systems Theory. Princeton, NJ: Princeton Univ. Press, 2005.
30. M. Ledoux and M. Talagrand, Probability in Banach Spaces: Isoperimetry and Processes. New York: Springer-Verlag, 1991.
31. M. Rudelson and R. Vershynin, "Sparse reconstruction by convex relaxation: Fourier and Gaussian measurements," in Proc. 40th Conf. Inf. Sci. Syst. (CISS 2006), Mar. 2006, pp. 207-212.
32. E. J. Candés and T. Tao, "The power of convex relaxation: Near-optimal matrix completion," IEEE Trans. Inf. Theory, vol. 56, no. 5, pp. 2053-2080, May 2010.
33. E. J. Candés, "The restricted isometry property and its implications for compressed sensing," Compte Rendus de l'Academie des Sciences, ser. I, vol. 346, pp. 589-592, 2008.
34. M. Rudelson and R. Vershynin, "On sparse reconstruction from Fourier and Gaussian measurements," Commun. Pure Appl. Math., vol. 61, pp. 1025-1045, 2008.
35. M. Talagrand, The Generic Chaining: Upper and Lower Bounds of Stochastic Processes. New York: Springer, 2005.
36. M. D. Buhmann, Radial Basis Functions: Theory and Implementations. Cambridge, U.K.: Cambridge Univ. Press, 2009.
37. R. A. Horn and C. R. Johnson, Matrix Analysis. New York: Cambridge Univ. Press, 1990.
38. J. R. Schott,Matrix Analysis for Statistics, 2nd ed. New York:Wiley- Interscience, 2005, 1.