Dequantizing compressed sensing: When oversampling and non-Gaussian constraints combine

IEEE Transactions on Information Theory

Volumn 57, Issue 1, 2011, Pages 559-571

  Jacques, Laurent ^a   Hammond, David K ^b   Fadili, Jalal M ^c  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^b UNIVERSITY OF OREGON   (United States)

^c UNIVERSITÉ DE CAEN   (France)

Author keywords

Compressed sensing; convex optimization; denoising; optimality; oversampling; quantization; sparsity

Indexed keywords

COMPRESSED SENSING; DE-NOISING; OPTIMALITY; OVER SAMPLING; QUANTIZATION; SPARSITY;

DECODING; IMAGE RECONSTRUCTION; MATRIX ALGEBRA; NOISE POLLUTION CONTROL; OPTIMIZATION;

CONVEX OPTIMIZATION;

EID: 78650920797     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2010.2093310     Document Type: Article

References (50)

1. L. Jacques, D. K. Hammond, and M. J. Fadili, "Dequantizing compressed sensing with non-Gaussian constraints," in Proc. IEEE Int. Conf. Image Processing (ICIP), Cairo, Egypt, Nov. 2009.
2. E. Candès and J. Romberg, "Quantitative robust uncertainty principles and optimally sparse decompositions," Found. Comput. Math., vol. 6, no. 2, pp. 227-254, 2006.
3. D. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, 2006.
4. E. J. Candès and T. Tao, "Near-optimal signal recovery from random projections: Universal encoding strategies," IEEE Trans. Inf. Theory, vol. 52, pp. 5406-5425, 2004.
5. P. Boufounos and R. G. Baraniuk, "1-bit compressive sensing," in 42nd Annu. Conf. Information Sciences and Systems (CISS), Princeton, NJ, Mar. 2008, pp. 19-21.
6. W. Dai, H. V. Pham, and O. Milenkovic, "Distortion-rate functions for quantized compressive sensing," in IEEE Information Theory Workshop (ITW) IEEE Int. Symp. InformationTheory (ISIT), 2009, arXiv:0901.0749, submitted for publication.
7. A. Zymnis, S. Boyd, and E. Candès, Compressed Sensing with Quantized Measurements 2009 [Online]. Available: http://stanford. edu/~boyd/papers/quant-compr-sens.html
8. N. Thao and M. Vetterli, "Deterministic analysis of oversampled A/D conversion and decoding improvement based on consistent estimates," IEEE Trans. Signal Process., vol. 42, no. 3, pp. 519-531, 1994.
9. P. Weiss, G. Aubert, and L. Blanc-Féraud, "Some applications of l∞ -constraints in image processing," INRIA Res. Rep., vol. 6115, 2006.
10. P. Weiss, L. Blanc-Feraud, T. Andre, and M. Antonini, "Compression artifacts reduction using variational methods: Algorithms and experimental study," in IEEE Int. Conf. Acoustics, Speech and Signal Processing, 2008. ICASSP 2008, 2008, pp. 1173-1176.
11. V. Goyal, A. Fletcher, and S. Rangan, "Compressive sampling and lossy compression," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 48-56, 2008.
12. p ball from limited measurements," in Data Compression Conf., Snowbird, UT, Mar. 2006.
13. P. Boufounos and R. G. Baraniuk, "Quantization of sparse representations," in Data Compression Conf., Snowbird, UT, Mar. 2007.
14. H. Rauhut, K. Schnass, and P. Vandergheynst, "Compressed sensing and redundant dictionaries," IEEE Trans. Inf. Theory, vol. 54, no. 5, pp. 2210-2219, May 2008.
15. L. Ying and Y. Zou, Linear Transformations and Restricted Isometry Property 2009, preprint, arXiv:0901.0541.
16. J. Laska, P. Boufounos, M. Davenport, and R. Baraniuk, "Democracy in Action: Quantization, Saturation, and Compressive Sensing," 2009, preprint.
17. E. Candès, J. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Commun. Pure Appl. Math., vol. 59, no. 8, pp. 1207-1223, 2006.
18. M. Fadili and J.-L. Starck, "Monotone operator splitting for fast sparse solutions of inverse problems," SIAM J. Imag. Sci., 2009, submitted.
19. P. Combettes, "Solving monotone inclusions via compositions of nonexpansive averaged operators," Optimization, vol. 53, no. 5, pp. 475-504, 2004.
20. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM Rev. vol. 43, no. 1, pp. 129-159, 2001 [Online]. Available: http://link.aip.org/link/?SIR/43/129/1, [Online]. Available:
21. W. Hoeffding, "Probability inequalities for sums of bounded random variables," J. Amer. Statist. Assoc., vol. 58, no. 301, pp. 13-30, 1963.
22. E. Candès, "The restricted isometry property and its implications for compressed sensing," Compte Rendus Acad. Sci. Paris, Serie I, vol. 346, pp. 589-592, 2008.
23. R. G. Baraniuk, M. A. Davenport, R. A. DeVore, and M. B.Wakin, "A simple proof of the restricted isometry property for random matrices," Construct. Approx., vol. 28, no. 3, pp. 253-263, Dec. 2008.
24. D. Donoho and J. Tanner, "Counting faces of randomly-projected polytopes when the projection radically lowers dimension," J. Amer. Math. Soc., vol. 22, no. 1, pp. 1-15, Jan. 2009.
25. S. Mendelson, A. Pajor, and N. Tomczak-Jaegermann, "Reconstruction and subgaussian operators in asymptotic geometric analysis," Geom. Funct. Anal., vol. 17, no. 4, pp. 1248-1282, 2007.
26. R. Berinde, A. C. Gilbert, P. Indyk, H. Karloff, and M. J. Strauss, "Combining geometry and combinatorics:A unified approach to sparse signal recovery," in Allerton Conf., 2008.
27. R. Berinde and P. Indyk, Sparse Recovery Using Sparse Matrices Mass. Inst. Technol., Cambridge, Tech. Rep. MIT-CSAIL-TR-2008-001, Oct. 2008.
28. R. Chartrand and V. Staneva, "Restricted isometry properties and nonconvex compressive sensing," Inv. Probl., vol. 24, p. 035020, 2008.
29. A. Cohen, R. DeVore, and W. Dahmen, "Compressed sensing and best k-term approximation," J. Amer. Math. Soc., vol. 22, pp. 211-231, 2009.
30. M. Varanasi and B. Aazhang, "Parametric generalized Gaussian density estimation," J. Acoust. Soc. Amer., vol. 86, pp. 1404-1415, 1989.
31. q -minimization for
32. p -sparse recovery can fail for < p ≤ 1," IEEE Trans. Inf. Theory, vol. 55, no. 5, pp. 2203-2214, May 2009.
33. 1 regularized sparse representations algorithm," in Proc. 2009 IEEE Int. Conf. Acoustics, Speech and Signal Processing, 2009, pp. 3329-3332.
34. D. François, V. Wertz, and M. Verleysen, "The concentration of fractional distances," IEEE Trans. Knowl. Data. Eng., pp. 873-886, 2007.
35. W. Bynum, "Weak parallelogram laws for banach spaces," Can. Math. Bull, vol. 19, no. 3, pp. 269-275, 1976.
36. H. K. Xu, "Inequalities in banach spaces with applications," Nonlinear Anal., vol. 16, no. 12, pp. 1127-1138, 1991.
37. R. Spira, "Calculation of the gamma function by Stirling's formula," Math. Comput., vol. 25, no. 114, pp. 317-322, 1971.
38. P. Combettes and J. Pesquet, "A proximal decomposition method for solving convex variational inverse problems," Inv. Probl., vol. 24, p. 27, Dec. 2008.
39. J.-J. Moreau, "Fonctions Convexes Duales et Points Proximaux Dans un Espace Hilbertien," CR Acad. Sci. Paris Ser. A Math, vol. 255, pp. 2897-2899, 1962.
40. P. Combettes and V. Wajs, "Signal recovery by proximal forwardbackward splitting," Multiscale Model. Simul., vol. 4, no. 4, p. 1168, 2006.
41. A. N. A. Ben-Tal, Optimization III: Convex Analysis, Nonlinear Programming Theory, Standard Nonlinear Programming Algorithms 2004.
42. D. Zwillinger, CRC Standard Mathematical Tables and Formulae. Boca Raton, FL: Chapman & Hall/CRC, 2003.
43. M. Lustig, D. Donoho, and J. Pauly, "Sparse MRI: The application of compressed sensing for rapid MR imaging," Magn. Res. Med., vol. 58, no. 6, p. 1182, 2007.
44. L. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Physica D, Jan. 1992.
45. C. R. Vogel and M. E. Oman, "Iterative methods for total variation denoising," SIAM J. Sci. Comput., vol. 17, no. 1, pp. 227-238, 1996.
46. T. F. Chan, G. H. Golub, and P. Mulet, "A nonlinear primal-dual method for total variation-based image restoration," SIAM J. Sci. Comput., vol. 20, no. 6, pp. 1964-1977, 1999.
47. A. Chambolle, "An algorithm for total variation minimization and applications," J. Math. Imag. Vis., Jan. 2004.
48. Y. Wang, J. Yang, W. Yin, and Y. Zhang, "A new alternating minimization algorithm for total variation image reconstruction," SIAM J. Imag. Sci., vol. 1, no. 3, pp. 248-272, 2008.
49. M. Ledoux and M. Talagrand, Probability in Banach Spaces: Isoperimetry and Processes. Berlin, Germany: Springer, 1991.
50. M. Ledoux, "The concentration of measure phenomenon," J. Amer. Math. Soc., 2001.