Projection design for statistical compressive sensing: A tight frame based approach

IEEE Transactions on Signal Processing

Volumn 61, Issue 8, 2013, Pages 2016-2029

  Chen, Wei ^a   Rodrigues, Miguel R D ^b   Wassell, Ian J ^c  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Compressive sensing; overcomplete dictionary; sensing projection design; sparse representation; tight frames

Indexed keywords

COMPRESSIVE SENSING; MEAN SQUARED ERROR; NUMERICAL INVESTIGATIONS; OPTIMIZATION PROBLEMS; ORTHOGONAL MATCHING PURSUIT; OVER-COMPLETE DICTIONARIES; SPARSE REPRESENTATION; TIGHT FRAME;

ALGORITHMS; BENCHMARKING; ITERATIVE METHODS; RELAXATION PROCESSES; SIGNAL RECONSTRUCTION;

DESIGN;

EID: 84875654775     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2013.2245661     Document Type: Article

References (52)

1. E. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006. (Pubitemid 43174093)
2. D. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
3. M. Lustig, D. Donoho, and J. Pauly, "Sparse MRI: The application of compressed sensing for rapid MR imaging," Magn. Reson. Med., vol. 58, no. 6, pp. 1182-1195, 2007. (Pubitemid 350234205)
4. W. Chen, M. Rodrigues, and I. Wassell, "A fréchet mean approach for compressive sensing date acquisition and reconstruction in wireless sensor networks," IEEE Trans. Wireless Commun., vol. 11, no. 10, pp. 3598-3606, Oct. 2012.
5. R. Baraniuk, V. Cevher, M. Duarte, and C. Hegde, "Model-based compressive sensing," IEEE Trans. Inf. Theory, vol. 56, no. 4, pp. 1982-2001, Apr. 2010.
6. S. Ji, Y. Xue, and L. Carin, "Bayesian compressive sensing," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2346-2356, Jun. 2008. (Pubitemid 351795888)
7. C. Hegde and R. Baraniuk, "Signal recovery on incoherent manifolds," IEEE Trans. Inf. Theory, vol. 58, no. 12, pp. 7204-7214, Dec. 2012.
8. M. Chen, J. Silva, J. Paisley, C. Wang, D. Dunson, and L. Carin, "Com-pressive sensing on manifolds using a nonparametric mixture of factor analyzers: Algorithm and performance bounds," IEEE Trans. Signal Process., vol. 58, no. 12, pp. 6140-6155, Dec. 2010.
9. X. Ding, L. He, and L. Carin, "Bayesian robust principal component analysis," IEEE Trans. Image Process., vol. 20, no. 12, pp. 3419-3430, Dec. 2011.
10. C. Fu, X. Ji, and Q. Dai, "Adaptive compressed sensing recovery utilizing the property of signal's autocorrelations," IEEE Trans. Image Process., vol. 21, no. 5, pp. 2369-2378, May 2012.
11. Z. Zhang and B. Rao, "Sparse signal recovery with temporally correlated source vectors using sparse bayesian learning," IEEE J. Sel. Top. Signal Process., vol. 5, no. 5, pp. 912-926, Sep. 2011.
12. T. Peleg, Y. Eldar, and M. Elad, "Exploiting statistical dependencies in sparse representations for signal recovery," IEEE Trans. Signal Process., vol. 60, no. 5, pp. 2286-2303, May 2012.
13. A. Danielyan, A. Foi, V. Katkovnik, and K. Egiazarian, "Image upsam-pling via spatially adaptive block-matching filtering," presented at the 16th Eur. Signal Process. Conf. (EUSIPCO), Lausanne, Switzerland, Aug. 25-29, 2008.
14. K. Egiazarian, A. Foi, and V. Katkovnik, "Compressed sensing image reconstruction via recursive spatially adaptive filtering," in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2007, pp. 549-552.
15. A. Danielyan, A. Foi, V. Katkovnik, and K. Egiazarian, "Spatially adaptive filtering as regularization in inverse imaging: Compressive sensing, super-resolution, and upsampling," in Super-Resolution Imaging, P. Milanfar, Ed. Boca Raton, FL, USA: CRC/Taylor & Francis, Sep. 2010, pp. 123-153.
16. M. Elad, "Optimized projections for compressed sensing," IEEE Trans. Signal Process., vol. 55, no. 12, pp. 5695-5702, Dec. 2007. (Pubitemid 350201203)
17. J. Duarte-Carvajalino and G. Sapiro, "Learning to sense sparse signals: Simultaneous sensing matrix and sparsifying dictionary optimization," IEEE Trans. Image Process., vol. 18, no. 7, pp. 1395-1408, Jul. 2009.
18. J. Xu, Y. Pi, and Z. Cao, "Optimized projection matrix for compressive sensing," EURASIP J. Adv. Signal Process., vol. 43, pp. 1-8, Feb. 2010.
19. L. Zelnik-Manor, K. Rosenblum, and Y. Eldar, "Sensing matrix optimization for block-sparse decoding," IEEE Trans. Signal Process., vol. 59, no. 9, pp. 4300-4312, Sep. 2011.
20. W. Carson, M. Chen, M. Rodrigues, R. Calderbank, and L. Carin, "Communications-inspired projection design with application to com-pressive sensing," SIAM J. Imag. Sci., vol. 5, no. 4, pp. 1185-1212, 2012.
21. D. Donoho, M. Elad, and V. Temlyakov, "Stable recovery of sparse overcomplete representations in the presence of noise," IEEE Trans. Inf. Theory, vol. 52, no. 1, pp. 6-18, Jan. 2006. (Pubitemid 43263116)
22. R. Calderbank, S. Howard, and S. Jafarpour, "Construction of a large class of deterministic sensing matrices that satisfy a statistical isom-etry property," IEEE J. Sel. Topics Signal Process., vol. 4, no. 2, pp. 358-374, Apr. 2010.
23. E. Candès and T. Tao, "The Dantzig selector: Statistical estimation when p is much larger than n," Ann. Statist., vol. 35, no. 6, pp. 2313-2351, 2007.
24. W. Chen, M. Rodrigues, and I. Wassell, "On the use of unit-norm tight frames to improve the average MSE performance in compressive sensing applications," IEEE Signal Process. Lett., vol. 19, no. 1, pp. 8-11, Jan. 2012.
25. H. Rauhut, K. Schnass, and P. Vandergheynst, "Compressed sensing and redundant dictionaries," IEEE Trans. Inf. Theory, vol. 54, no. 5, pp. 2210-2219, May 2008. (Pubitemid 351689557)
26. E. J. Candès, Y. C. Eldar, D. Needell, and P. Randall, "Compressed sensing with coherent and redundant dictionaries," Appl. Comput. Harmon. Anal., vol. 31, no. 1, pp. 59-73, 2011.
27. M. Davenport, D. Needell, and M. Wakin, "Signal space cosamp for sparse recovery with redundant dictionaries," 2012 [Online]. Available: http://arxiv.org/abs/1208.0353, arXiv preprint arXiv:1208.0353
28. F. Champagnat, Y. Goussard, and J. Idier, "Unsupervised deconvo-lution of sparse spike trains using stochastic approximation," IEEE Trans. Signal Process., vol. 44, no. 12, pp. 2988-2998, Dec. 1996. (Pubitemid 126778045)
29. H. Zayyani, M. Babaie-Zadeh, and C. Jutten, "An iterative Bayesian algorithm for sparse component analysis in presence of noise," IEEE Trans. Signal Process., vol. 57, no. 11, pp. 4378-4390, Nov. 2009.
30. N. Dobigeon and J.-Y. Tourneret, "Bayesian orthogonal component analysis for sparse representation," IEEE Trans. Signal Process., vol. 58, no. 5, pp. 2675-2685, May 2010.
31. R. Gribonval and K. Schnass, "Dictionary identification-sparse matrix-factorization via-minimization," IEEE Trans. Inf. Theory, vol. 56, no. 7, pp. 3523-3539, Jul. 2010.
32. F. Labeau, J.-C. Chiang, M. Kieffer, P. Duhamel, L. Vandendorpe, and B. Macq, "Oversampled filter banks as error correcting codes: Theory and impulse noise correction," IEEE Trans. Signal Process., vol. 53, no. 12, pp. 4619-4630, Dec. 2005. (Pubitemid 41800398)
33. M. Hyder and K. Mahata, "An improved smoothed approximation algorithm for sparse representation," IEEE Trans. Signal Process., vol. 58, no. 4, pp. 2194-2205, Apr. 2010.
34. C. Soussen, J. Idier, D. Brie, and J. Duan, "From Bernoulli-Gaussian deconvolution to sparse signal restoration," IEEE Trans. Signal Process., vol. 59, no. 10, pp. 4572-4584, Oct. 2011.
35. S. Chen, D. Donoho, and M. Saunders, "Atomic decomposition by basis pursuit," SIAM Rev., vol. 43, no. 1, pp. 129-159, 2001. (Pubitemid 32406896)
36. E. Candès, "The restricted isometry property and its implications for compressed sensing," Comptes Rendus-Math., vol. 346, no. 9-10, pp. 589-592, 2008.
37. E. Candès and T. Tao, "Decoding by linear programming," IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4203-4215, Dec. 2005. (Pubitemid 41800353)
38. S. Kim and C. Yoo, "Underdetermined blind source separation based on subspace representation," IEEE Trans. Signal Process., vol. 57, no. 7, pp. 2604-2614, Jul. 2009.
39. V. Bostanov, "Bci competition 2003-data sets ib and iib: Feature extraction from event-related brain potentials with the continuous wavelet transform and the t-value scalogram," IEEE Trans. Biomed. Eng., vol. 51, no. 6, pp. 1057-1061, Jun. 2004. (Pubitemid 38661462)
40. G. Yen and K.-C. Lin, "Wavelet packet feature extraction for vibration monitoring," IEEE Trans. Ind. Electron., vol. 47, no. 3, pp. 650-667, Jun. 2000.
41. Z. Ben-Haim and Y. Eldar, "The Cramèr-Rao bound for estimating a sparse parameter vector," IEEE Trans. Signal Process., vol. 58, no. 6, pp. 3384-3389, Jun. 2010.
42. Z. Ben-Haim, Y. Eldar, and M. Elad, "Coherence-based performance guarantees for estimating a sparse vector under random noise," IEEE Trans. Signal Process., vol. 58, no. 10, pp. 5030-5043, Oct. 2010.
43. E. G. Larsson and Y. Selen, "Linear regression with a sparse parameter vector," IEEE Trans. Signal Process., vol. 55, no. 2, pp. 451-460, Feb. 2007. (Pubitemid 46351271)
44. P. Schniter, L. Potter, and J. Ziniel, "Fast Bayesian matching pursuit: Model uncertainty and parameter estimation for sparse linear models," OSU ECE, Tech. Rep., 2009.
45. M. Elad and I. Yavneh, "A plurality of sparse representations is better than the sparsest one alone," IEEE Trans. Inf. Theory, vol. 55, no. 10, pp. 4701-4714, Oct. 2009.
46. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006. (Pubitemid 44811686)
47. E. J. Candès and M. A. Davenport, "How well can we estimate a sparse vector?," Appl. Comput. Harmon. Anal., 2012, to be published.
48. F. Ye and C.-H. Zhang, "Rate minimaxity of the lasso and dantzig selector for the loss in balls," J. Mach. Learn. Res., vol. 11, pp. 3519-3540, Dec. 2010.
49. G. Raskutti, M. Wainwright, and B. Yu, "Minimax rates of estimation for high-dimensional linear regression over-balls," IEEE Trans. Inf. Theory, vol. 57, no. 10, pp. 6976-6994, Oct. 2011.
50. M. Rudelson and R. Vershynin, "Smallest singular value of a random rectangular matrix," Commun. Pure Appl. Math., vol. 62, no. 12, pp. 1707-1739, 2009.
51. J. A. Tropp, "On the conditioning of random subdictionaries," Appl. Comput. Harmon. Anal., vol. 25, no. 1, pp. 1-24, 2008. (Pubitemid 351721018)
52. T. Strohmer and R. W. H., Jr., "Grassmannian frames with applications to coding and communication," Appl. Comput. Harmon. Anal., vol. 14, no. 3, pp. 257-275, 2003.