Alternating optimization of sensing matrix and sparsifying dictionary for compressed sensing

IEEE Transactions on Signal Processing

Volumn 63, Issue 6, 2015, Pages 1581-1594

  Bai, Huang ^a   Li, Gang ^a   Li, Sheng ^a   Li, Qiuwei ^b   Jiang, Qianru ^a   Chang, Liping ^a  

^a ZHEJIANG UNIVERSITY OF TECHNOLOGY   (China)

^b Department of Geology and Geological Engineering   (United States)

Author keywords

Compressed sensing; mutual coherence; optimization techniques; sensing matrix; sparsifying dictionary

Indexed keywords

ALGORITHMS; OPTIMIZATION; SIGNAL RECONSTRUCTION; SIGNAL TO NOISE RATIO;

ALTERNATING OPTIMIZATIONS; CLOSED FORM SOLUTIONS; DICTIONARY DESIGNS; MUTUAL COHERENCE; OPTIMIZATION PROBLEMS; OPTIMIZATION TECHNIQUES; PEAK SIGNAL TO NOISE RATIO; RECONSTRUCTION ACCURACY;

COMPRESSED SENSING;

EID: 84924045952     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2015.2399864     Document Type: Article

References (37)

1. E. J. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information,"IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006.
2. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Sep. 2006.
3. E. J. Candès and T. Tao, "Near optimal signal recovery from random projection: Universal encoding strategies?," IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5406-5425, Dec. 2006.
4. E. J. Candès and M. B. Wakin, "An introduction to compressive sampling,"IEEE Signal Process. Mag., vol. 25, no. 2, pp. 21-30, Mar. 2008.
5. M. F. Duarte and Y. C. Eldar, "Structured compressed sensing: From theory to applications," IEEE Trans. Signal Process., vol. 59, no. 9, pp. 4053-4085, Sep. 2011.
6. J. A. Tropp, "Greed is good: Algorithmic results for sparse approximation,"IEEE Trans. Inf. Theory, vol. 50, no. 10, pp. 2231-2242, Oct. 2004.
7. J. A. Tropp and A. Gilbert, "Signal recovery from random measurements via orthogonal matching pursuit," IEEE Trans. Inf. Theory, vol. 53, no. 12, pp. 4655-4666, Dec. 2007.
8. 2 optimization in signal and image processing," IEEE Signal Process. Mag., vol. 27, no. 3, pp. 76-88, May 2010.
9. 1 minimization," Proc. Nat. Acad. Sci., vol. 100, no. 5, pp. 2197-2202, Mar. 2003.
10. 1 approach to the compressed sensing problem," IEEE Signal Process. Lett., vol. 17, no. 2, pp. 181-184, Feb. 2010.
11. M. Elad, "Optimized projections for compressed sensing," IEEE Trans. Signal Process., vol. 55, no. 12, pp. 5695-5702, Dec. 2007.
12. J. M. Duarte-Carvajalino and G. Sapiro, "Learning to sense sparse signals: Simultaneous sensingmatrix and sparsifying dictionary optimization,"IEEE Trans. Image Process., vol. 18, no. 7, pp. 1395-1408, 2009.
13. V. Abolghasemi, S. Ferdowsi, B. Makkiabadi, and S. Sanei, "On optimization of the measurement matrix for compressive sensing," presented at the Eur. Signal Process. Conf., Aalborg, Denmark, Aug. 2010.
14. L. Zelnik-Manor, K. Rosenblum, and Y. C. Eldar, "Sensing matrix optimization for block-sparse decoding," IEEE Trans. Signal Process., vol. 59, no. 9, pp. 4300-4312, Sep. 2011.
15. G. Li, Z. H. Zhu, D. H. Yang, L. P. Chang, and H. Bai, "On projection matrix optimization for compressive sensing systems," IEEE Trans. Signal Process., vol. 61, no. 11, pp. 2887-2898, Jun. 2013.
16. T. Strohmer and R.W. Heath, "Grassmannian frames with applications to coding and communication," Appl. Comp. Harmon. Anal., vol. 14, no. 3, pp. 257-275, May 2003.
17. O. Christensen, An Introduction to Frames and Riesz Bases. Boston, MA, USA: Birkhäuser, 2003.
18. J. P. Xu, Y. M. Pi, and Z. J. Cao, "Optimized projection matrix for compressive sensing," EURASIP J. Adv. Signal Process., vol. 43, pp. 1-8, Feb. 2010.
19. V. Abolghasemi, S. Ferdowsi, and S. Sanei, "A gradient-based alternating minimization approach for optimization of the measurement matrix in compressive sensing," Signal Process., vol. 92, no. 4, pp. 999-1009, Apr. 2012.
20. W. Chen, M. D. Rodrigues, and I. J.Wassell, "On the use of unit-norm tight frames to improve the average MSE performance in compressive sensing applications," IEEE Signal Process. Lett., vol. 19, no. 1, pp. 8-11, Jan. 2012.
21. W. Chen, M. R. D. Rodrigues, and I. J. Wassell, "Projection design for statistical compressive sensing: A tight frame based approach," IEEE Trans. Signal Process., vol. 61, no. 8, pp. 2016-2029, Apr. 2013.
22. E. V. Tsiligianni, L. P. Kondi, and A. K. Katsaggelos, "Construction of incoherent unit norm tight frames with application to compressed sensing," IEEE Trans. Inf. Theory, vol. 60, no. 4, pp. 2319-2330, Apr. 2014.
23. W. J. Yan, Q. Wang, and Y. Shen, "Shrinkage-based alternating projection algorithm for efficient measurement matrix construction in compressive sensing," IEEE Trans. Instrum. Meas., vol. 63, no. 5, pp. 1073-1084, May 2014.
24. N. Cleju, "Optimized projections for compressed sensing via rank-constrained nearest correlation matrix," Appl. Computat. Harmon. Anal., vol. 36, no. 3, pp. 495-507, May 2014.
25. M. Elad, Sparse and Redundant Representations. Berlin, Germany: Springer, 2010.
26. I. Tosic and P. Frossard, "Dictionary learning: What is the right representation for my signals," IEEE Signal Process. Mag., vol. 28, no. 2, pp. 27-38, 2011.
27. K. Engan, S. O. Aase, and J. H. Hakon-Housoy, "Method of optimal direction for frame design," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 1999, vol. 5, pp. 2443-2446.
28. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
29. L. N. Smith and M. Elad, "Improving dictionary learning: Multiple dictionary updates and coefficient reuse," IEEE Signal Process. Lett., vol. 20, no. 1, pp. 79-82, 2013.
30. M. Sadeghi, M. Babaie-Zadeh, and C. Jutten, "Dictionary learning for sparse representation: A novel approach," IEEE Signal Process. Lett., vol. 20, no. 12, pp. 1195-1198, 2013.
31. S. K. Sahoo and A. Makur, "Dictionary training for sparse representation as generalization of K-means clustering," IEEE Signal Process. Lett., vol. 20, no. 6, pp. 587-590, 2013.
32. W. Chen andM. R. D. Rodrigues, "Dictionary learning with optimized projection design for compressive sensing applications," IEEE Signal Process. Lett., vol. 20, no. 10, pp. 992-995, Oct. 2013.
33. J. Mairal, F. Bach, and J. Ponce, "Task-driven dictionary learning,"IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 791-804, Apr. 2012.
34. J. A. Tropp, I. S. Dhillon, R. W. Heath Jr., and T. Strohmer, "Designing structured tight frame via alternating projection," IEEE Trans. Inf. Theory, vol. 51, no. 1, pp. 188-209, 2005.
35. A. Gunawardana and W. Byrne, "Convergence theorems for generalized alternating minimization procedures," J. Mach. Learn. Res., vol. 6, pp. 2049-2073, 2005.
36. M. Yaghoobi, L. Daudet, and M. E. Davies, "Parametric dictionary design for sparse coding," IEEE Trans. Signal Process., vol. 57, no. 12, pp. 4800-4810, 2009.
37. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985.