An efficient method for robust projection matrix design

Signal Processing

Volumn 143, Issue , 2018, Pages 200-210

  Hong, Tao ^a   Zhu, Zhihui ^b  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b Department of Geology and Geological Engineering   (United States)

Author keywords

High dimensional dictionary; Mutual coherence; Robust projection matrix; Sparse representation error (SRE)

Indexed keywords

COMPRESSED SENSING; IMAGE PROCESSING;

COMPRESSIVE SENSING; HIGH-DIMENSIONAL; LEARNED DICTIONARIES; MUTUAL COHERENCE; RECONSTRUCTION ACCURACY; ROBUST PROJECTION; SPARSE REPRESENTATION; STATE-OF-THE-ART METHODS;

MATRIX ALGEBRA;

EID: 85029398127     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2017.09.007     Document Type: Article

References (33)

1. Candès, E.J., Romberg, J., Tao, T., Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory 52 (2006), 489–509.
2. Candès, E.J., Tao, T., Near optimal signal recovery from random projections: universal encoding strategies. IEEE Trans. Inf. Theory 52 (2006), 5406–5425.
3. Donoho, D.L., Compressed sensing. IEEE Trans. Inf. Theory 52 (2006), 1289–1306.
4. Candès, E.J., Wakin, M.B., An introduction to compressive sampling. IEEE Signal Process. Mag. 25 (2008), 21–30.
5. Elad, M., Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing. 2010, Springer Science & Business Media.
6. Eldar, Y.C., Kutyniok, G., Compressed Sensing: Theory and Application. May 2012, Cambridge University Press.
7. 2 Optimization in signal and image processing. IEEE Signal Process. Mag. 27 (2010), 76–88.
8. Barchiesi, D., Plumbley, M.D., Learning incoherent dictionaries for sparse approximation using iterative projections and rotations. IEEE Trans. Signal Process. 61 (2013), 2055–2065.
9. Li, G., Zhu, Z., Bai, H., Yu, A., A new framework for designing incoherent sparsifying dictionaries. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2017, 4416–4420.
10. Elad, M., Optimized projections for compressed sensing. IEEE Trans. Signal Process. 55 (2007), 5695–5702.
11. Abolghasemi, V., Ferdowsi, S., Sanei, S., A gradient-based alternating minimzation approach for optimization of the measurement matrix in compressive sensing. Signal Process. 94 (2012), 999–1009.
12. Lu, W.-S., Hinamoto, T., Design of projection matrix for compressive sensing by nonsmooth optimization. IEEE International Symposium Circuits and Systems (ISCAS), 2014, 1279–1282.
13. Li, S., Zhu, Z., Li, G., Chang, L., Li, Q., Projection matrix optimization for block-sparse compressive sensing. IEEE Conf. Signal Process., Communicaton and Computation (ICSPCC), 2013.
14. Li, G., Zhu, Z.H., Yang, D.H., Chang, L.P., Bai, H., On projection matrix optimization for compressive sensing systems. IEEE Trans. Signal Process. 61 (2013), 2887–2898.
15. Li, G., Li, X., Li, S., Bai, H., Jiang, Q., He, X., Designint robust sensing matrix for image compression. IEEE Trans. Image Process. 24 (2015), 5389–5400.
16. Hong, T., Bai, H., Li, S., Zhu, Z., An efficient algorithm for designing projection matrix in compressive sensing based on alternating optimization. Signal Process. 125 (2016), 9–20.
17. Zhu, Z., Wakin, M.B., Approximating sampled sinusoids and multiband signals using multiband modulated DPSS dictionaries. J. Fourier Anal. Appl., 2016, 1–40.
18. Tosic, I., Frossard, P., Dictionary learning. IEEE Signal Process. Mag. 28 (2011), 27–38.
19. Aharon, M., Elad, M., Bruckstein, A., K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 54 (2006), 4311–4322.
20. Engan, K., Aase, S.O., Hakon-housoy, J.H., Method of optimal direction for frame design. Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), vol. 5, 1999, 2443–2446.
21. Botou, L., Online algorithms and stochastic approximations. Online Learning and Neural Networks, 1998, Cambridge Univ. Press.
22. Mairal, J., Bach, F., Ponce, J., Sapiro, G., Online dictionary learning for sparse coding. Proceedings of the 26th Annual International Conference on Machine Learning ACM (ICML), 2009, 689–696.
23. Mairal, J., Bach, F., Ponce, J., Sapiro, G., Online learning for matrix factorization and sparse coding. J. Mach. Learn. 11 (2010), 19–60.
24. Z. Zhu, Q. Li, G. Tang, M.B. Wakin, Global optimality in low-rank matrix optimization, 2017 arXiv:1702.07945.
25. M. Schmidt, minfunc: unconstrained differentiale multivariate optimization in matlab, 2005. https://www.cs.ubc.ca/~schmidtm/Software/minFunc.html.
26. Sulam, J., Ophir, B., Zibulevsky, M., Elad, M., Trainlets: dictionary learning in high dimensions. IEEE Trans. Signal Process. 64 (2016), 3180–3193.
27. Sulam, J., Elad, M., Large inpainting of face images with trainlets. IEEE Signal Process. Lett. 23 (2016), 1839–1843.
28. Duarte-Carvajalino, J.M., Sapiro, G., Learning to sense sparse signals: simultaneous sensing matrix ans sparsifying dictionary optimization. IEEE Trans. Image Process. 18 (2009), 1395–1408.
29. Casella, G., Roger, L.B., Statistical Inference, Vol. 2. 2002, Pacific Grove, CA: Duxbury.
30. Nocedal, J., Wright, S., Numerical Optimization. 2006, Springer.
31. Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T., Labelme: a database and web-based tool for image annotation. Int. J. Comput. Vis. 77 (2008), 157–173.
32. Rubinstein, R., Zibulevsky, M., Elad, M., Efficient Implementation of the k-SVD Algorithm and the Batch-OMP Method. Tech. Rep., 2008, Department of Computer Science, Technion, Israel.
33. Mensch, A., Mairal, J., Thirion, B., Varoquaux, G., Dictionary learning for massive matrix factorization. Proceedings of the 33th Annual International Conference on Machine Learning ACM (ICML), 2016.