Data-Driven Learning of a Union of Sparsifying Transforms Model for Blind Compressed Sensing

IEEE Transactions on Computational Imaging

Volumn 2, Issue 3, 2016, Pages 294-309

  Ravishankar, Saiprasad ^a   Bresler, Yoram ^b  

^a UNIVERSITY OF MICHIGAN   (United States)

^b University of Illinois at Urbana Champaign   (United States)

Author keywords

Compressed sensing; dictionary learning; inverse problems; machine learning; magnetic resonance imaging; medical imaging; sparse representations; sparsifying transforms

Indexed keywords

COMPRESSED SENSING; IMAGE RECONSTRUCTION; INVERSE PROBLEMS; LEARNING SYSTEMS; MEDICAL IMAGING; MEDICAL PROBLEMS; NUMERICAL METHODS; REPAIR;

ADAPTIVE TRANSFORM; BLOCK COORDINATE DESCENTS; DICTIONARY LEARNING; IMAGE RECONSTRUCTION METHODS; MAGNETIC RESONANCE IMAGING (MRI); NUMERICAL EXPERIMENTS; SPARSE REPRESENTATION; SPARSE SIGNAL MODELS;

MAGNETIC RESONANCE IMAGING;

EID: 85023768572     PISSN: None     EISSN: 23339403     Source Type: Journal    
DOI: 10.1109/TCI.2016.2567299     Document Type: Article

References (77)

1. S. Ravishankar and Y. Bresler, "Data-driven adaptation of a union of sparsifying transforms for blind compressed sensing MRI reconstruction, " Proc. SPIE, vol. 9597, 2015, Art. no. 959713. [Online]. Available: http://dx. doi. org/10. 1117/12. 2188952
2. M. W. Marcellin, M. J. Gormish, A. Bilgin, and M. P. Boliek, "An overview of JPEG-2000, " in Proc. Data Compression Conf., 2000, pp. 523-541.
3. E. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information, " IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006.
4. D. Donoho, "Compressed sensing, " IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
5. E. Candès and T. Tao, "Decoding by linear programming, " IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4203-4215, Dec. 2005.
6. P. Feng and Y. Bresler, "Spectrum-blind minimum-rate sampling and reconstruction of multiband signals, " in Proc. Int. Conf. Acoust., Speech, Signal Process., May 1996, vol. 3, pp. 1689-1692.
7. Y. Bresler and P. Feng, "Spectrum-blind minimum-rate sampling and reconstruction of 2-D multiband signals, " in Proc. 3rd IEEE Int. Conf. Image Process., 1996, pp. 701-704.
8. P. Feng, "Universal spectrum blind minimum rate sampling and reconstruction of multiband signals, " Ph. D. dissertation, Univ. Illinois at Urbana-Champaign, Champaign, IL, USA, 1997.
9. R. Venkataramani and Y. Bresler, "Further results on spectrum blind sampling of 2D signals, " in Proc. IEEE Int. Conf. Image, Oct. 1998, vol. 2, pp. 752-756.
10. Y. Bresler, M. Gastpar, and R. Venkataramani, "Image compression onthe-fly by universal sampling in Fourier imaging systems, " in Proc. 1999 IEEE Inf. Theory Workshop Detection, Estimation, Classification, Imag., Feb. 1999, p. 48.
11. M. Gastpar and Y. Bresler, "On the necessary density for spectrum-blind nonuniform sampling subject to quantization, " in Proc. Int. Conf. Acoust., Speech, Signal Process., Jun. 2000, vol. 1, pp. 348-351.
12. J. C. Ye, Y. Bresler, and P. Moulin, "A self-referencing level-set method for image reconstruction from sparse Fourier samples, " Int. J. Comput. Vision, vol. 50, no. 3, pp. 253-270, Dec. 2002.
13. Y. Bresler, "Spectrum-blind sampling and compressive sensing for continuous-index signals, " in Proc. Inform. Theory Appl. Workshop Conf., 2008, pp. 547-554.
14. M. Lustig, D. Donoho, and J. Pauly, "Sparse MRI: The application of compressed sensing for rapid MR imaging, " Magn. Resonance Med., vol. 58, no. 6, pp. 1182-1195, 2007.
15. M. Lustig, J. M. Santos, D. L. Donoho, and J. M. Pauly, "k-t SPARSE: High frame rate dynamic MRI exploiting spatio-temporal sparsity, " in Proc. Int. Symp. Magn. Resonance Med., 2006, Art. no. 2420.
16. R. Chartrand, "Fast algorithms for nonconvex compressive sensing: MRI reconstruction from very few data, " in Proc. IEEE Int. Symp. Biomed. Imag., 2009, pp. 262-265.
17. J. Trzasko and A. Manduca, "Highly undersampled magnetic resonance image reconstruction via homotopic l0-minimization, " IEEE Trans. Med. Imag., vol. 28, no. 1, pp. 106-121, Jan. 2009.
18. Y. Kim, M. S. Nadar, and A. Bilgin, "Wavelet-based compressed sensing using gaussian scale mixtures, " in Proc. Int. Symp. Magn. Resonance Med., 2010, p. 4856.
19. C. Qiu, W. Lu, and N. Vaswani, "Real-time dynamic MR image reconstruction using Kalman filtered compressed sensing, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2009, pp. 393-396.
20. X. Qu, D. Guo, B. Ning, Y. Hou, Y. Lin, S. Cai, and Z. Chen, "Undersampled MRI reconstruction with patch-based directional wavelets, " Magn. Resonance Imag., vol. 30, no. 7, pp. 964-977, 2012.
21. G. H. Chen, J. Tang, and S. Leng, "Prior image constrained compressed sensing (piccs): A method to accurately reconstruct dynamic CT images from highly undersampled projection data sets, " Med. Phys., vol. 35, no. 2, pp. 660-663, 2008.
22. K. Choi, J. Wang, L. Zhu, T.-S. Suh, S. Boyd, and L. Xing, "Compressed sensing based cone-beam computed tomography reconstruction with a first-order method, " Med. Phys., vol. 37, no. 9, pp. 5113-5125, 2010.
23. X. Li and S. Luo, "A compressed sensing-based iterative algorithm for CT reconstruction and its possible application to phase contrast imaging, " Biomed. Eng. Online, vol. 10, no. 1, pp. 1-14, 2011, http://dx. doi. org/10. 1186/1475-925X-10-73
24. S. Valiollahzadeh, T. Chang, J. W. Clark, and O. R. Mawlawi, "Image recovery in PET scanners with partial detector rings using compressive sensing, " in Proc. IEEE Nucl. Sci. Symp. Med. Imag. Conf., Oct. 2012, pp. 3036-3039.
25. K. Malczewski, "PET image reconstruction using compressed sensing, " in Proc. Signal Process. : Algorithms, Architectures, Arrangements, Appl., Sep. 2013, pp. 176-181.
26. K. P. Pruessmann, "Encoding and reconstruction in parallel MRI, " NMR Biomed., vol. 19, no. 3, pp. 288-299, 2006.
27. S. Ma, W. Yin, Y. Zhang, and A. Chakraborty, "An efficient algorithm for compressed MR imaging using total variation and wavelets, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
28. X. Qu, D. Guo, Z. Chen, and C. Cai, "Compressed sensing MRI based on nonsubsampled contourlet transform, " in Proc. IEEE Int. Symp. IT Med. Educ., 2008, pp. 693-696.
29. Y. Chen, X. Ye, and F. Huang, "A novel method and fast algorithm for MR image reconstruction with significantly under-sampled data, " Inverse Problems Imag., vol. 4, no. 2, pp. 223-240, 2010.
30. Q. Wang, J. Liu, N. Janardhanan, M. Zenge, E. Mueller, and M. S. Nadar, "Tight frame learning for cardiovascular MRI, " in Proc. IEEE 10th Int. Symp. Biomed. Imag., 2013, pp. 290-293.
31. S. Ravishankar and Y. Bresler, "MR image reconstruction from highly undersampled k-space data by dictionary learning, " IEEE Trans. Med. Imag., vol. 30, no. 5, pp. 1028-1041, May 2011.
32. S. Ravishankar and Y. Bresler, "Multiscale dictionary learning for MRI, " in Proc. Int. Symp. Magn. Resonance Med., 2011, p. 2830.
33. S. Gleichman and Y. C. Eldar, "Blind compressed sensing, " IEEE Trans. Inf. Theory, vol. 57, no. 10, pp. 6958-6975, Oct. 2011.
34. S. G. Lingala and M. Jacob, "Blind compressive sensing dynamic MRI, " IEEE Trans. Med. Imag., vol. 32, no. 6, pp. 1132-1145, Jun. 2013.
35. Y. Wang, Y. Zhou, and L. Ying, "Undersampled dynamic magnetic resonance imaging using patch-based spatiotemporal dictionaries, " in Proc. IEEE 10th Int. Symp. Biomed. Imag., Apr. 2013, pp. 294-297.
36. J. Caballero, D. Rueckert, and J. V. Hajnal, "Dictionary learning and time sparsity in dynamic MRI, " in Medical Image Computing and Computer-Assisted Intervention (Lecture Notes in Computer Science). Berlin, Germany: Springer, 2012, vol. 7510, pp. 256-263.
37. Y. Huang, J. Paisley, Q. Lin, X. Ding, X. Fu, and X. P. Zhang, "Bayesian nonparametric dictionary learning for compressed sensing MRI, " IEEE Trans. Image Process., vol. 23, no. 12, pp. 5007-5019, 2014.
38. S. P. Awate and E. V. R. DiBella, "Spatiotemporal dictionary learning for undersampled dynamic MRI reconstruction via joint frame-based and dictionary-based sparsity, " in Proc. 9th IEEE Int. Symp. Biomed. Imag., 2012, pp. 318-321.
39. J. Caballero, A. N. Price, D. Rueckert, and J. V. Hajnal, "Dictionary learning and time sparsity for dynamic MR data reconstruction, " IEEE Trans. Med. Imag., vol. 33, no. 4, pp. 979-994, Jul. 2014.
40. S. Wang, X. Peng, P. Dong, L. Ying, D. D. Feng, and D. Liang, "Parallel imaging via sparse representation over a learned dictionary, " in Proc. IEEE 12th Int. Symp. Biomed. Imag., 2015, pp. 687-690.
41. S. Ravishankar and Y. Bresler, "Sparsifying transform learning for compressed sensing MRI, " in Proc. IEEE Int. Symp. Biomed. Imag., 2013, pp. 17-20.
42. L. Pfister and Y. Bresler, "Model-based iterative tomographic reconstruction with adaptive sparsifying transforms, " Proc. SPIE, vol. 9020, 2014, Art. no. 90200H.
43. S. Ravishankar and Y. Bresler, "Efficient blind compressed sensing using sparsifying transforms with convergence guarantees and application to magnetic resonance imaging, " SIAM J. Imag. Sci., vol. 8, no. 4, pp. 2519-2557, 2015.
44. J. E. Fowler, "Compressive-projection principal component analysis, " IEEE Trans. Image Process., vol. 18, no. 10, pp. 2230-2242, Oct. 2009.
45. A. M. Bruckstein, D. L. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images, " SIAM Rev., vol. 51, no. 1, pp. 34-81, 2009.
46. S. Ravishankar and Y. Bresler, "Learning sparsifying transforms, " IEEE Trans. Signal Process., vol. 61, no. 5, pp. 1072-1086, Mar. 2013.
47. B. K. Natarajan, "Sparse approximate solutions to linear systems, " SIAM J. Comput., vol. 24, no. 2, pp. 227-234, Apr. 1995.
48. G. Davis, S. Mallat, and M. Avellaneda, "Adaptive greedy approximations, " J. Constructive Approximation, vol. 13, no. 1, pp. 57-98, 1997.
49. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries, " IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006.
50. J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration, " IEEE Trans. Image Process., vol. 17, no. 1, pp. 53-69, Jan. 2008.
51. J. Mairal, G. Sapiro, and M. Elad, "Learning multiscale sparse representations for image and video restoration, " SIAM Multiscale Modeling Simulation, vol. 7, no. 1, pp. 214-241, 2008.
52. S. Ravishankar and Y. Bresler, "Learning doubly sparse transforms for images, " IEEE Trans. Image Process., vol. 22, no. 12, pp. 4598-4612, Dec. 2013.
53. S. Ravishankar and Y. Bresler, "0 sparsifying transform learning with efficient optimal updates and convergence guarantees, " IEEE Trans. Signal Process., vol. 63, no. 9, pp. 2389-2404, May 2015.
54. B. Wen, S. Ravishankar, and Y. Bresler, "Structured overcomplete sparsifying transform learning with convergence guarantees and applications, " Int. J. Comput. Vision, vol. 114, no. 2/3, pp. 137-167, 2015.
55. S. Ravishankar, B. Wen, and Y. Bresler, "Online sparsifying transform learning-part I: Algorithms, " IEEE J. Sel. Topics Signal Process., vol. 9, no. 4, pp. 625-636, 2015.
56. S. Ravishankar and Y. Bresler, "Online sparsifying transform learning-part II: Convergence analysis, " IEEE J. Sel. Topics Signal Process., vol. 9, no. 4, pp. 637-646, Jun. 2015.
57. X. Qu, Y. Hou, F. Lam, D. Guo, J. Zhong, and Z. Chen, "Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator, " Med. Image Anal., vol. 18, no. 6, pp. 843-856, Aug. 2014.
58. S. Ravishankar and Y. Bresler, "Closed-form solutions within sparsifying transform learning, " in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., 2013, pp. 5378-5382.
59. G. H. Golub and C. F. V. Loan, Matrix Computations. Baltimore, MD, USA: The Johns Hopkins Univ. Press, 1996.
60. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation, " IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
61. P. Tseng, "Convergence of a block coordinate descent method for nondifferentiable minimization, " J. Optim. Theory Appl., vol. 109, no. 3, pp. 475-494, 2001.
62. R. T. Rockafellar and R. J.-B. Wets, Variational Analysis. Berlin, Germany: Springer-Verlag, 1998.
63. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image denoising by sparse 3D transform-domain collaborative filtering, " IEEE Trans. Image Process., vol. 16, no. 8, pp. 2080-2095, Aug. 2007.
64. B. Ning, X. Qu, D. Guo, C. Hu, and Z. Chen, "Magnetic resonance image reconstruction using trained geometric directions in 2D redundant wavelets domain and non-convex optimization, " Magn. Resonance Imag., vol. 31, no. 9, pp. 1611-1622, 2013.
65. M. Lustig, "Michael Lustig home page, " 2014. [Online]. Available: http://www. eecs. berkeley. edu/?mlustig/Software. html. Accessed: Oct., 2014.
66. X. Qu, "PBDWS Code, " 2014. [Online]. Available: http://www. quxiaobo. org/project/CS-MRI-PBDWS/Demo-PBDWS-SparseMRI. zip. Accessed: Sep., 2014.
67. X. Qu, "PANO Code, " 2014. [Online]. Available: http://www. quxiaobo. org/project/CS-MRI-PANO/Demo-PANO-SparseMRI. zip. Accessed: May, 2015.
68. S. Ravishankar and Y. Bresler, "DLMRI-Lab: Dictionary learning MRI software, " 2013. [Online]. Available: http://www. ifp. illinois. edu/ ?yoram/DLMRI-Lab/DLMRI. html. Accessed: Oct., 2014.
69. S. Ravishankar and Y. Bresler, "Transform learning software, " 2016. [Online]. Available: http://transformlearning. csl. illinois. edu/software/
70. X. Qu, "PANO Code with multi-core cpu parallel computing, " 2014. [Online]. Available: http://www. quxiaobo. org/project/CS- MRI-PANO/Demo-Parallel-PANO-SparseMRI. zip. Accessed: Apr., 2015.
71. Y. Mohsin, G. Ongie, and M. Jacob, "Iterative shrinkage algorithm for patch-smoothness regularized medical image recovery, " IEEE Trans. Med. Imag., vol. 34, no. 12, pp. 2417-2428, Dec. 2015.
72. S. Ravishankar and Y. Bresler, "Learning overcomplete sparsifying transforms for signal processing, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., May 2013, pp. 3088-3092.
73. I. B. Kerfoot, Y. Bresler, and A. S. Belmont, "Mean-field and informationtheoretic algorithms for direct segmentation of tomographic images, " Proc. SPIE, vol. 1905, 1993, pp. 956-963.
74. I. B. Kerfoot andY. Bresler, "Theoretical analysis of a multiscale algorithm for the direct segmentation of tomographic images, " in Proc. IEEE Int. Conf. Image Process., 1994, vol. 2, pp. 177-181.
75. I.-T. Hsiao, A. Rangarajan, and G. Gindi, "Joint-map reconstruction/ segmentation for transmission tomography using mixture-models as priors, " in Proc. Conf. Rec. IEEE Nucl. Sci. Symp., 1998, vol. 3, pp. 1689-1693.
76. D. V. de Sompel and M. Brady, "Simultaneous reconstruction and segmentation algorithm for positron emission tomography and transmission tomography, " in Proc. IEEE Int. Symp. Biomed. Imag., 2008, pp. 1035-1038.
77. J. Caballero, W. Bai, A. N. Price, D. Rueckert, and J. V. Hajnal, "Application-driven MRI: Joint reconstruction and segmentation from undersampled MRI data, " in Proc. Med. Image Comput. Comput.-Assisted Intervention Conf., 2014, pp. 106-113.