Online sparsifying transform learning for signal processing

2014 IEEE Global Conference on Signal and Information Processing, GlobalSIP 2014

Volumn , Issue , 2014, Pages 364-368

  Ravishankar, Saiprasad ^a   Weni, Bihan ^a   Bresler, Yoram ^a  

^a United States of America   (United States)

Author keywords

Big data; Denoising; Dictionary learning; Online learning; Sparse representations; Sparsifying transforms

Indexed keywords

BIG DATA; COMPRESSED SENSING; IMAGE DENOISING; IMAGE PROCESSING; INFORMATION SCIENCE; LEARNING ALGORITHMS; SIGNAL DENOISING; SIGNAL PROCESSING; SOCIAL NETWORKING (ONLINE);

COMPUTATIONAL COSTS; DE-NOISING; DICTIONARY LEARNING; ONLINE LEARNING; SEQUENTIAL LEARNING; SIGNAL AND IMAGE PROCESSING; SIGNAL PROCESSING APPLICATIONS; SPARSE REPRESENTATION;

E-LEARNING;

EID: 84983189688     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/GlobalSIP.2014.7032140     Document Type: Conference Paper

References (27)

1. M. Elad, P. Milanfar, and R. Rubinstein, "Analysis versus synthesis in signal priors, " Inverse Problems, vol. 23, no. 3, pp. 947-968, 2007.
2. S. Nam, M. E. Davies, M. Elad, and R. Gribonval, "Cosparse analysis modeling-uniqueness and algorithms, " in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2011, pp. 5804-5807.
3. W. K. Pratt, J. Kane, and H. C. Andrews, "Hadamard transform image coding, " Proc. IEEE, vol. 57, no. 1, pp. 58-68, 1969.
4. S. Ravishankar and Y. Bresler, "Learning sparsifying transforms, " IEEE Trans. Signal Process., vol. 61, no. 5, pp. 1072-1086, 2013.
5. A. M. Bruckstein, D. L. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images, " SIAM Review, vol. 51, no. 1, pp. 34-81, 2009.
6. R. Rubinstein, T. Faktor, and M. Elad, "K-SVD dictionary-learning for the analysis sparse model, " in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2012, pp. 5405-5408.
7. R. Rubinstein and M. Elad, "K-SVD dictionary-learning for analysis sparse models, " in Proc. SPARS11, June 2011, p. 73.
8. S. Mallat, A Wavelet Tour of Signal Processing. Academic Press, 1999.
9. B. K. Natarajan, "Sparse approximate solutions to linear systems, " SIAM J. Comput., vol. 24, no. 2, pp. 227-234, Apr. 1995.
10. G. Davis, S. Mallat, and M. Avellaneda, "Adaptive greedy approximations, " Journal of Constructive Approximation, vol. 13, no. 1, pp. 57-98, 1997.
11. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images, " Nature, vol. 381, no. 6583, pp. 607-609, 1996.
12. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation, " IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, 2006.
13. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries, " IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, 2006.
14. K. Skretting and K. Engan, "Recursive least squares dictionary learning algorithm, " IEEE Trans. Signal Process., vol. 58, no. 4, pp. 2121-2130, 2010.
15. M. Yaghoobi, S. Nam, R. Gribonval, and M. Davies, "Analysis operator learning for overcomplete cosparse representations, " in European Signal Processing Conference (EUSIPCO), 2011, pp. 1470-1474.
16. B. Ophir, M. Elad, N. Bertin, and M. Plumbley, "Sequential minimal eigenvalues-an approach to analysis dictionary learning, " in Proc. European Signal Processing Conference (EUSIPCO), 2011, pp. 1465-1469.
17. M. Yaghoobi, S. Nam, R. Gribonval, and M. E. Davies, "Constrained overcomplete analysis operator learning for cosparse signal modelling, " IEEE Trans. Signal Process., vol. 61, no. 9, pp. 2341-2355, 2013.
18. S. Ravishankar and Y. Bresler, "Learning doubly sparse transforms for images, " IEEE Trans. Image Process., vol. 22, no. 12, pp. 4598-4612, 2013.
19. -, "Sparsifying transform learning for compressed sensing MRI, " in Proc. IEEE Int. Symp. Biomed. Imag., 2013, pp. 17-20.
20. L. Pfister, "Tomographic reconstruction with adaptive sparsifying transforms, " Master's thesis, University of Illinois at Urbana-Champaign, Aug. 2013.
21. S. Ravishankar and Y. Bresler, "Closed-form solutions within sparsifying transform learning, " in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 5378-5382.
22. -, "0 sparsifying transform learning with efficient optimal updates and convergence guarantees, " IEEE Trans. Signal Process., 2014, submitted. Online: https://uofi. box. com/s/oq8xokc7ozgv3yl47ytc.
23. -, "Online sparsifying transform learning-part II: Convergence analysis, " IEEE Journal of Selected Topics in Signal Process., 2014, accepted for publication. Online: https://uofi. box. com/s/e691o7vjiuv6rfwvwo6d.
24. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online learning for matrix factorization and sparse coding, " J. Mach. Learn. Res., vol. 11, pp. 19-60, 2010.
25. S. Ravishankar, B. Wen, and Y. Bresler, "Online sparsifying transform learning-part I: Algorithms, " IEEE Journal of Selected Topics in Signal Process., 2014, accepted for publication. Online: https://uofi. app. box. com/s/dry7pjyjo09p2pcv1ooi.
26. P. Stange, "On the efficient update of the singular value decomposition, " PAMM, vol. 8, no. 1, pp. 10 827-10 828, 2008.
27. M. Elad, "Michael Elad personal page, " http://www. cs. technion. ac. il/-elad/Various/KSVD Matlab ToolBox. zip, 2009.