Coupled dictionary training for image super-resolution

IEEE Transactions on Image Processing

Volumn 21, Issue 8, 2012, Pages 3467-3478

  Yang, Jianchao ^a   Wang, Zhaowen ^a   Lin, Zhe ^b   Cohen, Scott ^b   Huang, Thomas ^a  

^a University of Illinois at Urbana Champaign   (United States)

^b ADOBE RESEARCH   (United States)

Author keywords

Dictionary learning; image restoration; image super resolution; sparse coding; sparse recovery

Indexed keywords

BILEVEL OPTIMIZATION PROBLEMS; DICTIONARY LEARNING; EXPERIMENTAL COMPARISON; HIGH RESOLUTION IMAGE; IMAGE PATCHES; IMAGE SUPER-RESOLUTION; LEARNING PROBLEM; LEARNING PROCESS; LOW RESOLUTION IMAGES; MINIMIZATION PROBLEMS; NEURAL NETWORK MODEL; REAL APPLICATIONS; SALIENT REGIONS; SPARSE CODING; SPARSE RECOVERY; SPARSE REPRESENTATION; STOCHASTIC GRADIENT DESCENT; SUPERRESOLUTION; TRAINING METHODS;

ALGORITHMS; IMAGE RECONSTRUCTION; INFERENCE ENGINES; LEARNING SYSTEMS; OPTICAL RESOLVING POWER; OPTIMIZATION;

IMAGE CODING;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; PROCEDURES;

ALGORITHMS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 84864128043     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2192127     Document Type: Article

References (35)

1. D. L. Donoho, "De-noising by soft-thresholding," IEEE Trans. Inform. Theory, vol. 41, no. 3, pp. 613-627, May 1995.
2. R. Rubinstein, A. M. Bruckstein, and M. Elad, "Dictionaries for sparse representation modeling," Proc. IEEE, vol. 98, no. 6, pp. 1045-1057, Jun. 2010.
3. K. Engan, S. O. Aase, and J. H. Husoy, "Method of optimal directions for frame design," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Mar. 1999, pp. 2443-2446.
4. M. Aharon, M. Elad, and A. Bruckstein, "K-svd: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Image Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
5. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms," Adv. Neural Inform. Process. Syst., vol. 19, no. 2, pp. 801- 808, 2007.
6. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online dictionary learning for sparse coding," in Proc. Int. Conf. Mach. Learn., 2009, pp. 689-696.
7. J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. Image Process., vol. 17, no. 1, pp. 53-69, Jan. 2008.
8. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 1-8, Nov. 2010.
9. A. Adler, Y. Hel-Or, and M. Elad, "A shrinkage learning approach for single image super-resolution with overcomplete representations," in Proc. Eur. Conf. Comput. Vision, 2010, pp. 622-635.
10. E. J. Candès, "Compressive sampling," in Proc. Int. Congr. Math., 2006, p. 1.
11. J. Yang, K. Yu, and T. S. Huang, "Supervised translation-invariant sparse coding," in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2010, pp. 3517-3524.
12. J. Mairal, F. Bach, and J. Ponce, "Task-driven dictionary learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 791-804, Apr. 2011.
13. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe super-resolution," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1327-1344, Oct. 2004.
14. R. C. Hardie, K. J. Barnard, and E. A. Armstrong, "Joint map registration and high-resolution image estimation using a sequence of undersampled images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1621-1633, Dec. 1997. (Pubitemid 127770518)
15. M. E. Tipping and C. M. Bishop, "Bayesian image super-resolution, " Adv. Neural Inform. Process. Syst. vol. 16, no. 15, pp. 1279-1286, 2002.
16. S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1167- 1183, Sep. 2002. (Pubitemid 35242579)
17. H. Chang, D. Yeung, and Y. Xiong, "Super-resolution through neighbor embedding," in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2004, pp. 275-282.
18. W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-based superresolution," IEEE Comput. Graph. Appl., vol. 22, no. 2, pp. 56-65, Mar.- Apr. 2002.
19. J. Sun, Z. Xu, and H. Shum, "Image super-resolution using gradient profile prior," in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2008, pp. 1-8.
20. G. Freedman and R. Fattal, "Image and video upscaling from local selfexamples," ACM Trans. Graph., vol. 28, no. 3, pp. 1-10, 2010.
21. D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image," in Proc. IEEE Int. Conf. Comput. Vision, 2009, pp. 349-356.
22. G. Peyre, S. Bougleux, and L. Cohen, "Non-local regularization of inverse problems," in Proc. Eur. Conf. Comput. Vision, 2008, pp. 1-10.
23. M. Protter, M. Elad, H. Takeda, and P. Milanfar, "Generalizing the non-local means to super-resolution reconstruction," IEEE Trans. Image Process., vol. 18, no. 1, pp. 36-581, Jan. 2009.
24. H. Zhang, J. Yang, Y. Zhang, and T. S. Huang, "Non-local kernel regression for image and video restoration," in Proc. Eur. Conf. Comput. Vision, 2010, pp. 566-579.
25. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches," in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2008, pp. 1-8.
26. K. Gregor and Y. LeCun, "Learning fast approximations of sparse coding," in Proc. Int. Conf. Mach. Learn., 2010, pp. 399-406.
27. B. Colson, P. Marcotte, and G. Savard, "An overview of bilevel optimization," Ann. Operat. Res., vol. 153, no. 1, pp. 235-256, 2007.
28. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," Annu. Stat., vol. 32, pp. 407-499, Jun. 2004. (Pubitemid 41250302)
29. D. Bradley and J. A. Bagnell, "Differentiable sparse coding," in Proc. Adv. Neural Inform. Process. Syst., 2008, pp. 113-120.
30. H. Zou, T. Hastie, and R. Tibshirani, "On the degree of freedom of the lasso," Annu. Stat., vol. 35, no. 5, pp. 2173-2192, 2007.
31. K. Jarrett, K. Kavukcuoglu, M. Ranzato, and Y. LeCun, "What is the best multi-stage architecture for object recognition?" in Proc. IEEE Int. Conf. Comput. Vision, 2009, pp. 2146-2153.
32. K. Kavukcuoglu, M. Ranzato, and Y. LeCun, "Fast inference in sparse coding algorithms with applications to object recognition," Computational and Biological Learning Lab, Courant Inst., New York University, New York, Tech. Rep. CBLL-TR-2008-12-01, 2008.
33. A. Beck and M. Teboulle, "A fast iterative shrinkage thresholding algorithm with application to wavelet based image deblurring," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., 2009, pp. 693-696.
34. Q. Shan, Z. Li, J. Jia, and C. Tang, "Fast image/video upsampling," ACM Trans. Graph., vol. 27, no. 5, pp. 1-7, 2008.
35. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online learning for matrix factorization and sparse coding," J. Mach. Learn. Res., vol. 11, pp. 19- 60, Mar. 2010.