Image Fusion with Convolutional Sparse Representation

IEEE Signal Processing Letters

Volumn 23, Issue 12, 2016, Pages 1882-1886

  Liu, Yu ^a   Chen, Xun ^a   Ward, Rabab K ^b   Wang, Jane ^b  

^a HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Convolutional sparse representation (CSR); detail preservation; image fusion; shift invariance; sparse representation (SR)

Indexed keywords

CONVOLUTION; IMAGE CODING; SIGNAL PROCESSING;

DETAIL PRESERVATION; EFFECTIVE ALGORITHMS; MULTIFOCUS IMAGE FUSION; MULTIMODAL IMAGE FUSIONS; OBJECTIVE ASSESSMENT; SHIFT INVARIANCE; SIGNAL DECOMPOSITION; SPARSE REPRESENTATION;

IMAGE FUSION;

EID: 85005999434     PISSN: 10709908     EISSN: None     Source Type: Journal    
DOI: 10.1109/LSP.2016.2618776     Document Type: Article

References (38)

1. S. Li, X. Kang, L. Fang, J. Hu, and H. Yin, "Pixel-level image fusion: A survey of the state of the art," Inf. Fusion, vol. 33, pp. 100-112, 2017.
2. T. Stathaki, Image Fusion: Algorithms and Applications. New York, NY, USA: Academic, 2008.
3. S. Li, J. Kwok, and Y. Wang, "Combination of imageswith diverse focuses using the spatial frequency," Inf. Fusion, vol. 2, no. 3, pp. 169-176, 2001.
4. A. Goshtasby, "Fusion of multi-exposure images," Image Vis. Comput., vol. 23, no. 6, pp. 611-618, 2005.
5. V. Aslantas and R. Kurban, "Fusion of multi-focus images using differential evolution algorithm," Expert Syst. Appl., vol. 37, no. 12, pp. 8861-8870, 2010.
6. X. Bai, Y. Zhang, F. Zhou, and B. Xue, "Quadtree-based multi-focus image fusion using a weighted focus-measure," Inf. Fusion, vol. 22, no. 1, pp. 105-118, 2015.
7. S. Li, X. Kang, J. Hu, and B. Y, "Image matting for fusion of multi-focus images in dynamic scenes," Inf. Fusion, vol. 14, no. 2, pp. 147-162, 2013.
8. W. Zhang and W.-K. Cham, "Gradient-directed multiexposure composition," IEEE Trans. Image Process., vol. 21, no. 4, pp. 2318-2323, Apr. 2012.
9. B. Gu, W. Li, J. Wong, M. Zhu, and M. Wang, "Gradient field multiexposure images fusion for high dynamic range image visualization," J. Vis. Commun. Image Represent., vol. 23, no. 4, pp. 604-610, 2012.
10. Y. Liu, S. Liu, and Z. Wang, "Multi-focus image fusion with dense sift," Inf. Fusion, vol. 23, no. 1, pp. 139-155, 2015.
11. P. Burt and R. Kolczynski, "Enhanced image capture through fusion," in Proc. IEEE Int. Conf. Comput. Vis., 1993, pp. 173-182.
12. H. Li, B. Manjunath, and S. Mitra, "Multisensor image fusion using the wavelet transform," Graph. Models Image Process., vol. 57, no. 3, pp. 235-245, 1995.
13. L. Cao, L. Jin, H. Tao, G. Li, Z. Zhuang, and Y. Zhang, "Multi-focus image fusion based on spatial frequency in discrete cosine transform domain," IEEE Signal Process. Lett., vol. 22, no. 2, pp. 220-224, Feb. 2015.
14. Q. Zhang and B. Guo, "Multifocus image fusion using the nonsubsampled contourlet transform," Signal Process., vol. 89, no. 7, pp. 1334-1346, 2009.
15. N. Mitianoudis and T. Stathaki, "Pixel-based and region-based image fusion schemes using ICA bases," Inf. Fusion, vol. 8, no. 2, pp. 131-142, 2007.
16. B. Yang and S. Li, "Multifocus image fusion and restoration with sparse representation," IEEE Trans. Instrum. Meas., vol. 59, no. 4, pp. 884-892, Apr. 2010.
17. A. Goshtasby and S. Nikolov, "Image fusion: Advances in the state of the art," Inf. Fusion, vol. 8, no. 2, pp. 114-118, 2007.
18. Y. Liu and Z. Wang, "Simultaneous image fusion and denoising with adaptive sparse representation," IET Image Process., vol. 9, no. 5, pp. 347-357, 2015.
19. B. Yang and S. Li, "Pixel-level image fusion with simultaneous orthogonal matching pursuit," Inf. Fusion, vol. 13, no. 1, pp. 10-19, 2012.
20. N. Yu, T. Qiu, F. Bi, and A. Wang, "Image features extraction and fusion based on joint sparse representation," IEEE J. Sel. Topics Signal Process., vol. 5, no. 5, pp. 1074-1082, Sep. 2011.
21. Q. Zhang and M. Levine, "Robust multi-focus image fusion using multi-task sparse representation and spatial context," IEEE Trans. Image Process., vol. 25, no. 5, pp. 2045-2058, May 2016.
22. B. Wohlberg, "Efficient algorithms for convolutional sparse representation," IEEE Trans. Image Process., vol. 25, no. 1, pp. 301-315, Jan. 2016.
23. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images," Nature, vol. 381, no. 6583, pp. 607-609, 1996.
24. A. Bruckstein, D. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol. 51, no. 1, pp. 34-81, 2009.
25. J. Yang, T. H. J. Wright, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
26. M. Wang, X. Liu, and X. Wu, "Visual classification by l1-hypergraph modeling," IEEE Trans. Knowl. Data Eng., vol. 27, no. 9, pp. 2564-2574, Sep. 2015.
27. S. Gu, W. Zuo, Q. Xie, D. Meng, X. Feng, and L. Zhang, "Convolutional sparse coding for image super-resolution," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 1823-1831.
28. H. Bristow, A. Eriksson, and S. Lucey, "Fast convolutional sparse coding," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 391-398.
29. F. Heide, W. Heidrich, and G. Wetzstein, "Fast and flexible convolutional sparse coding," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 5135-5143.
30. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed optimization and statistical learning via the alternating direction method of multipliers," Found. Trends Mach. Learn., vol. 3, no. 1, pp. 1-122, 2010.
31. M. Zeiler, D. Krishnan, G. Taylor, and R. Fergus, "Deconvolutional networks," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 2528-2535.
32. M. Lewicki and T. Sejnowski, "Coding time-varying signals using sparse, shift-invariant representations," in Proc. Adv. Neural Inf. Process. Syst., 1999, pp. 730-736.
33. M. Morup and M. Schmidt, "Transformation invariant sparse coding," in Proc. IEEE Int. Workshop Mach. Learn. Signal Process., 2011, pp. 1-6.
34. S. Li, X. Kang, and J. Hu, "Image fusion with guided filtering," IEEE Trans. Image Process., vol. 22, no. 7, pp. 2864-2875, Jul. 2013.
35. C. S. Xydeas and V. S. Petrovic, "Objective image fusion performance measure," Electron. Lett., vol. 36, no. 4, pp. 308-309, 2000.
36. Y. Chen and R. Blum, "A new automated quality assessment algorithm for image fusion," Image Vis. Comput., vol. 27, no. 10, pp. 1421-1432, 2009.
37. Y. Han, Y. Cai, Y. Cao, and X. Xu, "A new image fusion performance metric based on visual information fidelity," Inf. Fusion, vol. 14, pp. 127-135, 2013.
38. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.