Robust Multi-Focus Image Fusion Using Multi-Task Sparse Representation and Spatial Context

IEEE Transactions on Image Processing

Volumn 25, Issue 5, 2016, Pages 2045-2058

  Zhang, Qiang ^a   Levine, Martin D ^b  

^a XIDIAN UNIVERSITY   (China)

^b MCGILL UNIVERSITY   (Canada)

Author keywords

image patch misregistration; multi focus image fusion; multi task robust sparse representation; spatial context

Indexed keywords

ALGORITHMS;

GRAY LEVEL IMAGE; MISREGISTRATION; MULTIFOCUS IMAGE FUSION; RECONSTRUCTION ERROR; SPARSE RECONSTRUCTION; SPARSE REPRESENTATION; SPATIAL CONTEXT; STATE OF THE ART;

IMAGE FUSION;

EID: 84963831223     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2524212     Document Type: Article

References (40)

1. Y. Liu, S. Liu, Z. Wang, "Multi-focus image fusion with dense SIFT, " Inf. Fusion, vol. 23, pp. 139-155, May 2015.
2. Q. Zhang and B. L. Guo, "Multifocus image fusion using the nonsubsampled contourlet transform, " Signal Process., vol. 89, pp. 1334-1346, Jul. 2009.
3. S. Li, B. Yang, J. Hu, "Performance comparison of different multiresolution transforms for image fusion, " Inf. Fusion, vol. 12, pp. 74-84, Apr. 2011.
4. T. Wan, C. Zhu, Z. Qin, "Multifocus image fusion based on robust principal component analysis, " Pattern Recognit. Lett., vol. 34, pp. 1001-1008, Jul. 2013.
5. V. N. Gangapure, S. Banerjee, A. S. Chowdhury, "Steerable local frequency based multispectral multifocus image fusion, " Inf. Fusion, vol. 23, pp. 99-115, May 2015.
6. S. Pertuz, D. Puig, M. A. Garcia, A. Fusiello, "Generation of all-infocus images by noise-robust selective fusion of limited depth-of-field images, " IEEE Trans. Image Process., vol. 22, no. 3, pp. 1242-1251, Mar. 2013.
7. L. Cao, L. Jin, H. Tao, G. Li, Z. Zhuang, Y. Zhang, "Multi-focus image fusion based on spatial frequency in discrete cosine transform domain, " IEEE Signal Process. Lett., vol. 22, no. 2, pp. 220-224, Feb. 2015.
8. B. Yang and S. Li, "Multifocus image fusion and restoration with sparse representation, " IEEE Trans. Instrum. Meas., vol. 59, no. 4, pp. 884-892, Apr. 2010.
9. Y. Liu, S. Liu, Z. F. Wang, "A general framework for image fusion based on multi-scale transform and sparse representation, " Inf. Fusion, vol. 24, pp. 147-164, Jul. 2015.
10. M. Nejati, S. Samavi, S. Shirani, "Multi-focus image fusion using dictionary-based sparse representation, " Inf. Fusion, vol. 25, pp. 72-84, Sep. 2015.
11. L. Chen, J. Li, C. L. P. Chen, "Regional multifocus image fusion using sparse representation, " Opt. Exp., vol. 21, no. 4, pp. 5182-5197, 2013.
12. Y. Liu and Z. Wang, "Simultaneous image fusion and denoising with adaptive sparse representation, " IET Image Process., vol. 9, no. 5, pp. 347-357, 2015.
13. S. Li, H. Yin, L. Fang, "Group-sparse representation with dictionary learning for medical image denoising and fusion, " IEEE Trans. Biomed. Eng., vol. 59, no. 12, pp. 3450-3459, Dec. 2012.
14. M. Aharon, M. Elad, A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation, " IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
15. Q. Li, H. Zhang, J. Guo, B. Bhanu, L. An, "Reference-based scheme combined with K-SVD for scene image categorization, " IEEE Signal Process. Lett., vol. 20, no. 1, pp. 67-70, Jan. 2013.
16. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, Y. Ma, "Robust face recognition via sparse representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
17. T. Guha and R. K. Ward, "Learning sparse representations for human action recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 8, pp. 1576-1588, Aug. 2012.
18. E. Elhamifar and R. Vidal, "Sparse subspace clustering: Algorithm, theory, applications, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2765-2781, Nov. 2013.
19. X.-T. Yuan, X. Liu, S. Yan, "Visual classification with multitask joint sparse representation, " IEEE Trans. Image Process., vol. 21, no. 10, pp. 4349-4360, Oct. 2012.
20. Y. P. Liu, J. Jin, Q. Wang, Y. Shen, X. Dong, "Region level based multi-focus image fusion using quaternion wavelet and normalized cut, " Signal Process., vol. 97, pp. 9-30, Apr. 2014.
21. L. Guo, M. Dai, M. Zhu, "Multifocus color image fusion based on quaternion curvelet transform, " Opt. Exp., vol. 20, no. 17, pp. 18846-18860, 2012.
22. Q.-G. Miao, C. Shi, P.-F. Xu, M. Yang, Y.-B. Shi, "A novel algorithm of image fusion using shearlets, " Opt. Commun., vol. 284, no. 6, pp. 1540-1547, 2011.
23. Y. Chai, H. Li, X. Zhang, "Multifocus image fusion based on features contrast of multiscale products in nonsubsampled contourlet transform domain, " Optik-Int. J. Light Electron Opt., vol. 123, pp. 569-581, Apr. 2012.
24. H. Zhao, Z. Shang, Y. Y. Tang, B. Fang, "Multi-focus image fusion based on the neighbor distance, " Pattern Recognit., vol. 46, pp. 1002-1011, Mar. 2013.
25. V. Aslantas and R. Kurban, "Fusion of multi-focus images using differential evolution algorithm, " Expert Syst. Appl., vol. 37, pp. 8861-8870, Dec. 2010.
26. M. Li, W. Cai, Z. Tan, "A region-based multi-sensor image fusion scheme using pulse-coupled neural network, " Pattern Recognit. Lett., vol. 27, no. 16, pp. 1948-1956, 2006.
27. S. Li, X. Kang, J. Hu, "Image fusion with guided filtering, " IEEE Trans. Image Process., vol. 22, no. 7, pp. 2864-2875, Jul. 2013.
28. S. Li, X. Kang, J. Hu, B. Yang, "Image matting for fusion of multi-focus images in dynamic scenes, " Inf. Fusion, vol. 14, no. 2, pp. 147-162, 2013.
29. H. Li, Y. Chai, H. Yin, G. Liu, "Multifocus image fusion and denoising scheme based on homogeneity similarity, " Opt. Commun., vol. 285, no. 2, pp. 91-100, 2012.
30. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, Y. Ma, "Robust recovery of subspace structures by low-rank representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171-184, Jan. 2013.
31. Z. Lin, R. Liu, Z. Su, "Linearized alternating direction method with adaptive penalty for low-rank representation, " in Proc. Adv. Neural Inf. Process. Syst., 2011, pp. 1-9.
32. Y. Zhang, Z. Jiang, L. S. Davis, "Learning structured low-rank representations for image classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 676-683.
33. C. Lang, G. Liu, J. Yu, S. Yan, "Saliency detection by multitask sparsity pursuit, " IEEE Trans. Image Process., vol. 21, no. 3, pp. 1327-1338, Mar. 2012.
34. X. Wang, W. Wan, G. Liu, "Multi-task low-rank and sparse matrix recovery for human motion segmentation, " in Proc. 19th IEEE Int. Conf. Image Process., Sep./Oct. 2012, pp. 897-900.
35. E. J. Candès, X. Li, Y. Ma, J. Wright, "Robust principal component analysis?" J. ACM, vol. 58, no. 3, pp. 1-37, May 2011.
36. G. Qu, D. Zhang, P. Yan, "Information measure for performance of image fusion, " Electron. Lett., vol. 38, no. 7, pp. 313-315, Mar. 2002.
37. C. S. Xydeas and V. Petrovic, "Objective image fusion performance measure, " Electron. Lett., vol. 36, no. 4, pp. 308-309, Feb. 2000.
38. Z. Liu, D. S. Forsyth, R. Laganiére, "A feature-based metric for the quantitative evaluation of pixel-level image fusion, " Comput. Vis. Image Understand., vol. 109, no. 1, pp. 56-68, 2008.
39. Q. Zhang, Z. Ma, L. Wang, "Multimodality image fusion by using both phase and magnitude information, " Pattern Recognit. Lett., vol. 34, pp. 185-193, Jan. 2013.
40. J.-F. Cai, E. J. Candes, Z. Shen, "A singular value thresholding algorithm for matrix completion, " SIAM J. Optim., vol. 20, no. 4, pp. 1956-1982, 2010.