Joint patch clustering-based dictionary learning for multimodal image fusion

Information Fusion

Volumn 27, Issue , 2016, Pages 198-214

  Kim, Minjae ^a   Han, David K ^b   Ko, Hanseok ^a  

^a Korea University   (South Korea)

^b OFFICE OF NAVAL RESEARCH   (United States)

Author keywords

Clustering; Dictionary learning; K SVD; Multimodal image fusion; Sparse representation

Indexed keywords

IMAGE MATCHING;

CLUSTERING; DICTIONARY LEARNING; IMAGE FUSION TECHNIQUES; MULTIMODAL IMAGE FUSIONS; ORTHOGONAL MATCHING PURSUIT; OVER-COMPLETE DICTIONARIES; SPARSE REPRESENTATION; STRUCTURAL SIMILARITY;

IMAGE FUSION;

EID: 84938200080     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.inffus.2015.03.003     Document Type: Article

References (60)

1. A.A. Goshtasby, and S. Nikolov Image fusion: advances in the state of the art Inform. Fusion 8 2 2007 114 118
2. J. Bae, B. Ku, D.K. Han, H. Ko, Combining infrared and visible images using novel transform and statistical information, in: Proceedings of the 9th IEEE International Conference on Advanced Video and Signal-Based Surveillance, 2012, pp. 149-153.
3. A. James, and B. Dasarathy Medical image fusion: a survey of the state of the art Inform. Fusion 19 2014 4 19
4. S. Daneshvar, and H. Ghassemian MRI and PET image fusion by combining IHS and retina-inspired models Inform. Fusion 11 2 2010 114 123
5. Z. Xue, R.S. Blum, Concealed weapon detection using color image fusion, in: Proceedings of the 6th International Conference of Information Fusion, 2003, pp. 622-627.
6. X. Gang, Y. Bo, Infrared and visible dynamic image sequence fusion based on region target detection, in: Proceedings of the 10th International Conference of Information Fusion, 2007, pp. 1-5.
7. M. Zribi Non-parametric and region-based image fusion with bootstrap sampling Inform. Fusion 11 2 2010 85 94
8. V.S. Petrovic, and C.S. Xydeas Gradient-based multiresolution image fusion IEEE Trans. Image Process. 13 2 2004 228 237
9. N. Mitianoudis, and T. Stathaki Pixel-based and region-based image fusion schemes using ICA bases Inform. Fusion 8 2 2007 131 142
10. N. Mitianousdis, and T. Stathaki Optimal contrast correction for ICA-based fusion of multimodal images IEEE Sens. J. 8 12 2008 2016 2026
11. S. Li, B. Yang, and J. Hu Performance comparison of different multi-resolution transforms for image fusion Inform. Fusion 12 2 2011 74 84
12. H. Li, B. Manjunath, and S. Mitra Multisensor image fusion using the wavelet transform Graph. Models Image Process. 57 3 1995 235 245
13. G. Pajares, and J. Cruz A wavelet-based image fusion tutorial Pattern Recogn. 37 9 2004 1855 1872
14. J.J. Lewis, R.J. Ocallaghan, and S.G. Nikolov Pixel- and region-based image fusion with complex wavelets Inform. Fusion 8 2 2007 119 130
15. J.J. Lewis, R.J. Ocallaghan, S.G. Nikolov, D.R. Bull, C.N. Canagarajah, Region-based image fusion using complex wavelets, in: Proceedings of the 7th International Conference on Information Fusion, 2004, pp. 555-562.
16. F. Nencini, A. Garzelli, S. Baronti, and L. Alparone Remote sensing image fusion using the curvelet transform Inform. Fusion 8 2 2007 143 156
17. L. Tessens, A. Ledda, A. Pizurica, W. Philips, Extending the depth of field in microscopy through curvelet-based frequency-adaptive image fusion, in: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, 2007, pp. I-861-I-864.
18. S.Y. Yang, M. Wang, L.C. Jiao, R.X. Wua, and Z.X. Wang Image fusion based on a new contourlet packet Inform. Fusion 11 2 2010 78 84
19. Q. Miao, C. Shi, P. Xu, M. Yang, and Y. Shi A novel algorithm of image fusion using shearlets Opt. Commun. 284 2011 1540 1547
20. L. Wang, B. Li, and L. Tian Multi-modal medical image fusion using the inter-scale and intra-scale dependencies between image shift-invariant shearlet coefficients Inform. Fusion 19 2014 20 28
21. L.D. Cunha, and J.P. Zhou The nonsubsampled contourlet transform: theory, design, and applications IEEE Trans. Image Process. 15 10 2006 3089 3101
22. Q. Zhang, and B.L. Guo Multi-focus image fusion using the nonsubsampled contourlet transform Signal Process. 89 7 2009 1334 1346
23. B. Yang, and S. Li Pixel-level image fusion with simultaneous orthogonal matching pursuit Inform. Fusion 13 1 2012 10 19
24. H. Yin, and S. Li Multimodal image fusion with joint sparsity model Opt. Eng. 50 6 2011 067007
25. M. Kim, D.K. Han, H. Ko, Multimodal image fusion via sparse representation with local patch dictionaries, in: Proceedings of the IEEE International Conference on Image Processing, 2013, pp. 1301-1305.
26. D.L. Donoho Compressed sensing IEEE Trans. Inform. Theory 52 4 2006 1289 1306
27. A.M. Bruckstein, D.L. Donoho, and M. Elad From sparse solutions of systems of equations to sparse modeling of signals and images SIAM Rev. 51 1 2007 34 81
28. J. Wright, Y. Ma, J. Mairal, G. Sapiro, T.S. Huang, and S. Yan Sparse representation for computer vision and pattern recognition Proc. IEEE 98 6 2010 1031 1044
29. M. Elad Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing 2010 Springer
30. M. Aharon, M. Elad, and A. Bruckstein The K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation IEEE Trans. Signal Process. 54 11 2006 4311 4322
31. M. Elad, and M. Aharon Image denoising via sparse and redundant representations over learned dictionaries IEEE Trans. Image Process. 15 12 2006 3736 3745
32. J. Mairal, M. Sapiro, and G. Sapiro Sparse representation for color image restoration IEEE Trans. Image Process. 17 1 2008 53 68
33. W.S. Dong, L. Zhang, G.M. Shi, and X.L. Wu Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization IEEE Trans. Image Process. 20 7 2011 1838 1857
34. B. Yang, and S. Li Multifocus image fusion and restoration with sparse representation IEEE Trans. Instrum. Meas. 59 4 2010 884 892
35. H. Yin, S. Li, and L. Fang Simultaneous image fusion and super-resolution using sparse representation Inform. Fusion 14 3 2013 229 240
36. M. Ding, L. Wei, and B. Wang Research on fusion method for infrared and visible images via compressive sensing Infrared Phys. Technol. 57 2013 56 67
37. N. Yu, T. Qiu, F. Bi, and A. Wang Image features extraction and fusion based on joint sparse representation IEEE J. Sel. Top. Signal Process. 5 5 2011 1074 1082
38. B. Yang, J. Luo, S. Li, Color image fusion with extend joint sparse model, in: Proceedings of the 21st International Conference on Pattern Recognition, 2012, pp. 376-379.
39. S. Li, H. Yin, and L. Fang Group-sparse representation with dictionary learning for medical image denoising and fusion IEEE Trans. Biomed. Eng. 59 12 2012 3450 3459
40. Q. Zhang, Y. Fu, H. Li, and J. Zou Dictionary learning method for joint sparse representation-based image fusion Opt. Eng. 52 5 2013 057006
41. P. Chatterjee, and P. Milanfar Clustering-based denoising with locally learned dictionaries IEEE Trans. Image Process. 18 7 2009 1438 1451
42. H. Takeda, S. Farsiu, and P. Milanfar Kernel regression for image processing and reconstruction IEEE Trans. Image Process. 16 2 2007 349 366
43. S.G. Mallat, and Z. Zhang Matching pursuits with time-frequency dictionaries IEEE Trans. Signal Process. 41 12 1993 3397 3415
44. R. Rubinstein, M. Zibulevsky, and M. Elad Double sparsity: learning sparse dictionaries for sparse signal approximation IEEE Trans. Signal Process. 58 3 2010 1553 1564
45. J. Mairal, F. Bach, J. Ponce, G. Sapiro, A. Zisserman, Non-local sparse model for image restoration, in: Proceedings of the 12th International Conference on Computer Vision, 2009, pp. 2272-2279.
46. W. Dong, X. Li, L. Zhang, G. Shi, Sparsity-based image denoising via dictionary learning and structural clustering, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2011, pp. 457-464.
47. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian Image denoising by sparse 3-D transform-domain collaborative filtering IEEE Trans. Image Process. 16 8 2007 2080 2095
48. J.A. Tropp, A.C. Gilbert, and M.J. Strauss Strauss, algorithms for simultaneous sparse approximation. Part I: greedy pursuit Signal Process. 86 3 2006 572 588
49. S. Lloyd Least squares quantization in PCM IEEE Trans. Inform. Theory 28 2 1982 129 137
50. M. Elad, and I. Yavneh A plurality of sparse representations is better than the sparsest one alone IEEE Trans. Inform. Theory 55 10 2009 4701 4714
51. W. Dong, L. Zhang, R. Lukac, and G. Shi Sparse representation based image interpolation with nonlocal autoregressive modeling IEEE Trans. Image Process. 22 4 2013 1382 1394
52. W. Dong, L. Zhang, G. Shi, and X. Li Nonlocally centralized sparse representation for image restoration IEEE Trans. Image Process. 22 4 2013 1620 1630
53. D.L. Donoho, and I.M. Johnstone Ideal spatial adaptation via wavelet shrinkage Biometrika 81 3 1994 425 455
54. G.H. Qu, D.L. Zhang, and P.F. Yan Information measure for performance of image fusion Electron. Lett. 38 7 2002 313 315
55. G. Piella, H. Heijmans, A new quality metric for image fusion, in: Proceedings of the International Conference on Image Processing, 2003, pp. 173-176.
56. V. Petrovic Subjective tests for image fusion evaluation and objective metric validation Inform. Fusion 8 2 2007 208 216
57. C.S. Xydeas, and V. Petrovic Objective image fusion performance measure Electron. Lett. 36 4 2000 308 309
58. H.R. Sheikh, and A.C. Bovik Image information and visual quality IEEE Trans. Image Process. 15 2 2006 430 444
59. Y. Han, Y. Cai, Y. Cao, and X. Xu A new image fusion performance metric based on visual information fidelity Inform. Fusion 14 2 2013 127 135
60. U. Javed, M.M. Riza, A. Ghafoor, S.S. Ali, and T.A. Cheema MRI and PET image fusion using fuzzy logic and image local features Sci. World J. 2014 1 8 Article ID 708075