Multifocus Image Fusion Based on Extreme Learning Machine and Human Visual System

IEEE Access

Volumn 5, Issue , 2017, Pages 6989-7000

  Yang, Yong ^a   Yang, Mei ^a   Huang, Shuying ^a   Que, Yue ^a   Ding, Min ^a   Sun, Jun ^a  

^a JIANGXI UNIVERSITY OF FINANCE AND ECONOMICS   (China)

Author keywords

extreme learning machine; focused regions; human visual system; Multifocus image fusion

Indexed keywords

IMAGE PROCESSING; KNOWLEDGE ACQUISITION; LEARNING SYSTEMS; PIXELS;

CLOSING OPERATION; EXTREME LEARNING MACHINE; FOCUSED REGIONS; FUSION METHODS; HUMAN VISUAL SYSTEM; MORPHOLOGICAL OPENING; MULTIFOCUS IMAGE FUSION; SUBJECTIVE AND OBJECTIVE EVALUATIONS;

IMAGE FUSION;

EID: 85028756472     PISSN: None     EISSN: 21693536     Source Type: Journal    
DOI: 10.1109/ACCESS.2017.2696119     Document Type: Article

References (42)

1. Y. Liu, S. Liu, and Z. Wang, "Multi-focus image fusion with dense SIFT, " Inf. Fusion, vol. 23, pp. 139-155, May 2015.
2. P. Geng, M. Huang, S. Liu, J. Feng, and P. Bao, "Multifocus image fusion method of Ripplet transform based on cycle spinning, " Multimedia Tools Appl., vol. 75, no. 17, pp. 1-11, 2016.
3. Y. Yang, W. Wan, S. Huang, F. Yuan, S. Yang, and Y. Que, "Remote sensing image fusion based on adaptive IHS and multiscale guided filter, " IEEE Access, vol. 4, pp. 4573-4582, Aug. 2016.
4. S. Li, X. Kang, L. Fang, J. Hu, and H. Yin, "Pixel-level image fusion: A survey of the state of the art, " Inf. Fusion, vol. 33, pp. 100-112, Jun. 2016.
5. S. Li and B. Yang, "Multifocus image fusion using region segmentation and spatial frequency, " Image Vis. Comput., vol. 26, no. 7, pp. 971-979, 2008.
6. Y. Chai, H. Li, and Z. Li, "Multifocus image fusion scheme using focused region detection and multiresolution, " Opt. Commun., vol. 284, no. 19, pp. 4376-4389, 2011.
7. M. Pagidimarry and K. A. Babu, "An all approach for multi-focus image fusion using neural network, " Artif. Intell. Syst. Mach. Learn., vol. 3, no. 12, pp. 732-739, 2011.
8. T. Tu, S. Su, H. C. Shyu, P. S. Huang, "Efficient intensity-hue-saturationbased image fusion with saturation compensation, " Opt. Eng., vol. 40, no. 5, pp. 720-728, 2001.
9. X. Bai, M. Liu, Z. Chen, P. Wang, and Y. Zhang, "Multi-focus image fusion through gradient-based decision map construction and mathematical morphology, " IEEE Access, vol. 4, pp. 4749-4760, Aug. 2016.
10. J. Tian, L. Chen, L. Ma, and W. Yu, "Multi-focus image fusion using a bilateral gradient-based sharpness criterion, " Opt. Commun., vol. 284, no. 1, pp. 80-87, 2011.
11. I. De and B. Chanda, "Multi-focus image fusion using a morphologybased focus measure in a quad-Tree structure, " Inf. Fusion, vol. 14, no. 2, pp. 136-146, 2013.
12. X. Bai, Y. Zhang, F. Zhou, and B. Xue, "Quadtree-based multi-focus image fusion using a weighted focus-measure, " Inf. Fusion, vol. 22, no. 1, pp. 105-118, 2015.
13. D. Guo, J. Yan, and X. Qu, "High quality multi-focus image fusion using self-similarity and depth information, " Opt. Commun., vol. 338, pp. 138-144, Mar. 2015.
14. S. Li, X. Kang, and J. Hu, "Image fusion with guided filtering, " IEEE Trans. Image Process., vol. 22, no. 7, pp. 2864-2875, Jul. 2013.
15. S. Li, X. Kang, J. Hu, and B. Yang, "Image matting for fusion of multifocus images in dynamic scenes, " Inf. Fusion, vol. 14, no. 2, pp. 147-162, 2013.
16. M. B. A. Haghighat, A. Aghagolzadeh, and H. Seyedarabi, "Multi-focus image fusion for visual sensor networks in DCT domain, " Comput. Electr. Eng., vol. 37, no. 5, pp. 789-797, 2011.
17. Y. Yang, "A novel DWT based multi-focus image fusion method, " Proce-dia Eng., vol. 24, no. 1, pp. 177-181, 2011.
18. S. Li and B. Yang, "Multifocus image fusion by combining curvelet and wavelet transform, " Pattern Recognit. Lett., vol. 29, no. 9, pp. 1295-1301, 2008.
19. X.-B. Qu, G.-F. Xie, J.-W. Yan, Z.-Q. Zhu, and B.-G. Chen, "Image fusion algorithm based on neighbors and cousins information in nonsubsampled contourlet transform domain, " in Proc. Int. Conf. Wavelet Anal. Pattern Recognit., Nov. 2007, pp. 1797-1802.
20. X. Li, H. Li, Z. Yu, and Y. Kong, "Multifocus image fusion scheme based on the multiscale curvature in nonsubsampled contourlet transform domain, " Opt. Eng., vol. 54, no. 7, p. 073115, 2015.
21. H. Li, X. Li, and Z. Yu, "Multifocus image fusion by combining with mixed-order structure tensors and multiscale neighborhood, " Inf. Sci., vols. 349-350, pp. 25-49, Jul. 2016.
22. Y. Liu, S. Liu, and Z. Wang, "A general framework for image fusion based on multi-scale transform and sparse representation, " Inf. Fusion, vol. 24, pp. 147-164, Jul. 2015.
23. S. Li, T.-Y. Kwok, I. W.-H. Tsang, and Y. Wang, "Fusing images with different focuses using support vector machines, " IEEE Trans. Neural Netw., vol. 15, no. 6, pp. 1555-1561, Jun. 2004.
24. S. Li, J. T. Kwok, Y. Wang, "Multifocus image fusion using artificial neural networks, " Pattern Recognit. Lett., vol. 23, no. 8, pp. 985-997, 2002.
25. Y. Liu, X. Chen, H. Peng, and Z. Wang, "Multi-focus image fusion with a deep convolutional neural network, " Inf. Fusion, vol. 36, pp. 191-207, Sep. 2017.
26. G. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification, " IEEE Trans. Syst., vol. 42, no. 2, pp. 513-519, Feb. 2012.
27. G. Feng, G.-B. Huang, and Q. Lin, "Error minimized extreme learning machine with growth of hidden nodes and incremental learning, " IEEE Trans. Neural Netw., vol. 20, no. 8, pp. 1352-1357, Aug. 2009.
28. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme learning machine: Theory and applications, " Neurocomputing, vol. 70, nos. 1-3, pp. 489-501, 2006.
29. P. F. Xiao and X. Z. Feng, Segmentation and Information Extraction of High-Resolution Remote Sensing Image. Beijing, China: Beijing Science Press, 2012.
30. R. B. Huang, F. N. Lang, and Z. Shi, "Log-Gabor and 2 D semi-supervised discriminant analysis based face image retrieval, " Appl. Res. Comput., vol. 29, no. 1, pp. 393-396, 2012.
31. A. Liu, W. Lin, and M. Narwaria, "Image quality assessment based on gradient similarity, " IEEE Trans. Image Process., vol. 21, no. 4, pp. 1500-1512, Apr. 2012.
32. G. Bhatnagar, Q. M. J. Wu, and Z. Liu, "Human visual system inspired multi-modal medical image fusion framework, " Expert Syst. Appl., vol. 40, no. 5, pp. 1708-1720, 2013.
33. W. Huang and Z. Jing, "Evaluation of focus measures in multi-focus image fusion, " Pattern Recognit. Lett., vol. 28, no. 4, pp. 493-500, 2007.
34. X. Qu, J. Yan, and G. Yang, "Multifocus image fusion method of sharp frequency localized Contourlet transform domain based on sum-modified-Laplacian, " Opt. Precis. Eng., vol. 17, no. 5, pp. 1203-1212, 2009.
35. X. Qu, J. Yan, X. Zhi, and Z. Qian, "Image fusion algorithm based on spatial frequency-motivated pulse coupled neural networks in nonsubsampled contourlet transform domain, " Acta Autom. Sinica, vol. 34, no. 12, pp. 1508-1514, 2008.
36. B. K. S. Kumar, "Image fusion based on pixel significance using cross bilateral filter, " Signal Image Video Process., vol. 9, no. 5, pp. 1193-1204, 2015.
37. Z. Zhou, S. Li, and B. Wang, "Multi-scale weighted gradient-based fusion for multi-focus images, " Inf. Fusion, vol. 20, no. 1, pp. 60-72, 2014.
38. J. Tian and L. Chen, "Adaptive multi-focus image fusion using a waveletbased statistical sharpness measure, " Signal Process., vol. 92, no. 9, pp. 2137-2146, 2012.
39. G. Qu, D. Zhang, and P. Yan, "Information measure for performance of image fusion, " Electron. Lett., vol. 38, no. 7, pp. 313-315, Mar. 2002.
40. C. S. Xydeas and V. Petrovi, "Objective image fusion performance measure, " Electron. Lett., vol. 36, no. 4, pp. 308-309, 2000.
41. C. Yang, J. Zhang, X. Wang, and X. Liu, "A novel similarity based quality metric for image fusion, " Inf. Fusion, vol. 9, no. 2, pp. 156-160, 2008.
42. A. M. Eskicioglu and P. S. Fisher, "Image quality measures and their performance, " IEEE Trans. Commun., vol. 43, no. 12, pp. 2959-2965, Dec. 1996.