Statistical comparison of image fusion algorithms: Recommendations

Information Fusion

Volumn 36, Issue , 2017, Pages 251-260

  Liu, Z ^a   Blasch, E ^b   John, V ^c  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b AIR FORCE RESEARCH LABORATORY   (United States)

^c TOYOTA TECHNOLOGICAL INSTITUTE   (Japan)

Author keywords

Image fusion; Performance assessment; Pixel level fusion; Statistical comparison; Statistical significance

Indexed keywords

DATA FUSION; DECISION SUPPORT SYSTEMS; MEDICAL IMAGING; PIXELS; REMOTE SENSING; SECURITY SYSTEMS; STATISTICS;

IMAGE FUSION ALGORITHMS; NON-PARAMETRIC STATISTICAL ANALYSIS; PERFORMANCE ASSESSMENT; PIXEL LEVEL FUSION; PIXEL-LEVEL IMAGE FUSION; STATISTICAL COMPARISONS; STATISTICAL SIGNIFICANCE; SUBJECTIVE ASSESSMENTS;

IMAGE FUSION;

EID: 85007082708     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.inffus.2016.12.007     Document Type: Article

References (61)

1. [1] R.S. Blum, Z. Liu (Eds.), Multi-sensor Image Fusion and Its Applications, Signal Processing and Communications, Taylor and Francis, 2005.
2. [2] Kahler, B., Blasch, E., Sensor management fusion using operating conditions. Proceedings of National Aerospace and Electronics Conference, Fairborn, Ohio, USA, 2008.
3. [3] Z. Liu, E. Blasch, Multisensor Data Fusion: From Algorithm and Architecture Design to Applications, Taylor & Francis, pp. 453–488.
4. [4] Blasch, E., Laskey, K., Jousselme, A.-L., Dragos, V., Costa, P., Dezert, J., URREF reliability versus credibility in information fusion (stanag 2511). Information Fusion (FUSION), 2013 16th International Conference on, 2013, 1600–1607.
5. [5] Toet, A., Hogervorst, M., Nikolov, S., Lewis, J., Dixon, T., Bull, D., Canagarajah, C., Towards cognitive image fusion. Inf. Fusion 11:2 (2010), 95–113.
6. [6] Liu, Z., Blasch, E., Xue, Z., Zhao, J., Laganière, R., Wu, W., Objective assessment of multiresolution fusion algorithms for context enhancement in night vision: a comparative study. IEEE Trans. Pattern Anal. Mach. Intell. 34:1 (2012), 94–109.
7. [7] Demšar, J., Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7 (2006), 1–30.
8. [8] Garcia, S., Fernandez, A., Luengo, J., Herrera, F., Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inf. Sci. 180:10 (2010), 2044–2064 Special Issue on Intelligent Distributed Information Systems.
9. [9] Derrac, J., Garcia, S., Molina, D., Herrera, F., A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol. Comput. 1:1 (2011), 3–18.
10. [10] García, S., Fernández, A., Luengo, J., Herrera, F., A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability. Soft comput. 13:10 (2008), 959–977.
11. [11] Luengo, J., Garcia, S., Herrera, F., A study on the use of statistical tests for experimentation with neural networks: analysis of parametric test conditions and non-parametric tests. Expert Syst. Appl. 36:4 (2009), 7798–7808.
12. [12] Liu, Y., Liu, S., Wang, Z., A general framework for image fusion based on multi-scale transform and sparse representation. Inf. Fusion 24 (2014), 147–164.
13. [13] Sharma, K., Sharma, M., Image fusion based on image decomposition using self-fractional fourier functions. Signal Image Video Process. 8:7 (2014), 1335–1344.
14. [14] Li, S., Kang, X., Hu, J., Image fusion with guided filtering. IEEE Trans. Image Process. 22:7 (2013), 2864–2875.
15. [15] Liang, J., He, Y., Liu, D., Zeng, X., Image fusion using higher order singular value decomposition. Image Process. IEEE Trans. 21:5 (2012), 2898–2909.
16. [16] Li, X., Qin, S.Y., Efficient fusion for infrared and visible images based on compressive sensing principle. IET Image Process. 5:2 (2011), 141–147.
17. [17] Hariharan, H., Koschan, A., Abidi, B., Gribok, A., Abidi, M., Fusion of visible and infrared images using empirical mode decomposition to improve face recognition. Proceedings of International Conference on Image Processing, 2006, 2049–2052.
18. [18] Li, S., Kwok, J.T., Wang, Y., Multifocus image fusion using artificial neural networks. Pattern Recognit. Lett. 23:8 (2002), 985–997.
19. [19] Xia, Y., Kamel, M., Novel cooperative neural fusion algorithms for image restoration and image fusion. Image Process. IEEE Trans. 16:2 (2007), 367–381.
20. [20] Toet, A., Walraven, J., New false color mapping for image fusion. Opt. Eng. 35:3 (1996), 650–658.
21. [21] Yin, S., Cao, L., Ling, Y., Jin, G., One color contrast enhanced infrared and visible image fusion method. Infrared Phys. Technol. 53:2 (2010), 146–150.
22. [22] Xue, Z., Blum, R.S., Concealed weapon detection using color image fusion. Proceedings of 6th International Conference of Information Fusion, 1, 2003, 622–627.
23. [23] Zheng, Y., Dong, W., Blasch, E.P., Qualitative and quantitative comparisons of multispectral night vision colorization techniques. Opt. Eng. 51:8 (2012), 087004–1–087004–16.
24. [24] Zhang, Y., Adaptive region-based image fusion using energy evaluation model for fusion decision. Signal Image Video Process. 1:3 (2007), 215–223.
25. [25] Chan, T., Esedoglu, S., Park, F., Yip, A., Recent developments in total variation image restoration. Paragios, N., Chen, Y., Faugeras, O.D., (eds.) Handbook of Mathematical Models in Computer Vision, 2006, Springer-Verlag US, 17–31.
26. [26] Caselles, V., Total variation based image denoising and restoration. Proceedings of the International Congress of Mathematicians, volume 3, Madrid, Spain, 2006, 1453–1472.
27. [27] Wang, W.-W., Shui, P.-L., Feng, X.-C., Variational models for fusion and denoising of multifocus images. Signal Process. Lett., IEEE 15 (2008), 65–68.
28. [28] Greig, D.M., Porteous, B.T., Seheult, A.H., Exact maximum a posteriori estimation for binary images. J. R. Stat. Soc. Series B (Methodol.) 51:2 (1989), 271–279.
29. [29] Kumar, M., Dass, S., A total variation-based algorithm for pixel-level image fusion. IEEE Trans. Image Process. 18:9 (2009), 2137–2143.
30. [30] Seng, C.H., Bouzerdoum, A., Amin, M., Phung, S.L., Two-stage fuzzy fusion with applications to through-the-wall radar imaging. Geosci. Remote Sensing Lett., IEEE 10:4 (2013), 687–691.
31. [31] Dalgaard, P., Introductory Statistics with R. 2 Statistics and Computing, 2008, Springer, New York, USA.
32. [32] Trawinski, B., Smetek, M., Telec, Z., Lasota, T., Nonparametric statistical analysis for multiple comparison of machine learning regression algorithms. Int. J. Appl. Math. Comput. Sci. 22:4 (2012), 867–881.
33. [33] Iman, R.L., Davenport, J.M., Approximations of the critical region of the Friedman statistic. Commun. Stat. - Theory Methods 9:6 (1980), 571–595.
34. [34] Sheskin, D., Handbook of Parametric and Nonparametric Statistical Procedures. 4, 2007, Chapman & Hall / CRC.
35. [35] Calvo, B., Santafe, G., Scmamp: statistical comparison of multiple algorithms in multiple problems. R J. 8:1 (2016), 1–8.
36. [36] Li, X., Qin, S.Y., Efficient fusion for infrared and visible images based on compressive sensing principle. IET Image Process. 5:2 (2011), 141–147.
37. [37] Nejati, M., Samavi, S., Shirani, S., Multi-focus image fusion using dictionary-based sparse representation. Inf. Fusion 25 (2015), 72–84.
38. [38] Alcalá-Fdez, J., Sánchez, L., García, S., del Jesus, M.J., Ventura, S., Garrell, J.M., Otero, J., Romero, C., Bacardit, J., Rivas, V.M., Fernández, J.C., Herrera, F., Keel: a software tool to assess evolutionary algorithms for data mining problems. Soft comput. 13:3 (2008), 307–318.
39. [39] Liu, Z., Blasch, E., Statistical analysis of the performance assessment results for pixel-level image fusion. 17th International Conference on Information Fusion, Salamanca, Spain, 2014, 1–8.
40. [40] Rodriguez-Fdez, I., Canosa, A., Mucientes, M., Bugarín, A., STAC: a web platform for the comparison of algorithms using statistical tests. 2015 IEEE International Conference on Fuzzy Systems, 2015, 1–8.
41. [41] García, S., Molina, D., Lozano, M., Herrera, F., A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: aâ case study on the CEC’2005 special session on real parameter optimization. J. Heuristics 15:6 (2008), 617–644.
42. [42] Wan, T., Qin, Z., An application of compressive sensing for image fusion. Proceedings of the ACM International Conference on Image and Video Retrieval CIVR'10, 2010, ACM, New York, NY, USA, 3–9.
43. [43] Rockinger, O., Image sequence fusion using a shift-invariant wavelet transform. Proceedings of International Conference on Image Processing, Vol. 3, 1997, 288–301.
44. [44] Tessens, L., Ledda, A., Pizurica, A., Philips, W., Extending the depth of field in microscopy through curvelet-based frequency-adaptive image fusion. IEEE International Conference on Acoustics, Speech and Signal Processing, 1, 2007, I–861–I–864.
45. [45] Burt, P., Adelson, E., The laplacian pyramid as a compact image code. IEEE Trans. Commun. 31:4 (1983), 532–540.
46. [46] Zhang, Q., B. long Guo, Multifocus image fusion using the nonsubsampled contourlet transform. Signal Process. 89:7 (2009), 1334–1346.
47. [47] Shen, R., Cheng, I., Shi, J., Basu, A., Generalized random walks for fusion of multi-exposure images. IEEE Trans. Image Process. 20:12 (2011), 3634–3646, 10.1109/TIP.2011.2150235.
48. [48] Tian, J., Chen, L., Adaptive multi-focus image fusion using a wavelet-based statistical sharpness measure. Signal Process. 92:9 (2012), 2137–2146.
49. [49] Li, S., Yao, Z., Yi, W., Frame fundamental high-resolution image fusion from inhomogeneous measurements. Image Process. IEEE Trans. 21:9 (2012), 4002–4015.
50. [50] Shreyamsha Kumar, B.K., Multifocus and multispectral image fusion based on pixel significance using discrete cosine harmonic wavelet transform. Signal Image Video Process. 7:6 (2013), 1125–1143, 10.1007/s11760-012-0361-x.
51. [51] Shreyamsha Kumar, B.K., Image fusion based on pixel significance using cross bilateral filter. Signal Image Video Process. 9:5 (2015), 1193–1204, 10.1007/s11760-013-0556-9.
52. [52] Li, S., Kang, X., Hu, J., Yang, B., Image matting for fusion of multi-focus images in dynamic scenes. Inf. Fusion 14:2 (2013), 147–162.
53. [53] Cvejic, N., Canagarajah, C.N., Bull, D.R., Image fusion metric based on mutual information and tsallis entropy. Electron. Lett., 42(11), 2006.
54. [54] Dixon, T.D., Canga, E.F., Noyes, J.M., Troscianko, T., Nikolov, S.G., Bull, D.R., Canagarajah, C.N., Methods for the assessment of fused images. ACM Trans. Appl. Percept. 3:3 (2006), 309–332.
55. [55] Yang, C., Zhang, J., Wang, X., Liu, X., A novel similarity based quality metric for image fusion. Inf. Fusion 9 (2008), 156–160.
56. [56] Cvejic, N., Loza, A., Bul, D., Canagarajah, N., A similarity metric for assessment of image fusion algorithms. Int. J. Signal Process. 2:3 (2005), 178–182.
57. [57] Xydeas, C.S., Petrovic, V., Objective pixel-level image fusion performance measure. Proceedings of SPIE, 4051, 2000, 89–98.
58. [58] Zhao, J., Laganiere, R., Liu, Z., Performance assessment of combinative pixel-level image fusion based on an absolute feature measurement. Int. J. Innovative Comput. Inf. Control 3:6(A) (2007), 1433–1447.
59. [59] Hossny, M., Nahavandi, S., Vreighton, D., Comments on ‘information measure for performance of image fusion’. Electron. Lett., 44(18), 2008.
60. [60] Xydeas, C.S., Petrovic, V., Objective image fusion performance measure. Electron. Lett. 36:4 (2000), 308–309.
61. [61] Han, Y., Cai, Y., Cao, Y., Xu, X., A new image fusion performance metric based on visual information fidelity. Inf. Fusion 14:2 (2013), 127–135.