Fast saliency-aware multi-modality image fusion

Neurocomputing

Volumn 111, Issue , 2013, Pages 70-80

  Han, Jungong ^a   Pauwels, Eric J ^b   de Zeeuw, Paul ^b  

^a HTC 9   (Netherlands)

^b CWI   (Netherlands)

Author keywords

Co occurrence; Markov random fields (MRFs); Multi modality fusion; Saliency detection

Indexed keywords

CO-OCCURRENCE; DETECTION ACCURACY; FOREGROUND OBJECTS; MARKOV RANDOM FIELD; MULTI-MODALITY FUSION; MULTI-MODALITY IMAGE FUSION; SALIENCY DETECTION; SUBJECTIVE ASSESSMENTS;

ALGORITHMS; IMAGE SEGMENTATION; INFRARED IMAGING; MARKOV PROCESSES;

IMAGE FUSION;

ALGORITHM; ARTICLE; BRIGHTNESS; CONTROLLED STUDY; IMAGE FUSION; IMAGING AND DISPLAY; INFRARED RADIATION; LIGHT; MOTION; PHYSICAL PHENOMENA; PRIORITY JOURNAL; SALIENCY; SALIENCY AWARE FUSION ALGORITHM; VIDEORECORDING;

EID: 84876738370     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2012.12.015     Document Type: Article

References (33)

1. Pohl C., Van Genderen J. Review article multisensor image fusion in remote sensing. concepts, methods and applications. Int. J. Remote Sensing 1998, 19(5):823-854.
2. Amolins -K., Zhang Y., Dare P. Wavelet based image fusion techniques. an introduction, review and comparison. ISPRS J. Photogramm. Remote Sensing 2007, 62(4):249-263.
3. H. Irshad, M. Kamran, A. Siddiqui, A. Hussain, Image fusion using computational intelligence: a survey, in: Proceedings of the ICECS, 2009, pp. 128-132.
4. P. Burt, E. Adelson, Merging images through pattern decomposition, in: Proceedings of the SPIE, vol. 575, 1985, pp. 173-181.
5. Toet A. Hierarchical image fusion. Mach. Vision Appl. 1990, 3:1-11.
6. Q. Miao, B. Wang, A novel image fusion method using contourlet transform, in: Proceedings of the IEEE Conference on Communications, Circuits and Systems, vol. 1, 2006, pp. 548-552.
7. P. de Zeeuw, The multigrid image transform, in: Proceedings of the Image Processing Based on Partial Differential Equations, 2007, pp. 309-324.
8. Piella G. A general framework for multiresolution image fusion. from pixels to regions. Inf. Fusion 2003, 9:259-280.
9. Burt P., Adelson E. The Laplacian pyramid as a compact image code. IEEE Trans. Commun. 1983, 31(4):532-540.
10. E. Simoncelli, W. Freeman, The steerable pyramid: a flexible architecture for multi-scale derivative computation, in: Proceedings of the ICIP, 1995, pp. 444-447.
11. P. Burt, Enhanced image capture through fusion, in: Proceedings of the Conference on Computer Vision, 1993, pp. 173-182.
12. Li H., Manjunath S., Mitra S. Multisensor image fusion using the wavelet transform. Graphical Models Image Process. 1995, 57(3):235-245.
13. Z. Zhang, R. Blum, A region-based image fusion scheme for concealed weapon detection, in: Proceedings Conference on Information Sciences and Systems, 1997, pp. 168-173.
14. G. Piella, H. Heijmans, Multiresolution image fusion guided by a multimodal segmentation, in: Proceedings of the ACIVS, 2002, pp. 175-182.
15. J. Lewis, R. O'Callaghan, S. Nikolov, D. Bull, C. Canagarajah, Region-based image fusion using complex wavelets, in: Proceedings Conference on Information Fusion, 2004, pp. 555-562.
16. J. Lewis, S. Nikolov, C. Canagarajah, D. Bull, A. Toet, Uni-modal versus joint segmentation for region-based image fusion, in: Proceedings Conference on Information Fusion, 2006, pp. 1-8.
17. Wan T., Canagarajah N., Achim A. Segmentation-driven image fusion based on alpha-stable modeling of wavelet coefficients. IEEE Trans. Multimedia 2009, 11(4):624-633.
18. Zaveri T., Zaveri M. A novel region based multimodality image fusion method. J. Pattern Recognition Res. 2011, 2:140-153.
19. P. de Zeeuw, E. Pauwels, J. Han, Multimodality and multiresolution image fusion, in: Proceedings of the International Conference on Computer Vision Theory and Applications, 2012, pp. 151-157.
20. Itti L., Koch C., Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 1998, 20(11):1254-1259.
21. H. Nanda, L. Davis, Probabilistic template based pedestrian detection in infrared videos, in: Proceedings of the IEEE Intelligent Vehicles Symposium, 2002, pp. 15-20.
22. Xu F., Liu X., Fujimura K. Pedestrian detection and tracking with night vision. IEEE Trans. Intell. Transp. Syst. 2005, 6(1):63-71.
23. Y. Benezeth, B. Emile, H. Laurent, C. Rosenberger, A real time human detection based on far infrared vision, in: Proceedings of the Conference on Image and Signal Processing, 2008, pp. 76-84.
24. Davis J., Sharma V. Background-subtraction using contour-based fusion of thermal and visible imagery. Comput. Vision Image Understanding 2007, 106:162-182.
25. Aach T., Kaup A. Bayesian algorithms for adaptive change detection in image sequence using Markov random fields. Signal Process. Image Commun. 1995, 7:147-160.
26. Han J., de With P. Real-time multiple people tracking for automatic group-behavior evaluation in delivery simulation training. Multimedia Tools Appl. 2011, 51:913-933.
27. Boykov Y., Kolmogorov V. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 2004, 26(9):1124-1131.
28. X. Hou, L. Zhang, Saliency detection: a spectral residual approach, in: Proceedings of the CVPR, 2007, pp. 1-8.
29. R. Achanta, S. Hemami, F. Estrada, S. Susstrunk, Frequency-tuned salient region detection, in: Proceedings of the CVPR, 2009, pp. 1597-1604.
30. M. Cheng, G. Zhang, M. Mitra, X. Huang, S. Hu, Global contrast based salient region detection, in: Proceedings of the CVPR, 2011, pp. 409-416.
31. Avraham T., Lindenbaum M. Esaliency (extended saliency). meaningful attention using stochastic image modeling. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32(4):693-708.
32. Liu Z., Blasch E., Xue Z., Zhao J., Laganiere R., Wu W. Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision. a comparative study. IEEE Trans. Pattern Anal. Mach. Intell. 2012, 34(1):94-109.
33. Han J., Pauwels E., de Zeeuw P. Visible and infrared image registration in man-made environment employing hybrid visual features. Pattern Recognition Lett. 2013, 34(1):42-51.