An overview of image fusion

Multi-Sensor Image Fusion and its Applications

Volumn , Issue , 2005, Pages 1-36

  Blum, Rick S ^a   Xue, Zhiyun ^a   Zhang, Zhong ^b  

^a LEHIGH UNIVERSITY   (United States)

^b OBJECTVIDEO INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85017295198     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (117)

1. Clark, J. J., and Yuille, A. L., Data Fusion for Sensory Information Processing System, Kluwer, Norwell, MA, 1990.
2. Hall, D. L., Mathematical Techniques in Multisensor Data Fusion, Artech House, Boston-London, 1992.
3. Abidi, M. A., and Gonzalez, R. C., Data Fusion in Robotics and Machine Intelligence, Academic Press, Boston, 1992.
4. Aggarwal, J. K., Multisensor Fusion for Computer Vision, Springer, Berlin, 1993.
5. Klein, L. A., Sensor and data fusion concepts and applications, SPIE, 1993.
6. Luo, R. C., and Kay, M. G., Multisensor Integration and Fusion for Intelligent Machines and Systems, Ablex Publishing Corporation, Norwood, NJ, 1995.
7. Hall, D. L., and Llinas, J., An introduction to multisensor data fusion, Proc. IEEE, 85(1), 6-23, 1997.
8. Varshney, P. K., Multisensor data fusion, Electron. Commun. Eng. J., 9(6), 245-253, 1997, December.
9. Brooks, R. R., and Iyengar, S. S., Multi-Sensor Fusion: Fundamentals and Applications with Software, Prince-Hall, Upper Saddle River, NJ, 1998.
10. Viswanathan, R., and Varshney, P. K., Distributed detection with multiple sensors: part I — fundamentals, Proc. IEEE, 85(1), 54-63, 1997, January.
11. Blum, R. S., Kassam, S. A., and Poor, H. V., Distributed detection with multiple sensors: part II — advanced topics, Proc. IEEE, 85(1), 64-79, 1997, January.
12. Varshney, P. K., Chen, H., and Ramac, L. C., Registration and fusion of infrared and millimeter wave images for concealed weapon detection, pp. 532-536. In Proceedings of International Conference on Image Processing, Vol. 3. Japan, 1999.
13. Uner, M. K., Ramac, L. C., and Varshney, P. K., Concealed weapon detection: an image fusion approach, pp. 123-132. In Proceedings of SPIE, Vol. 2942, 1997.
14. Ramac, L. C., Uner, M. K., Varshney, P. K., Alford, M., and Ferris, D., Morphological filters and wavelet based image fusion for concealed weapons detection, pp. 110-119. In Proceedings of the SPIE — The International Society for Optical Engineering, Vol. 3376, 1998.
15. Zhang, Z., and Blum, R. S., A region-based image fusion scheme for concealed weapon detection, pp. 168-173. In Proceedings of 31st Annual Conference on Information Sciences and Systems. Baltimore, MD, 1997.
16. Xue, Z., and Blum, R. S., Concealed weapon detection using color image fusion, pp. 622-627. In The Sixth International Conference on Image Fusion. Queensland, Australia, 2003.
17. Yang, J., and Blum, R. S., A statistical signal processing approach to image fusion for concealed weapon detection, pp. 513-516. In IEEE International Conference on Image Processing. Rochester, NY, 2002.
18. Tu, T. M., Su, S. C., Shyu, H. C., and Huang, P. S., Efficient intensity-hue-saturation-based image fusion with saturation compensation, Opt. Eng., 40(5), 720-728, 2001.
19. Pohl, C., and Van Genderen, J. L., Multisensor image fusion in remote sensing: concepts, methods and applications, Int. J. Remote Sens., 19(5), 823-854, 1998.
20. Nunez, J., Otazu, X., Fors, O., Prades, A., Pala, V., and Arbiol, R., Multiresolutionbased image fusion with additive wavelet decomposition, IEEE Trans. Geosci. Remote Sens., 37(3), 1204-1211, 1999.
21. Simone, G., Farina, A., Morabito, F. C., Serpico, S. B., and Bruzzone, L., Image fusion techniques for remote sensing applications, Inf. Fusion, 3(1), 3-15, 2002.
22. Laliberte, F., Gagnon, L., and Sheng, Y., Registration and fusion of retinal imagesan evaluation study, IEEE Trans. Med. Imaging, 22(5), 661-673, 2003.
23. Zhang, Z., Yao, J., Bajwa, S., and Gudas, T., Automatic multimodal medical image fusion, pp. 42-49. In Proceedings of the 16th IEEE Symposium on Computerbased Medical Systems. New York, 2003.
24. Qu, G., Zhang, D., and Yan, P., Medical image fusion using two dimensional discrete wavelet transform, Proc. SPIE, 4556, 86-95, 2001.
25. Pattichis, C. S., Pattichis, M. S., and Micheli-Tzanakou, E., Medical imaging fusion applications: an overview, pp. 1263-1267. In The 35th Asilomar Conference on Signals, Systems and Computers, Vol. 2. Pacific Grove, CA, 2001.
26. Reed, J. M., and Hutchinson, S., Image fusion and subpixel parameter estimation for automated optical inspection of electronic components, IEEE Trans. Ind. Electron., 43(3), 346-354, 1996.
27. Simone, G., and Morabito, F. C., NDT image fusion using eddy current and ultrasonic data, pp. 857-868. In The Sixth International Workshop on Optimization and Inverse Problems in Electromagnetism (OPIE 2000), Vol. 20. Italy, 2000.
28. Leon, F. P., and Kammel, S., Image fusion techniques for robust inspection of specular surfaces, Proc. SPIE — Int. Soc. Opt. Eng., 5099, 77-86, 2003.
29. Dobeck, G. J., Fusing sonar images for mine detection and classification, Proc. SPIE, 3710, 602-614, 1999.
30. McDaniel, R., Scribner, D., Krebs, W., Warren, P., Ockman, N., and McCarley, J., Image fusion for tactical applications, Proc. SPIE, 3436, 685-695, 1998.
31. Smith, M. I., and Rood, G., Image fusion of II and IR data for helicopter pilotage. In Proceedings of the Night Vision Conference. Washington, DC, 1999.
32. Murphy, R. R., Sensor and information fusion for improved vision-based vehicle guidance, IEEE Intell. Syst., 13(6), 49-56, 1998.
33. Reese, C. E., and Bender, E. J., Multi-spectral/image fused head tracked vision system for driving applications, Proc. SPIE, 4361, 1-11, 2001.
34. Zhang, Z., and Blum, R. S., A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application, Proc. IEEE, 87(8), 1315-1326, 1999.
35. Seales, W. B., and Dutta, S., Everywhere-in-focus image fusion using controllable cameras, Proc. SPIE, 2905, 227-234, 1996.
36. Reese, C. E., Bender, E. J., and Reed, R. D., Advancements of the head-tracked vision system, Proc. SPIE, 4711, 105-116, 2002.
37. Gros, X. E., Liu, Z., Tsukada, K., and Hanasaki, K., Experimenting with pixellevel NDT data fusion techniques, IEEE Trans. Instrum. Meas., 49(5), 1083-1090, 2000.
38. Gross, H. N., and Schott, J. R., Application of spectral mixing to image fusion. In The 26th International Symposium on Remote Sensing of Environment. Vancouver, BC, 1996, February.
39. Rosenfeld, A., and Thurston, M., Edge and curve detection for visual scene analysis, IEEE Trans. Comput., C-20, 562-569, 1971.
40. Witkin, A. P., and Tenenbaum, J. M., On the role of structure in vision, In Human and Machine Vision, Beck, J., Hope, B., and Rosenfeld, A., Eds., Academic Press, New York, 1983, pp. 481-544.
41. Marr, D., Vision, WH Freeman, San Francisco, CA, 1982.
42. Burt, P. J., and Adelson, E. H., The Laplacian pyramid as a compact image code, IEEE Trans. Commun., 31(4), 532-540, 1983.
43. Lindeberg, T., Scale-Space Theory in Computer Vision, Kluwer Academic Publisher, Dordrecht, 1994.
44. Burt, P. J., and Adelson, E. H., Merging images through pattern decomposition, Proc. SPIE, 575, 173-182, 1985.
45. Anderson, C. H., A filter-subtract-decimate hierarchical pyramid signal analyzing and synthesizing technique, US Patent 4,718,104, Washington, DC, 1987.
46. Toet, A., van Ruyven, L. J., and Valeton, J. M., Merging thermal and visual images by a contrast pyramid, Opt. Eng., 28(7), 789-792, 1989.
47. Burt, P. J., A gradient pyramid basis for pattern-selective image fusion, SID Tech. Digest, 16, 467-470, 1992.
48. Toet, A., A morphological pyramidal image decomposition, Pattern Recognit. Lett., 9, 255-261, 1989.
49. Matsopoulos, G. K., Marshall, S., and Brunt, J., Multiresolution morphological fusion of MR and CT images of human brain, Proc. IEE Vision Image Signal Process., 141(3), 137-142, 1994.
50. Liu, Z., Tsukada, K., Hanasaki, K., Ho, Y. K., and Dai, Y. P., Image fusion by using steerable pyramid, Pattern Recognit. Lett., 22(9), 929-939, 2001.
51. Wechsler, H., Computational Vision, Academic Press, New York, 1990.
52. Mallat, S. G., A theory for multiresolution signal decomposition: the wavelet representation, IEEE Trans. Pattern Anal. Machine Intell., 11, 674-693, 1989.
53. Vetterli, M., and Herley, C., Wavelets and filter banks: theory, and design, IEEE Trans. Signal Process., 40, 2207-2232, 1992.
54. Daubechies, I., Orthonormal bases of compactly supported wavelets, Commun. Pure Appl. Math., 41, 909-996, 1988.
55. Unser, M., Texture classification and segmentation using wavelet frames, IEEE Trans. Image Process., 4(11), 1549-1560, 1995.
56. Young, R. M., An Introduction to Nonharmonic Fourier Series, Academic Press, New York, 1980.
57. Daubechies, I., Ten Lectures on Wavelets, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1992.
58. Burt, P. J., and Kolczynski, R. J., Enhanced image capture through fusion, pp. 173-182. In Proceedings of the Fourth International Conference on Computer Vision. Berlin, Germany, 1993.
59. Li, H., Manjunath, B., and Mitra, S., Multisensor image fusion using the wavelet transform, Graphical Models Image Process., 57, 235-245, 1995.
60. Rockinger, O., and Fechner, T., Pixel-level image fusion: the case of image sequences, Proc. SPIE, 3374, 378-388, 1998.
61. Lallier, E., and Farooq, M., A real time pixel-level based image fusion via adaptive weight averaging, pp. WeC3_3–WeC3_13. In The Third International Conference on Information Fusion. Paris, France, 2000.
62. Gonzalez, R. C., and Woods, R. E., Digital Image Processing, 2nd ed., Prentice- Hall, New Jersey, 2002.
63. Therrien, C. W., and Krebs, W. K., An adaptive technique for the enhanced fusion of low-light visible with uncooled thermal infrared imagery, pp. 405-408. In IEEE International Conference on Image Processing. Santa Barbara, CA, 1997.
64. Poor, H. V., An Introduction to Signal Detection and Estimation, 2nd ed., Springer, Berlin, 1994.
65. Clark, J. J., and Yuille, A. L., Data Fusion for Sensory Information Processing Systems, Kluwer, Boston, 1990.
66. Sharma, R. K., Leen, T. K., and Pavel, M., Bayesian sensor image fusion using local linear generative models, Opt. Eng., 40(7), 1364-1376, 2001.
67. Ma, B., Lakshmanan, S., and Hero, A. O., Simultaneous detection of lane and pavement boundaries using model-based multisensor fusion, IEEE Trans. Intell. Trans. Syst., 1(3), 135-147, 2000.
68. Blum, R. S., and Yang, J., Image fusion using the expectation-maximization algorithm and a Gaussian mixture model, In Advanced Video-Based Surveillance Systems, Foresti, G. L., Regazzoni, C. S., and Varshney, P. K., Eds., Kluwer, Boston, 2003.
69. Wright, W. A., and Bristol, F., Quick Markov random field image fusion, Proc. SPIE, 3374, 302-308, 1998.
70. Kundur, D., Hatzinakos, D., and Leung, H., Robust classification of blurred imagery, IEEE Trans. Image Process., 9(2), 243-255, 2000.
71. Azencott, R., Chalmond, B., and Coldefy, F., Markov fusion of a pair of noisy images to detect intensity valleys, Int. J. Comput. Vision, 16(2), 135-145, 1995.
72. Yocky, D. A., Multiresolution wavelet decomposition image merger of landsat thematic mapper and spot panchromatic data, Photogrammetric Engineering and Remote Sensing, 62, 1067-1074, 1996.
73. Carper, W. J., Lillesand, T. M., and Kiefer, R. W., The use of intensityhue- saturation transformations for merging spot panchromatic and multispectral image data, Photogrammetric Engineering Remote Sensing, 56, 459-467, 1990.
74. Waxman, A. M., Aguilar, M., Baxter, R. A., Fay, D. A., Ireland, D. B., Racamato, J. P., and Ross, W. D., Opponent-color fusion of multi-sensor imagery: visible, IR and SAR, Proc. IRIS Passive Sens., 1, 43-61, 1998.
75. Aguilar, M., Fay, D. A., Ross, W. D., Waxman, A. M., Ireland, D. B., and Racamato, J. P., Real-time fusion of low-light CCD and uncooled IR imagery for color night vision, Proc. SPIE, 3364, 124-135, 1998.
76. Xue Z., and Blum R. S., Concealed weapon detection using color image fusion. In The Sixth International Conference on Image Fusion. Queensland, Australia, 2003, July.
77. Toet, A., and Walraven, J., New false color mapping for image fusion, Opt. Eng., 35(3), 650-658, 1996.
78. Essock, E. A., Sinai, M. J., McCarley, J. S., Krebs, W. K., and DeFord, J. K., Perceptual ability with real-world nighttime scenes: image-intensified, infrared, and fused-color imagery, Hum. Factors, 41(3), 438-452, 1999.
79. Aguilar, M., and Garret, A. L., Biologically based sensor fusion for medical imaging, In Sensor Fusion: Architectures, Algorithms, and Applications V, Dasarathy, B. V., Ed., The International Society for Optical Engineering, Bellingham, WA, 2001, pp. 149-158.
80. Aguilar, M., and New, J. R., Fusion of multi-modality volumetric medical imagery, pp. 1206-1212. In Proceedings of The Fifth International Conference of Information Fusion. Annapolis, MD, 2002.
81. Fechner, T., and Godlewski, G., Optimal fusion of TV and infrared images using artificial neural networks, Proc. SPIE, 2492, 919-925, 1995.
82. Kinser, J. M., Pulse-coupled image fusion, Opt. Eng., 36(3), 737-742, 1997.
83. Johnson, J. L., Schamschula, M. P., Inguva, R., and Caulfield, H. J., Pulse coupled neural network sensor fusion, Proc. SPIE, 3376, 219-226, 1998.
84. Broussard, R. P., Rogers, S. K., Oxley, M. E., and Tarr, G. L., Physiologically motivated image fusion for object detection using a pulse coupled neural network, IEEE Trans. Neural Netw., 10(3), 554-563, 1999.
85. Wang, Z., and Bovik, A. C., A Universal image quality index, IEEE Signal Process. Lett., 9(3), 81-84, 2002.
86. Zhang, Z., and Blum, R. S., Image fusion for a digital camera application, pp. 603-607. In The proceedings of the 32nd Asilomar Conference on Signals, Systems, and Computers. Monterey, CA, 1998.
87. Xue, Z., Blum, R. S., and Li, Y., Fusion of visual and IR images for concealed weapon detection. In Proceedings of the Fifth International Conference on Information Fusion. Annapolis, MD, 2002.
88. Burt, P. J., The pyramid as structure for efficient computation, Multiresolution Image Processing and Analysis, Springer, Berlin, 1984.
89. Akerman, A. III, Pyramid techniques for multisensor fusion, Proc. SPIE, 1828, 124-131, 1992.
90. Huntsberger, T., and Jawerth, B., Wavelet based sensor fusion, Proc. SPIE, 2059, 488-498, 1993.
91. Ranchin, T., Wald, L., and Mangolini, M., Efficient data fusion using wavelet transform: the case of spot satellite images, Proc. SPIE, 2934, 171-178, 1993.
92. Koren, I., Laine, A., and Taylor, F., Image fusion using steerable dyadic wavelet transform, Proc. IEEE Int. Conf. Image Process., 3, 232-235, 1995.
93. Chipman, L. J., Orr, T. M., and Graham, L. N., Wavelets and image fusion, Proc. SPIE, 2569, 208-219, 1995.
94. Peytavin, L., Cross-sensor resolution enhancement of hyperspectral images using wavelet decomposition, Proc. SPIE, 2758, 193-197, 1996.
95. Wilson, T. A., Rogers, S. K., and Myers, L. R., Perceptual-based hyperspectral image fusion using multiresolution analysis, Opt. Eng., 34(11), 3154-3164, 1995.
96. Jiang, X., Zhou, L., and Gao, Z., Multispectral image fusion using wavelet transform, Proc. SPIE, 2898, 35-42, 1996.
97. Avcıbas, I., Sankur, B., and Sayood, K., Statistical evaluation of image quality measures, J. Electron. Imaging, 11, 206-223, 2002.
98. Piella, G., and Heijmans, H., A new quality metric for image fusion. In Proceedings of International Conference on Image Processing. Barcelona, 2003.
99. Xydeas, C., and Petrovic, V., Objective pixel-level image fusion performance measure, Proc. SPIE, 4051, 88-99, 2000.
100. Zhang, Z., and Blum, R. S., On estimating the quality of noisy images, pp. 2897-2901. In IEEE International Conference on Acoustics, Speech and Signal Processing. Seattle, WA, 1998.
101. Canny, J., A computational approach to edge detection, IEEE Trans. Pattern Anal. Machine Intelligence, 8(6), 679-698, 1986.
102. Redner, R. A., and Walker, H. F., Mixture densities, maximum likelihood and the EM algorithm, SIAM Rev., 26, 195-239, 1984.
103. Dempster, A. P., Laird, N. M., and Rubin, D. B., Maximum likelihood from incomplete data via the EM algorithm, J. R. Stat. Soc., 39(1), 1-38, 1977.
104. Li, H., Manjunath, B. S., and Mitra, S. K., A contour-based approach to multisensor image registration, IEEE Trans. Image Process., 4, 320-334, 1995.
105. Likar, B., and Pernus, F., Automatic extraction of corresponding points for the registration of medical images, Med. Phys., 26, 1678-1686, 1999.
106. Chen, H., and Varshney, P. K., Automatic registration of infrared and millimeter wave images for concealed weapons detection, Proceedings of SPIE Conference on Sensor Fusion: Architectures, Algorithms, and Applications 3, 3719, 152-160, 1999.
107. Chen, H., and Varshney, P. K., Cooperative search algorithm for mutualinformation- based image registration, Proc. SPIE, 4385, 117-128, 2001.
108. Chen, Y., Brooks, R. R., Iyengar, S. S., Rao, N. S. V., and Barhen, J., Efficient global optimization for image registration, IEEE Trans. Knowledge Data Eng., 14(1), 79-92, 2002.
109. Fonseca, L., Hewer, G. A., Kenney, C. S., and Manjunath, B. S., Registration and fusion of multispectral images using a new control point assessment method derived from optical flow ideas, Proc. SPIE, 3717, 104-111, 1999.
110. Le Moigne, J., and Cromp, R. F., Wavelets for remote sensing image registration and fusion, Proc. SPIE, 2762, 535-544, 1996.
111. Mostafa, M. G., Farag, A. A., and Essock, E., Multimodality image registration and fusion using neural network, Inf. Fusion, 2, 3-9, 2000.
112. Remagnino, P., and Jones, G. A., Automated registration of surveillance data for multi-camera fusion, Inf. Fusion, 2, 1190-1197, 2002.
113. Turcajova, R., and Kautsky, J., Hierarchical multiresolution technique for image registration, Proc. SPIE, 2825, 686-696, 1996.
114. Nevel, A. J. V., Image registration: a key element for information processing, Proc. SPIE, 4471, 190-200, 2001.
115. Brown, L. G., A survey of image registration techniques, ACM Computing Survey, 24(4), 325-376, 1992.
116. Lester, H., and Arridge, S. R., A survey of hierarchical non-linear medical image registration, Pattern Recogn., 32, 129-149, 1999.
117. Zhang, Z., and Blum, R. S., Image registration for multi-focus image fusion. SPIE AeroSense, Conference on Battlefield Digitization and Network Centric Warfare (4396-39), Orlando, FL, 2001, April.