Multisensor image fusion: Concept, method and applications

Advances in Modeling and Analysis B

Volumn 45, Issue 3-4, 2002, Pages 29-49

  Li, Shutao ^a   Wang, Yaonan ^a  

^a HUNAN UNIVERSITY   (China)

Author keywords

Data fusion; Image fusion; Information fusion; Multisensor fusion

Indexed keywords

CAMERAS; CHARGE COUPLED DEVICES; DATA REDUCTION; DIAGNOSIS; IMAGE PROCESSING; INFRARED IMAGING; LAW ENFORCEMENT; MILLIMETER WAVE DEVICES; NAVIGATION; REMOTE SENSING;

DATA FUSION; IMAGE FUSION; INFORMATION FUSION; MULTISENSOR FUSION;

SENSOR DATA FUSION;

EID: 2942546144     PISSN: 12404543     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (72)

1. E. A. Newraan and P. H. Hartline. The infrared vision of snakes. Scientific American, 1982, vol.246, no.3, pp.116-127.
2. C. Pohl. Multisensor image fusion in remote sensing: concepts, methods and applications. International Journal of Remote Sensing, 1998, vol.19, no.5, pp.823-854.
3. R. C. Gonzalez, and P. Wintz. Digital image processing. Addison Wesley, Reading, MA, 1977.
4. A. Toet and J. Walraven, New false color mapping for image fusion. Optical Engineering, 1996, vol.35, no.3, pp.650-658.
5. A. M. Waxman, A. N. Gove, M. C. Seibert, et al. Progress on color night visions: visible/IR fusion, perception, research, and low-light CCD imaging. Proceedings of SPIE, 1996, vol.2736, pp.96-107.
6. A. M. Waxman, D. A. Fay, A. Gove, et al. Color night vision: fusion of intensified visible and thermal IR imagery. Proceedings of SPIE, 1995, vol.2463, pp.58-68.
7. A. M. Waxman, J. E. Carrick, D. A. Fay, et al. Electronic imaging aids for night driving: low-light CCD, thermal IR, and color fused visible IR. Proceedings of SPIE, 1996, vol.2902, pp.62-73.
8. A. M. Waxman, A. N. Gove, D. A. Fay, et al. Color night vision: opponent processing in the fusion of visible and IR imagery. Neural Networks, 1997, vol.10, no.1, pp.1-6.
9. A. M. Waxman, M. Aguilar, D. A. Fay, et al. Real-time fusion of low-light CCD and uncooled IR imagery for color night vision. Proceedings of SPIE, 1998, vol.3364, pp.124-135.
10. A. Toet, J. K. Ijspeert, A. M. Waxman, et al. Fusion of visible and thermal imagery improves situational awareness. Displays, 1997, vol.18, no.2, pp.85-95.
11. C. W. Therrien, J. W. Scofani, and W. K. Krebs. An adaptive technique for the enhanced fusion of low-light visible with uncooled thermal infrared imagery. Proceedings of the 1997 International Conference on Image Processing, 1997, vol.1, pp.405-405.
12. R. K. Sharma and M. Pavel. Adaptive and statistical image fusion. SID Digest, Society for Information Display, 1996, Vol. XXVII, pp. 969-972.
13. R. K. Sharma, T. K. Leen, and M, Pavel. Probabilistic Image Sensor Fusion. Advances in Neural Information Processing Systems, The MIT Press. 1999. vol.11.
14. J. M. Lafert, F. Heitz, P. Perez, et al. Hierarchical statistical models for the fusion of multiresolution image data. Proceedings of the International Conference on Computer Vision, 1995, pp.908-913.
15. M. Beckerman and F. J. Sweeney. Segmentation and cooperative fusion of laser radar image data. Proceedings of SPIE, 1994, vol.2233, pp.88-98.
16. R. Azencott, B. Chalmond, and F. Coldefy. Markov fusion of a pair of noisy images to detect intensity valleys. International Journal of Computer Vision, 1995, vol.16, no.2, pp.135-145.
17. W. A. Wright and F. Bristol. Quick Markov random field image fusion. Proceedings of SPIE, 1998, vol.3374, pp.302-308.
18. E. A. Newman and P. H. Hartline. Integration of visual and infrared information in bimodal neurons of rattlesnake optic teotum. Science, 1981, vol.213, pp.789-791.
19. P. Ajjimarangsee and T. L. Huntsberger. Neural network model for fusion of visible and infrared sensor fusion. Proceedings of SPIE, 1988, vol.1003, pp.153-160.
20. Z. Y. Li, Z. H. Liu, and W. P. Yang. A method of visual-infrared sensor fusion for target recognition. Proceedings of SPIE, 1997, vol.3068, pp.591-596.
21. T. Fechner and G. Godlewski. Optimal fusion of TV and infrared images using artificial neural networks. Proceedings of SPIE, 1995, vol.2492, pp.919-925.
22. J. M. Kinser. Pulse-coupled image fusion. Optical Engineering, 1997, vol.36, no.3, pp.737-742.
23. J. L. Johnson, M. P. Schamschula, R. Inguva, et al. Pulse coupled neural network sensor fusion. Proceedings of SPIE, 1998, vol.3376, pp.219-226.
24. P. J. Burt and E. H. Andelson. The Laplacian pyramid as a compact image code. IEEE Transactions on Communications, 1983, vol.31, no.4, pp.532-540.
25. P. J. Burt. The pyramid as structure for efficient computation. Multiresolution Image Processing and Analysis (A. Rosenfeld, ed.), Springer-Verlag, New York/Berlin, 1984, pp.6-35.
26. P. J. Burt and E. H. Adelson. Merging images through pattern decomposition. Proceedings of SPIE, 1985, vol.575, pp.173-182.
27. A. Toet. Image fusion by a ratio of low pass pyramid. Pattern Recognition Letters, 1989, vol.9, no.4, pp.245-253.
28. A. Toet, L. J. Van Ruyven, and J. M. Valeton. Merging thermal and visual images by contrast pyramid. Optical Engineering, 1989, vol.28, no.7, pp.789-792.
29. A. Toet. Hierarchical image fusion. Machine Vision and Applications, 1990, vol.3, no.1, PP. 1-11.
30. A. Toet. Muhiscale contrast enhancement with application to image fusion. Optical Engineering, 1992, vol.31, no.5, pp.1026-1031.
31. M. Pavel, J. Larimer, and A. Ahumada. Sensor fusion for synthetic vision. Society for Information Display Digest of Technical Papers, Playa del, CA, 1992, pp.475-478.
32. P. J. Burt. A gradient pyramid basis for pattern-selective image fusion. Society for Information Display Digest of Technical Papers, 1985, vol.16, pp.467-470.
33. P. J. Burt and R. J. Lolczynski. Enhanced image capture through fusion. Proceedings of the 4th International Conference on Computer Vision, Berlin, Germany, 1993, pp. 173-182.
34. S. Richard, F. Sims, and M. A Phillips. Target signature consistency of image data fusion alternatives. Optical Engineering, 1997, vol.36, no.3, pp.743-754.
35. A. Toet. A morphological pyramid image decomposition. Pattern Recognition Letters, 1989, vol.9, no.4, pp.255-261.
36. G. K. Matsopoulos, S. Marshall, and J. Brunt. Multiresolution morphological fusion of MR and CT images of the human brain. Proceedings of IEE, Vision, Image and Signal Processing, 1994, vol.141, no.3, pp.137-142.
37. G. K. Matsopoulos and S. Marshall. Application of morphological pyramids: fusion of MR and CT phantoms. Journal of Visual Communication and Image Representation, 1995, vol.6, no.2, pp. 196-207.
38. S. G. Mallat. A theory for multiresolution signal decomposition: The wavelet representation, in: IEEE Trans. Pattern Analysis and Machine Intelligence, 1989, vol.11, no.7, pp. 674-693.
39. S. G. Mallat. Multifrequency channel decompositions of images and wavelet models. IEEE Transactions on Acoustic Speech Signal Processing, 1989,vol.37, no.12, pp.2091-2110.
40. Z. Zhang and R. S. Blum. A categorization of multiscale-decomposition- based image fusion schemes with a performance study for a digital camera application. Proceedings of IEEE, 1999, vol.87, no.8, pp.1315-1326.
41. H. Li, B. S. Manjunath, and S. K. Mitra. Multisensor image fusion using the wavelet transform. Graphical models and image processing, 1995. vol.57, no.3. pp.235-245.
42. D. A. Yochy. Image merging and data fusion by means of the discrete two-dimensional wavelet transform. Journal of Optical Society of America, Part A, 1995, vol.12, no.9, pp.1834-1841.
43. L. C. Ramac, M. K. Uner, and P. K. Varshney, Morphological filters and wavelet based image fusion for concealed weapons detection. Proceedings of SPIE, 1998, vol.3376, pp. 110-119.
44. M. A. Slamani, L.Ramac, P. K. Varshney, et al. Enhancement and fusion of data for concealed weapons detection. Proceedings of SPIE, 1997, vol.3068, pp.8-19.
45. M. K. Uner, L. C. Ramac, and P. K. Varshney. Concealed weapon detection: An image fusion approach, Proceedings of SPIE 1997,vol.2942, pp.123-132.
46. Z. Zhang and R. S. Blum. A region-based image fusion scheme for concealed weapon detection. Proceedings of 31st Annual Conference on Information Sciences and Systems, Baltimore, MD, Mar. 1997, pp.168-173.
47. L. Grewe and R. R. Brooks. Atmospheric attenuation reduction through multi-sensor fusion. Proceedings of SPIE, 1998,vol.3376, pp.102-109.
48. L.J. Chipman, T. M. Orr, and L. N. Graham. Wavelets and image fusion. Proceedings of SPIE, 1995, vol.2569, pp.208-219.
49. X. Jiang, L. Zhou, and Z. Gao. Multispectral image fusion using wavelet transform. Proceedings of SPIE, 1996,vol.2898, pp.35-42.
50. O. Rockinger. Pixel level fusion of image sequences using wavelet frames. Proceedings of 16th Leeds Annual Statistical Research Workshop, Leeds University Press, 1996, pp.149-154
51. O. Rockinger, Image sequence fusion using a shift invariant wavelet transform. Proceedings of IEEE International Conference on Image Processing, 1997, vol.3, pp.288-291.
52. O. Rockinger and T. Fechner. Pixel-level image fusion: The case of image sequences. Proceedings of SPIE, 1998, vol. 3374, pp.378-388.
53. I. Koren, A. Laine, and F. Taylor. Image fusion using steerable dyadic wavelet transform. Proceedings of IEEE International Conference on Image Processing, 1995, vol.3, pp.232-235.
54. V. Strela, N. Heller, G. Strang, et. al. The application of multiwavelet filters banks to signal and image processing. IEEE Transactions on Image Processing, 1998, vol.8, no.4, pp.548-563.
55. I. Daubechies. Ten lectures on wavelets. SIAM, Tech. Rep./CBMS-NSF Lecture Notes, 1992, vol.61.
56. V. Strela and A.T. Walden. Orthogonal and biorthogonal multiwavelets for signal denoising and image compression. Proceedings of SPIE, 1998, vol.3391, pp.96-107.
57. J. Y. Tham, L.X. Shen, S. L. Lee, et. al. A general approach for analysis and application of discrete multiwavelet transforms. IEEE Transactions on Signal Processing, 2000, vol.48, no.2, pp.457-464.
58. S. T. Li and Y. N. Wang. Multisensor image fusion using discrete multiwavelet transform. Proceedings of the 3rd International Conference on Visual Computing, Mexico city, Mexico, September 2000, pp.93-103.
59. W. B. Seales and S. Dutta. Everywhere-in-focus image fusion using controllable cameras. Proceedings of SPIE, 1996, vol.2905, pp.227-234.
60. A. Pinz and R. Bartl. Information fusion in image understanding. IEEE Transactions on Medical Imaging, 1992, vol.12, no.4, pp.234-255.
61. D. Hill, P. Edwards, and D. Hawkes, Fusing medical images. Image Processing, 1994, vol.6, no.2, pp.22-24.
62. K. Suomi, J. Oikainen, J. Jauhinen, et al. Medical image fusion. Proceedings of the First Finnish Anti-Aliasing Symposium, 1998, vol. 1, pp.44-51.
63. S. T. C. Wang, R. C. Knowlton, R. A. Hawkins, et al. Multimodal image fusion for noninvasive Epilepsy surgery planning. IEEE Transactions on Computer Graphics and Applications, 1996, vol.16, no.1, pp.30-38.
64. K. K. William, A. S. Dean, M. M. Geoffrey, et al. Beyond third generation: a sensor-fusion targeting FLIR pod for the F/A-18. Proceedings of SPIE, 1998,vol.3376, pp. 129-140.
65. D. D. Ferris, R. W. Mcmillan, N. C. Currie, et al. Sensors for military special operations and law enforcement applications. Proceedings of SPIE, 1997, vol.3062, pp.173-180.
66. G. A. Clark, et al. Detection of buried objects by fusing dual-band infrared images. Proceedings of IEEE Conference on Signals, Systems, and Computers, Pacific Grove, CA (United States), 1993, pp. 1-3.
67. G. A. Clark, et al. Land mine detection using multispectral image fusion. Proceedings of the Symposium on Autonomous Vehicles in Mine Countermeasures, Monterey, CA (United States), 1995. pp.3-7.
68. G. A. Clark, et al. Multispectral image fusion for detecting land mines. Proceedings of the International Symposium on Aerospace/Defense Sensing and Dual-use Photonics, Orlando, FL (United States), 1995, pp.17-21.
69. R. Mcdaniel, D. Scribner, W. Krebs, et al. Image fusion for tactical applications. Proceedings of SPIE, vol.3436, pp.685-695.
70. R. R. Murphy. Sensor and information fusion for improved vision-based vehicle guidance. IEEE Intelligent Systems and Their Applications, 1998, vol.13, no.6, pp.49-56.
71. J.M. Reed and S. Hutchinson. Image fusion and subpixel parameter estimation for automated optical inspection of electronic components. IEEE Transactions on Industrial Electronics, 1996, vol.43, no.3, pp.346-354.
72. M. A. Abidi and R. C. Gonzalez. Data fusion in robotics and machine intelligence. New York: Academic, 1992.