Real-time fusion of low-light CCD and uncooled IR imagery for color night vision

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 3364, Issue , 1998, Pages 124-135

  Aguilar, Mario ^a   Fay, David A ^a   Ross, W D ^a   Waxman, Allen M ^a   Ireland, David B ^a   Racamato, Joseph P ^a  

^a MIT LINCOLN LABORATORY   (United States)

Author keywords

Multispectral fusion; Night vision; Real time video; Sensor fusion

Indexed keywords

CHARGE COUPLED DEVICES; COLOR; DIGITAL CAMERAS; FACE RECOGNITION; HUMAN ENGINEERING; IMAGE QUALITY; NEURAL NETWORKS; REAL TIME SYSTEMS; SENSORS; VISION;

COLOR NIGHT VISIONS; COLOR PROCESSING; DSP CHIPS; FUSED IMAGES; FUSION ARCHITECTURES; FUSION STRATEGIES; HIGH IMAGE QUALITIES; HUMAN FACTORS; HUMAN PERFORMANCE; MULTI SENSORS; MULTI-BAND IMAGES; MULTISPECTRAL FUSION; NIGHT VISION; RAYTHEON; REAL-TIME VIDEO; SENSOR FUSION; SINGLE IMAGES; THERMAL INFRARED SENSORS; UN-COOLED IR;

IMAGE FUSION;

EID: 62349103086     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.317462     Document Type: Conference Paper

References (35)

1. A.M. Waxman, A.N. Gove, M.C. Seibert, D.A. Fay, J.E. Carrick, J.P. Racamato, E.D. Savoye, B.E. Burke, R.K. Reich, W.H. McGonagle, and D.M. Craig, "Progress on Color Night Vision: Visible/IR Fusion, Perception & Search, and Low-Light CCD Imaging", Proc. SPIE Conf. on Enhanced and Synthetic Vision 1996, SPIE-2736, 96-107, 1996.
2. A.M. Waxman, D.A. Fay, A.N. Gove, M.C. Seibert, J.P. Racamato, J.E. Carrick and E.D. Savoye, "Color night vision: Fusion of intensified visible and thermal IR imagery", Synthetic Vision for Vehicle Guidance and Control, SPIE-2463, 58-68, 1995.
3. A.M. Waxman "Color night vision using visible/LWIR fusion (abstract)", 1995 Conference on Automotive Night Vision/ Enhanced Driving, ERIM: Ann Arbor, MI, 1995.
4. A.M. Waxman, M.C. Seibert, A.N. Gove, D.A. Fay, A.M. Bernardon, C. Lazott, W.R. Steele and R.K. Cunningham, "Neural processing of targets in visible, multispectral IR and SAR imagery", Neural Net., 8, 1029-1051, 1995.
5. A.M. Waxman, A.N. Gove, D.A. Fay, and J.E. Carrick, "Real-time adaptive digital image processing for dynamic range remapping of imagery including low-light-level visible imagery", U.S. patent pending (application submitted 5 September 1996); rights assigned to the Massachusetts Institute of Technology, 1996.
6. A.M. Waxman, D.A. Fay, A.N. Gove, M.C. Seibert, and J.P. Racamato, "Method and apparatus for generating a synthetic image by the fusion of signals representative of different views of the same scene". U.S. Patent 5,555,324, issued 10 September 1996 (filed 1 November 1994); rights assigned to the Massachusetts Institute of Technology, 1996.
7. A.M. Waxman, M. Aguilar, R.A. Baxter, D.A. Fay, D.B. Ireland, J.P. Racamato, and W.D. Ross, "Opponent-color fusion of multi-sensor imagery: Visible, IR, and SAR", Proceedings of the 1998 Meeting of the IRIS Specialty Group on Passive Sensors, 1998.
8. P. J. Burt and R. J. Kolczynski, "Enhanced image capture through fusion", Fourth Internat'l Conf. on Computer Vision, 173-182. Los Alamitos: IEEE Computer Society Press, 1993.
9. D. Ryan and R. Tinkler, "Night pilotage assessment of image fusion", Helmet- and Head-Mounted Displays and Symbology Design Requirements II, SPIE-2465, 50-67, 1995.
10. A. Toet, "Hierarchical image fusion", Machine Vision and Applications, 3, 1-11, 1990.
11. A. Toet, "Multiscale contrast enhancement with applications to image fusion". Optical Eng., 31, 1026-1031, 1992.
12. A. Toet, L. J. van Ruyven and J. M. Valeton, "Merging thermal and visual images by a contrast pyramid", Optical Eng., 28, 789-792, 1989.
13. P. M. Steele and P. Perconti, "Part task investigation of multispectral image fusion using gray scale and synthetic color night vision sensor imagery for helicopter pilotage", Targets and Backgrounds: Characterization and Representation III, SPIE-3062, 88-100, 1997.
14. A. Toet, J. K. IJspeert, A. M. Waxman, and M. Aguilar, "Fusion of visible and thermal imagery improves situational awareness", Proceeds. of the SPIE Conf. on Enhanced and Synthetic Vision 1997, SPIE-3088, 177-188, 1997.
15. A. Toet and J. Walraven, "New false color mapping for image fusion", Optical Engineering, 35, 650-658, 1996.
16. R. K. Reich, B. E. Burke, W. M. McGonagle, D. M. Craig, A. M. Waxman, E. D. Savoye, and B. B. Kosicki, "Low-light-level 640x480 CCD camera for night vision application", Proceedings of the 1998 Meeting of the IRIS Specialty Group on Passive Sensors. Ann Arbor: Infrared Information Analysis Center, 1998.
17. E. D. Savoye, A. M. Waxman, J. Buss, H. Hawkins, and S. B. Campana, "Charge Coupled Devices and Visible/IR Fusion for Night Vision", Procs. of Night Vision '96. London, 1996.
18. P. Schiller, "The ON and OFF channels of the visual system", Trends in Neuroscience, TINS-15, 86-92, 1992.
19. P. Schiller and N. K. Logothetis, "The color-opponent and broad-band channels of the primate visual system", Trends in Neuroscience, TINS-13, 392-398, 1990.
20. P. Gouras, "Color vision", Chapter 31 in Principles of Neural Science (E. R. Kandel, J.H. Schwartz & T. M. Jessell, editors), 467-480, New York: Elsevier Science Publishers, 1991.
21. E. A. Newman and P. H. Hartline, "Integration of visual and infrared information in bimodal neurons of the rattlesnake optic tectum", Science, 213, 789-791, 1981.
22. E. A. Newman and P. H. Hartline, "The infrared vision of snakes", Scientific American, 246 (March), 116-127, 1982.
23. F. S. Frome, S. L. Buck, and R. M. Boynton, "Visibility of borders: separate and combined effects of color differences, luminance contrast, and luminance level", J. Opt. Soc. Am., 71, 145-150, 1981.
24. W. Fink, "Image coloration as an interpretation aid", Proc. of SPIE/OSA Conf. on Image Process., 74, 209-215, 1976.
25. J. L Barbur and P. M. Forsyth, "The effective contrast of coloured targets and its relation to visual search", in Visual Search (ed. D. Brogan), 319-328, London: Taylor & Francis, 1990.
26. J. M. Wolfe, K. R. Cave and S. L. Franzel, "Guided search: An alternative to the feature integration model of visual search", Journal of Experimental Psychology: Human Perception and Performance, 15, 419-433, 1989.
27. S. Grossberg, E. Mingolla, and W. D. Ross, "A neural theory of attentive visual search: Interactions of boundary, surface, spatial, and object representations", Psychological Review, 101, 470-489, 1994.
28. H. Widdel and C. Pfendler, "Visual detection performance in a vigilance task when using a colour display", in Visual Search (ed. D. Brogan), 331-338, London: Taylor & Francis, 1990.
29. E. H. Land, "Color vision and the natural image", Part I. Proc. of the National Academy of Sciences, 45, 115-129, 1959a.
30. E. H. Land, "Experiments in color vision", Scientific American, (May) 84-99, 1959b.
31. E. H. Land, "Recent advances in retinex theory and some implications for cortical computations: Color vision and the natural image", Proceedings of the National Academy of Sciences USA, 80, 5163-5169, 1983.
32. S. Grossberg, "Contour enhancement, short-term memory, and constancies in reverberating neural networks", Studies in Applied Mathematics, 52, 217-257, 1973.
33. S. Grossberg, "Nonlinear neural networks: Principles, mechanisms, and architectures", Neural Net., 1, 17-61, 1988a.
34. S. A. Ellias and S. Grossberg,, "Pattern formation, contrast control, and oscillations in the short memory of shunting on-center off-surround networks", Biological Cybernetics, 20, 69-98, 1975.
35. R. E. Flannery and J. E. Miller, "Status of uncooled infrared imagers", Infrared Imaging Sys., SPIE-1689, 379-395, 1992.