Fusion of multi-sensor imagery for night vision: Color visualization, target learning and search

Proceedings of the 3rd International Conference on Information Fusion, FUSION 2000

Volumn 1, Issue , 2000, Pages

  Fay, D A ^a   Waxman, A M ^a   Aguilar, M ^a,b   Ireland, D B ^a   Racamato, J P ^a   Ross, W D ^a   Streilein, W W ^a   Braun, M I ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b JACKSONVILLE STATE UNIVERSITY   (United States)

Author keywords

data mining; image fusion; night vision; real time processing; Sensor fusion; target recognition

Indexed keywords

COLOR; DATA MINING; IMAGE FUSION; INFORMATION FUSION; INFRARED DEVICES; INFRARED RADIATION; REAL TIME CONTROL; VISION;

FUSION SYSTEM ARCHITECTURE; FUZZY-ARTMAP NEURAL NETWORK; MULTI-SENSOR FUSION SYSTEM; NIGHT VISION; REAL-TIME IMPLEMENTATIONS; REALTIME PROCESSING; SENSOR FUSION; TARGET RECOGNITION;

SENSORS;

EID: 37349124240     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IFIC.2000.862702     Document Type: Conference Paper

References (35)

1. M. Aguilar, D.A. Fay, D.B. Ireland, J.P. Racamato, W.D. Ross, and A.M. Waxman, "Field Evaluations of Dual-Band Fusion for Color Night Vision, " Proc. ofSPlE Conf. On Enhanced and Synthetic Vision 1999, SPIE- 3691, pp. 168-175, 1999.
2. M. Aguilar, D.A. Fay, W.D. Ross, A.M. Waxman, D.B. Ireland, and J.P. Racamato, "Real-time fusion of low-light CCD and uncooled IR imagery for color night vision, " Proc. of SPIE Conf. On Enhanced and Synthetic Vision 1998, SPIE-3364, 1998.
3. R.K. Reich, B.E. Burke, W. M. McGonagle, D.M. Craig, A.M. Waxman, E.D. Savoye, J.A. Gregory, and B.B. Kosicki, "Low-light-level 640x480 CCD camera for night vision application, " Proc. of the Meeting of the IRIS Specialty Group on Passive Sensors 1998, Vol. 1, pp. 261-271, 1998.
4. A.M. Waxman, M. Aguilar, D.A. Fay, D.B. Ireland, J.P. Racamato, W.D. Ross, J.E. Carrick, A.N. Gove, M.C. Seibert, E.D. Savoye, R.K. Reich, B.E. Burke, W.H. McGonagle, and D.M. Craig, "Solid state color night vision: Fusion of low-light visible and thermal IR imagery, " Lincoln Laboratory Journal, 11 (1), pp. 41-60, 1998.
5. A.M. Waxman, A.N. Gove, D.A. Fay, J.P. Racamato, J.E. Carrick, M.C. Seibert and E.D. Savoye, "Color Night Vision: Opponent Processing in the Fusion of Visible and IR Imagery, " Neural Networks, 10 (1), pp. 1-6, 1997.
6. A.M. Waxman, A.N. Gove, D.A. Fay, J.P. Racamato, J. Carrick, M.C. Seibert, E.D. Savoye, B.E. Burke, R.K. Reich, W.H. McGonagle, and D.M. Craig, "Solid state color night vision: Fusion of low-light visible and thermal IR imagery, " Proc. of the Meeting of the IRIS Specialty Group on Passive Sensors 1996, II, pp. 263-280, 1996.
7. A.M. Waxman, A.N. Gove, M.C. Seibert, D.A. Fay, J.E. Carrick, J.P. Racamato, E.D. Savoye, B.E. Burke, R.K. Reich, W.H. McGonagle, and D.M. Craig, "Progress on Color Night Vision: Visible/IR Fusion, Perception & Search, and Low-Light CCD Imaging, " Proc. SPIE Conf. on Enhanced and Synthetic Vision 1996, SPIE-2736, pp. 96-107, 1996.
8. A.M. Waxman, D.A. Fay, A.N. Gove, M.C. Seibert, J.P. Racamato, J.E. Carrick and E.D. Savoye, "Color night vision: Fusion of intensified visible and thermal IR imagery, " Synthetic Vision for Vehicle Guidance and Control, SPIE-2463, pp. 58-68, 1995.
9. A.M. Waxman, A.N. Gove, D.A. Fay, and J.E. Carrick, "Real-Time Adaptive Digital Image Processing for Dynamic Range Remapping of Imagery Including Low-light-level Visible Imagery, " U.S. Patent 5, 909, 244, issued 6/1/99 (filed 9/5/96); rights assigned to the MIT, 1999.
10. E.D. Savoye, A.M. Waxman, R.K. Reich, B.E. Burke, J.A. Gregory, W.H. McGonagle, A.H. Loomis, B.B Kosicki, R.W. Mountain, A.N. Gove, D.A. Fay, J.E. Carrick, "Low-light-level Imaging and Image Processing, " U.S. Patent 5, 880, 777, issued 3/9/99 (filed 4/15/96); rights assigned to the MIT, 1999.
11. A.M. Waxman, D.A. Fay, A.N. Gove, M.C. Seibert, and J.P. Racamato, "Method and apparatus for generating a synthetic image by the fusion of signals representative of different views of the same scene, " U.S. Patent 5, 555, 324, issued 9/10/96 (filed 11/1/94); rights assigned to the MIT, 1996.
12. A. Toet, J. K. IJspeert, A. M. Waxman, and M. Aguilar, "Fusion of visible and thermal imagery improves situational awareness, " Proc. SPIE Conf. on Enhanced and Synthetic Vision, SPIE-3088, pp. 177-188, 1997.
13. A.M. Waxman, M. Aguilar, R.A. Baxter, D.A. Fay, D.B. Ireland, J.P. Racamato, and W.D. Ross, "Opponent- color fusion of multisensor imagery: Visible, IR and S AR, " Proc. of the Meeting of the IRIS Specialty Group on Passive Sensors 1998, 1, pp. 43-61, 1998.
14. A.N. Gove, R.K. Cunningham, and A.M. Waxman, "Opponent-color visual processing applied to multispectral infrared imagery, " Proc. of the Meeting of the IRIS Specialty Group on Passive Sensors 1996, II, pp. 247-262, 1996.
15. P.J. Burt and R.J. Kolczynski, "Enhanced image capture through fusion, " Fourth Internat'l Conf. on Computer Vision, pp. 173-182. Los Alamitos: IEEE Computer Society Press, 1993.
16. D. Ryan and R. Tinkler, "Night pilotage assessment of image fusion, " Helmet- And Head-Mounted Displays and Symbology Design Requirements II, SPIE-2465, pp. 50-67, 1995.
17. A. Toet, "Hierarchical image fusion, " Machine Vision and Applications, 3, pp. 1-11, 1990.
18. A. Toet, "Multiscale contrast enhancement with applications to image fusion, " Optical Eng., 31, 1026-1031, 1992.
19. A. Toet, L.J. van Ruyven and J.M. Valeton, "Merging thermal and visual images by a contrast pyramid, " Optical Eng., 28, pp. 789-792, 1989.
20. P.M. Steele and P. Perconti, "Part task investigation of multispectral image fusion using gray scale and synthetic color night vision sensor imagery for helicopter pilotage, " Targets and Backgrounds: Characterization and Representation III, SPIE-3062, pp. 88-100, 1997.
21. A. Toet and J. Walraven, "New false color mapping for image fusion, " Optical Engineering, 35, pp. 650-658, 1996.
22. M. Norton, R. Kindsfather, and R. Dixon, "Shortwave (1-2.8 nm) imagery applications for fun and profit, " Terrorism and Counterterrorism Methods and Technologies, SPIE-2933, pp. 9-31, 1997.
23. P.K. Kaiser and R.M. Boynton, Human Color Vision, Optical Society of America, Washington, DC, 1996.
24. P. Schiller, "The ON and OFF channels of the visual system, " Trends in Neuroscience, TINS-15, pp. 86-92, 1992.
25. P. Schiller and N.K. Logothetis, "The color-opponent and broad-band channels of the primate visual system, " Trends in Neuroscience, TINS-13, pp. 392-398, 1990.
26. P. Gouras, "Color Vision, " Chapter 31 in Principles of Neural Science (E.R. Kandel, J.H. Schwartz, and T.M. Jessell, editors), pp. 467-480, New York: Elsevier Science Publishers, 1991.
27. E.A. Newman and P.H. Hartline, "The infrared vision of snakes, " Scientific American, 246 (March), pp. 116-127, 1982.
28. E.A. Newman and P.H. Hartline, "Integration of visual and infrared information in bimodal neurons of the rattlesnake optic tectum, " Science, 213, pp. 781-791, 1981.
29. S.A. Ellias and S. Grossberg "Pattern formation, contrast control, and oscillations in the short memory of shunting on-center off-surround networks, " Biological Cybernetics, 20, pp. 69-98, 1975.
30. G.A. Carpenter, S. Grossberg, N. Markuzon, J.H. Reynolds, and D.B. Rosen, "Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps, " IEEE Transactions on Neural Networks, 3, pp. 698-713, 1992.
31. T. Kasuba, "Simplified Fuzzy ARTMAP", AI Expert, Nov 1993.
32. W. Ross, A. Waxman, W. Streilein, J. Verly, F. Liu, M. Braun, P. Harmon, and S. Rak, "Multi-sensor image fusion for efficient color 3D site visualization and rapid analysis utilizing search acceleration algorithms, " to appear in Proc. of the Fourth International Conference on Cognitive and Neural Systems, Boston, MA, May 24-27, 2000.
33. W. Streilein, A. Waxman, W. Ross, M. Braun, F. Liu, and J. Verly, "An interactive mining tool utilizing an extension of Fuzzy ARTMAP for efficient exploitation and enhanced visualization of multi-sensor imagery, " to appear in Proc. of the Fourth International Conference on Cognitive and Neural Systems, Boston, MA, May 24-27, 2000.
34. W. Ross, A. Waxman, W. Streilein, J. Verly, F. Liu, M. Braun, P. Harmon, and S. Rak, "Multi-sensor image fusion for 3D site visualization and search, " to appear in Proc. of the Third International Conference on Information Fusion, Paris, July 10-13, 2000.
35. W. Streilein, A. Waxman, W. Ross, F. Liu, M. Braun, J. Verly, and Read, "Fused multi-sensor image mining for feature foundation data, " to appear in Proc. of the Third International Conference on Information Fusion, Paris, July 10-13, 2000.