Single capture image fusion

Computational Photography: Methods and Applications

Volumn , Issue , 2017, Pages 1-62

  Adams, James E ^a   Hamilton, John F ^b   Kumar, Mrityunjay ^a   Morales, Efraín O ^a   Palum, Russell ^a   Pillman, Bruce H ^a  

^a EASTMAN KODAK COMPANY   (United States)

^b ROCHESTER INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COLOR; CONSTRAINED OPTIMIZATION; DEGREES OF FREEDOM (MECHANICS); DIGITAL CAMERAS; DIGITAL DEVICES; IMAGE ENHANCEMENT; IMAGE FUSION; SIGNAL TO NOISE RATIO; VIDEO CAMERAS;

COLOR CORRECTION; DESIGN AND MANUFACTURES; IMAGE INFORMATION; IMAGE PROCESSING CHAINS; INDUSTRY STANDARDS; SENSOR HARDWARE; SENSOR SYSTEMS; SIGNAL TO NOISE;

COLOR IMAGE PROCESSING;

EID: 84871643414     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1201/b10284     Document Type: Chapter

References (93)

1. J.T. Compton and J.F. Hamilton Jr., “Image sensor with improved light sensitivity,” U.S. Patent Application 11/191 729, February 2007.
2. M. Kokar and K. Kim, “Review of multisensor data fusion architectures,” in Proceedings of the IEEE International Symposium on Intelligent Control, Chicago, IL, USA, August 1993, pp. 261-266.
3. D.L. Hall and J. Llinas, “An introduction to multisensor data fusion,” Proceedings of the IEEE, vol. 85, no. 1, pp. 6-23, January 1997.
4. R. Mahler, “A unified foundation for data fusion,” in Proceedings of the Data Fusion System Conference, Laurel, MD, USA, June 1987.
5. M.A. Abidi and R.C. Gonzalez, Data Fusion in Robotics and Machine Intelligence, San Diego, CA: Academic Press, October 1992.
6. L. Waltz, J. Llinas, and E. Waltz, Multisensor Data Fusion, Boston, MA, USA: Artech House Publishers, August 1990.
7. M. Kumar, “Optimal image fusion using the rayleigh quotient,” in Proceedings of the IEEE Sensors Applications Symposium, New Orleans, LA, USA, February 2009, pp. 269-274.
8. E. Waltz, “The principles and practice of image and spatial data fusion,” in Proceedings of the Eighth National Data Fusion Conference, Dallas, TX, USA, March 1995, pp. 257-278.
9. R.S. Blum, Z. Xue, and Z. Zhang, Multi-Sensor Image Fusion and Its Applications, ch. An overview of image fusion, R.S. Blum and Z. Liu (eds.), Boca Raton, FL: CRC Press, July 2005, pp. 1-36.
10. Z. Zhang and R.S. Blum, “A categorization and study of multiscale-decomposition-based image fusion schemes,” Proceedings of the IEEE, vol. 87, no. 8, pp. 1315-1326, August 1999.
11. R.S. Blum, “Robust image fusion using a statistical signal processing approach,” Information Fusion, vol. 6, no. 2, pp. 119-128, June 2005.
12. R. Raskar, A. Agrawal, and J. Tumblin, “Coded exposure photography: Motion deblurring using fluttered shutter,” ACM Transactions on Graphics, vol. 25, no. 3, pp. 795-804, July 2006.
13. Y. Chibani, “Multisource image fusion by using the redundant wavelet decomposition,” in Proceedings of the IEEE Geoscience and Remote Sensing Symposium, Toulouse, France, July 2003, pp. 1383-1385.
14. M. Hum, K. Mardia, T. Hainsworth, J. Kirkbride, and E. Berry, “Bayesian fused classification of medical images,” IEEE Transactions on Medical Imaging, vol. 15, no. 6, pp. 850-858, December 1996.
15. D.L Hall and S.A.H. McMullen, Mathematical Techniques in Multisensor Data Fusion. Boston, MA, USA: Artech House, 2nd edition, February 2004.
16. J. Llinas and D. Hall, “A challenge for the data fusion community I: Research imperatives for improved processing,” in Proceedings of the Seventh National Symposium On Sensor Fusion, Albuquerque, New Mexico, USA, March 1994.
17. C. Pohl and J.L. van Genderen, “Multisensor image fusion in remote sensing: concepts, methods and applications,” International Journal of Remote Sensing, vol. 19, no. 5, pp. 823-854, March 1998.
18. M. Daniel and A. Willsky, “A multiresolution methodology for signal-level fusion and data assimilation with applications to remote sensing,” Proceedings of the IEEE, vol. 85, no. 1, pp. 164-180, January 1997.
19. E. Lallier and M. Farooq, “A real time pixel-level based image fusion via adaptive weight averaging,” in Proceedings of the Third International Conference on Information Fusion, Paris, France, July 2000, pp. WEC3/3-WEC3/13.
20. G. Pajares and J.M. de la Cruz, “A wavelet-based image fusion tutorial,” Pattern Recognition, vol. 37, no. 9, pp. 1855-1872, September 2004.
21. J. Richards, “Thematic mapping from multitemporal image data using the principal components transformation,” Remote Sensing of Environment, vol. 16, pp. 36-46, August 1984.
22. I. Bloch, “Information combination operators for data fusion: A comparative review with classification,” IEEE Transactions on Systems, Man, and Cybernetics. C, vol. 26, no. 1, pp. 52-67, January 1996.
23. Y. Gao and M. Maggs, “Feature-level fusion in personal identification,” in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA, June 2005, pp. 468-473.
24. V. Sharma and J.W. Davis, “Feature-level fusion for object segmentation using mutual information,” in Proceedings of Computer Vision and Pattern Recognition Workshop, New York, USA, June 2006, pp. 139-146.
25. A. Kumar and D. Zhang, “Personal recognition using hand shape and texture,” IEEE Transactions on Image Processing, vol. 15, no. 8, pp. 2454-2461, August 2006.
26. K. Fukanaga, Introduction to Statistical Pattern Recognition. New York, USA: Academic Press, October 1990.
27. Y. Liao, L.W. Nolte, and L.M. Collins, “Decision fusion of ground-penetrating radar and metal detector algorithms - A robust approach,” IEEE Transactions on Geoscience and Remote Sensing, vol. 45, no. 2, pp. 398-409, February 2007.
28. L.O. Jimenez, A. Morales-Morell, and A. Creus, “Classification of hyperdimensional data based on feature and decision fusion approaches using projection pursuit, majority voting, and neural networks,” IEEE Transactions on Geoscience and Remote Sensing, vol. 37, no. 3, pp. 1360-1366, May 1999.
29. M. Fauvel, J. Chanussot, and J.A. Benediktsson, “Decision fusion for the classification of urban remote sensing images,” IEEE Transactions on Geoscience and Remote Sensing, vol. 44, no. 10, pp. 2828-2838, October 2006.
30. S. Foucher, M. Germain, J.M. Boucher, and G.B. Benie, “Multisource classification using ICM and Dempster-Shafer theory,” IEEE Transactions on Instrumentation and Measurement, vol. 51, no. 2, pp. 277-281, April 2002.
31. F. Nebeker, “Golden accomplishments in biomedical engineering,” IEEE Engineering in Medicine and Biology Magazine, vol. 21, no. 3, pp. 17-47, May/June 2002.
32. D. Barnes, G. Egan, G. OKeefe, and D. Abbott, “Characterization of dynamic 3-D pet imaging for functional brain mapping,” IEEE Transactions on Medical Imaging, vol. 16, no. 3, pp. 261-269, June 1997.
33. S. Wong, R. Knowlton, R. Hawkins, and K. Laxer, “Multimodal image fusion for noninvasive epilepsy surgery planning,” International Journal of Remote Sensing, vol. 16, no. 1, pp. 30-38, January 1996.
34. R. Raskar, A. Agrawal, and J. Tumblin, “Coded exposure photography: Motion deblurring using fluttered shutter,” ACM Transactions on Graphics, vol. 25, no. 3, pp. 795-804, July 2006.
35. A. Agrawal and R. Raskar, “Resolving objects at higher resolution from a single motion-blurred image,” in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA, June 2007, pp. 1-8.
36. M. Kumar and P. Ramuhalli, “Dynamic programming based multichannel image restoration,” in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, PA, USA, March 2005, pp. 609-612.
37. L. Yuan, J. Sun, L. Quan, and H.Y. Shum, “Image deblurring with blurred/noisy image pairs,” ACM Transactions on Graphics, vol. 26, no. 3, July 2007.
38. G. Petschnigg, R. Szeliski, M. Agrawala, M. Cohen, H. Hoppe, and K. Toyama, “Digital photography with flash and no-flash image pairs,” ACM Transactions on Graphics, vol. 23, no. 3, pp. 664-672, August 2004.
39. PJ. Burt and R.J. Kolczynski, “Enhanced image capture through fusion,” in Proceedings of the Fourth International Conference on Computer Vision, Berlin, Germany, May 1993, pp. 173-182.
40. H. Li, B.S. Manjunath, and S.K. Mitra, “Multisensor image fusion using the wavelet transform,” Graphical Models and Image Processing, vol. 57, no. 3, pp. 235-245, May 1995.
41. B.E. Bayer, “Color imaging array,” U.S. Patent 3 971 065, July 1976.
42. Eastman Kodak Company, Kodak KAI-11002 Image Sensor Device Performance Specification, 2006.
43. J.E. Adams Jr. and J.F. Hamilton Jr., “Adaptive color plan interpolation in single color electronic camera,” U.S. Patent 5 506 619, April 1996.
44. C.W. Kim and M.G. Kan, “Noise insensitive high resolution demosaicing algorithm considering cross-channel correlation,” in Proceedings of the International Conference on Image Processing, Genoa, Italy, September 2005, pp. 1100-1103.
45. R. Kimmel, “Demosaicing: Image reconstruction from color CCD samples,” IEEE Transactions on Image Processing, vol. 8, no. 9, pp. 1221-1228, September 1999.
46. R.W.G. Hunt, The Reproduction of Colour, 5th Edition, Kingston-upon-Thames, UK: Fountain Press, 1995.
47. E.J. Giorgianni and T.E. Madden, Digital Color Management Encoding Solutions, 2nd Edition, Chichester, UK: John Wiley and Sons, Ltd., 2008.
48. J.C. Maxwell, On the Theory of Three Primary Colours, Cambridge, England: Cambridge University Press, 1890.
49. R.M. Evans, “Some notes on Maxwell’s colour photograph,” Journal of Photographic Science, vol. 9, no. 4, p. 243, July-August 1961.
50. J.S. Friedman, History of Color Photography, Boston, Massachusets: The American Photographic Publishing Company, 1944.
51. M.L. Collette, “Digital image recording device,” U.S. Patent 5 570 146, May 1994.
52. T.E. Lynch and F. Huettig, “High resolution RGB color line scan camera,” in Proceedings of SPIE, Digital Solid State Cameras: Designs and Applications, San Jose, CA, USA, January 1998, pp. 21-28.
53. G. Sharma and H.J. Trussell, “Digital color imaging,” IEEE Transactions on Image Processing, vol. 6, no. 7, pp. 901-932, July 1997.
54. R.F. Lyon, “Prism-based color separation for professional digital photography,” in Proceedings of the Image Processing, Image Quality, Image Capture, Systems Conference, Portland, OR, USA, March 2000, pp. 50-54.
55. R.F. Lyon and P.M. Hubel, “Eying the camera: Into the next century,” in Proceedings of the IS&T SID Tenth Color Imaging Conference, Scottsdale, AZ, USA, November 2002, pp. 349-355.
56. R.M. Turner and R.J. Guttosch, “Development challenges of a new image capture technology: Foveon X3 image sensors,” in Proceedings of the International Congress of Imaging Science, Rochester, NY, USA, May 2006, pp. 175-181.
57. K.E. Spaulding, E.J. Giorgianni, and G. Woolfe, “Optimized extended gamut color encodings for scene-referred and output-referred image states,” Journal of Imaging Science and Technology, vol. 45, no. 5, September/October 2001, pp. 418-426.
58. M. Anderson, R. Motta, S. Chandrasekar, and M. Stokes, “Proposal for a standard default color space for the internet: sRGB,” in Proceedings of the Fourth IS&T/SID Color Imaging Conference, Scottsdale, AZ, USA, November 1995, pp. 238-245.
59. K.E. Spaulding and J. Holm, “Color encodings: sRGB and beyond,” in Proceedings of the IS&T’s Conference on Digital Image Capture and Associated System, Reproduction and Image Quality Technologies, Portland, OR, USA, April 2002, pp. 167-171.
60. K.E. Spaulding, E.J. Giorgianni, and G. Woolfe, “Reference input/output medium metric RGB color encoding (RIMM/ROMM RGB),” in Proceedings of the Image Processing, Image Quality, Image Capture, Systems Conference, Portland, OR, USA, March 2000, pp. 155-163.
61. “Adobe rgb (1998) color image encoding,” Tech. Rep. http://www.adobe.com/adobergb, Adobe Systems, Inc., 1998.
62. S. Susstrunk, “Standard RGB color spaces,” in Proceedings of the Seventh IS&T/SID Color Imaging Conference, Scottsdale, AZ, USA, November 1999, pp. 127-134.
63. H.E.J. Neugebauer, “Quality factor for filters whose spectral transmittances are different from color mixture curves, and its application to color photography,” Journal of the Optical Society of America, vol. 46, no. 10, pp. 821-824, October 1956.
64. P. Vora and H.J. Trussel, “Measure of goodness of a set of color-scanning filters,” Journal of the Optical Society of America, vol. 10, no. 7, pp. 1499-1508, July 1993.
65. R.L. Baer, W.D. Holland, J. Holm, and P. Vora, “A comparison of primary and complementary color filters for ccd-based digital photography,” Proceedings of the SPIE, pp. 16-25, January 1999.
66. H. Kuniba and R.S. Berns, “Spectral sensitivity optimization of color image sensors considering photon shot noise,” Journal of Electronic Imaging, vol. 18, no. 2, pp. 023002/1-14, April 2009.
67. “Photography - electronic still picture imaging - noise measurements,” Tech. Rep. ISO 15739:2003, ISO TC42/WG 18, 2003.
68. R. Vogel, “Digital imaging device optimized for color performance,” U.S. Patent 5 668 596, September 1997.
69. M. Parmar and S.J. Reeves, “Optimization of color filter sensitivity functions for color filter array based image acquisition,” in Proceedings of the Fourteenth Color Imaging Conference, Scottsdale, AZ, USA, November 2006, pp. 96-101.
70. G.J.C. van der Horst, C.M.M. de Weert, and M.A. Bouman, “Transfer of spatial chromaticity-contrast at threshold in the human eye,” Journal of the Optical Society of America, vol. 57, no. 10, pp. 1260-1266, October 1967.
71. K.T. Mullen, “The contrast sensitivity of human colour vision to red-green and blue-yellow chromatic gratings,” Journal of Physiology, vol. 359, pp. 381-400, February 1985.
72. J.E. Adams Jr., M. Kumar, B.H. Pillman, and J.A. Hamilton, “Four-channel color filter array pattern,” U.S. Patent Application 12/472 563, May 2009.
73. J.E. Adams Jr., M. Kumar, B.H. Pillman, and J.A. Hamilton, “Four-channel color filter array interpolation,” U.S. Patent Application 12/473 305, May 2009.
74. J.E. Adams Jr., M. Kumar, B.H. Pillman, and J.A. Hamilton, “Color filter array pattem having four channels,” U.S. Patent Application 12/478 810, June 2009.
75. J.E. Adams Jr., M. Kumar, B.H. Pillman, and J.A. Hamilton, “Interpolation for four-channel color filter array,” U.S. Patent Application 12/480 820, June 2009.
76. J.D. Gaskill, Linear Systems, Fourier Transforms, and Optics, New York: John Wiley & Sons, 1978.
77. J.D. Gaskill, Linear Systems, Fourier Transforms, and Optics, ch. Characteristics and Applications of Linear Filters, New York: John Wiley & Sons, 1978, pp. 279-281.
78. R. Palum, Single-Sensor Imaging: Methods and Applications for Digital Cameras, ch. Optical antialiasing filters, R. Lukac (ed.), Boca Raton, FL: CRC Press/Taylor & Francis, September 2008, pp. 105-135.
79. D. Cok, “Signal processing method and apparatus for producing interpolated chrominance values in a sampled color image signal,” U.S. Patent 4 642 678, February 1987.
80. J.F. Hamilton Jr. and J.E. Adams Jr., “Adaptive color plan interpolation in single color electronic camera,” U.S. Patent 5 629 734, May 1997.
81. P.S. Tsai, T. Acharya, and A. Ray, “Adaptive fuzzy color interpolation,” Journal of Electronic Imaging, vol. 11, no. 3, pp. 293-305, July 2002.
82. K. Hirakawa and T. Parks, “Adaptive homogeneity-directed demosaicking algorithm,” in Proceedings of the International Conference on Image Processing, Barcelona, Spain, September 2003, pp. 669-672.
83. J.E. Adams Jr., “Design of practical color filter array interpolation algorithms for digital cameras,” in Proceedings of the SPIE Conference on Real-Time Imaging, San Jose, CA, USA, February 1997, pp. 117-125.
84. B.W. Keelan, Handbook of Image Quality: Characterization and Prediction. New York, NY, USA: Marcel Dekker, March 2002.
85. G.C. Holst and T.S. Lomheim, CMOS/CCD sensors and camera systems. Bellingham, WA: The International Society for Optical Engineering, October 2007.
86. H.R.S.Z. Wang, A.C. Bovik and E.P. Simoncelli, “Image quality assessment: From error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600-612, April 2004.
87. J.E. Adams Jr., J.F. Hamilton Jr., and E.B. Gindele, “Noise-reducing a color filter array image,” U.S. Patent Application 10/869 678, December 2005.
88. E.O. Morales and J.F. Hamilton Jr., “Noise reduced color image using panchromatic image,” U.S. Patent Application 11/752 484, November 2007.
89. A. Polesel, G. Ramponi, and V.J. Mathews, “Image enhancement via adaptive unsharp masking,” IEEE Transactions on Image Processing, vol. 9, no. 3, pp. 505-510, March 2000.
90. F.P. de Vries, “Automatic, adaptive, brightness independent contrast enhancement,” Signal Processing, vol. 21, no. 2, pp. 169-182, October 1990.
91. G. Ramponi, N. Strobel, S.K. Mitra, and T. Yu, “Nonlinear unsharp masking methods for image contrast enhancement,” Journal of Electronic Imaging, vol. 5, no. 3, pp. 353-366, July 1996.
92. G. Ramponi, “A cubic unsharp masking technique for contrast enhancement,” Signal Processing, vol. 67, no. 2, pp. 211-222, June 1998.
93. J.E. Adams Jr. and J.F. Hamilton Jr., Single-Sensor Imaging: Methods and Applications for Digital Cameras, ch. Digital camera image processing chain design, R. Lukac (ed.), Boca Raton, FL: CRC Press/Taylor & Francis, September 2008, pp. 67-103.