Generalized mosaicing: High dynamic range in a wide field of view

International Journal of Computer Vision

Volumn 53, Issue 3, 2003, Pages 245-267

  Schechner, Yoav Y ^a   Nayar, Shree K ^b  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b Department of Earth and Environmental Sciences   (United States)

Author keywords

Image fusion; Inverse problems; Machine vision; Mosaicing; Mosaicking; Panorama; Physics based vision; Sensors; SNR; Vignetting

Indexed keywords

COMPUTER VISION; DATA ACQUISITION; IMAGE ANALYSIS; INVERSE PROBLEMS; LIGHT TRANSMISSION; OPTICAL FILTERS; SIGNAL TO NOISE RATIO; VIDEO CAMERAS;

IMAGE FUSION;

IMAGING TECHNIQUES;

EID: 0038605655     PISSN: 09205691     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1023082924255     Document Type: Article

References (60)

1. Adelson, E.H. and Bergen, J.R. 1991. The plenoptic function and the elements of early vision. In Computational Models of Visual Processing, M. Landy and J.A. Movshon (Eds.). MIT Press: Cambridge, MA, pp. 3-20.
2. Aggarwal, M. and Ahuja, N. 2001. High dynamic range panoramic imaging. In Proc. ICCV, Vancouver, Canada, vol. I, pp. 2-9.
3. Ballard, R.D. 2001. Ancient Ashkelon. National Geographic, 199(1):61-93.
4. Batson, R.M. 1987. Digital cartography of the planets: New methods, its status, and its future. Photogrammetric Engineering and Remote Sensing, 53:1211-1218.
5. Bernstein, R. 1976. Digital image processing of earth observation sensor data. IBM Journal of Research and Development, 20(1):40-57.
6. Burt, P.J. and Adelson, E.H. 1983a. A multiresolution spline with application to image mosaics. ACM Trans. on Graphics, 2:217-236.
7. Burt, P.J. and Adelson, E.H. 1983b. The Laplacian pyramid as a compact image code. IEEE Trans. on Communications, 31:532-540.
8. Burt, P.J. and Kolczynski, R.J. 1993. Enhanced image capture through fusion. In Proc. Int. Conf. Comp. Vis., Berlin, Germany, pp. 173-182.
9. Capel, D. and Zisserman, A. 1998. Automated Mosaicing with super-resolution zoom. In Proc. Comp. Vis. Patt. Rec., Santa Barbara, CA, pp. 885-891.
10. C-Cam sensors. http://www.vector-international.be/C-Cam/sensors.html
11. Chapra, S.C. and Canale, R.P. 1998. Numerical Methods for Engineers with Programming and Software Applications, 3rd ed., WCB/McGraw-Hill: Boston, pp. 443, 444, 463-467.
12. Coorg, S. and Teller, S. 2000. Spherical mosaics with quaternions and dense correlation. Int. J. Comp. Vision, 37:259-273.
13. Curlander, J.C. 1984. Utilization of spaceborne SAR data for mapping. IEEE Trans. on Geoscience and Remote Sensing, 22:106-112.
14. Davis, A. 1998. Logarithmic pixel compression. TechOnLine Review 2(3).
15. Debevec, P.E. and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. In Proc. SIGGRAPH, Los Angeles, CA, pp. 369-378.
16. Duplaquet, M.L. 1998. Building large image mosaics with invisible seam lines. In Proc. SPIE Visual Information Processing VII, vol. 3387, Orlando, FL, pp. 369-377.
17. Durand, F. and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics, 21(3):257-266.
18. Edmund Industrial Optics 2002. Optics and Optical Instruments Catalog, p. 89, Stock # E41-960, E32-599.
19. Eustice, R., Pizarro, O., Singh, H., and Howland, J. 2002. UWIT: Underwater Image Toolbox for optical image processing and mosaicking in MATLAB. In Proc. IEEE Int. Sympos. on Underwater Technology, Tokyo, Japan, pp. 141-145.
20. Farid, H. and Simoncelli, E.P. 1998. Range estimation by optical differentiation. J. Opt. Soc. Amer. A, 15:1777-1786.
21. Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Transactions on Graphics, 21(3):249-256.
22. Garcia, R., Batlle, J., Cufi, X., and Amat, J. 2001. Positioning an underwater vehicle through image mosaicking. In Proc. IEEE Int. Conf. on Robotics and Automation, Seoul, South Korea, part 3, pp. 2779-2784.
23. Grossberg, M.D. and Nayar, S.K. 2002. What can be known about the radiometric response from images? In Lecture Notes in Computer Science, Proc. ECCV, vol. 2353, Copenhagen, Denmark, part IV, pp. 189-205.
24. Hansen, M., Anandan, P., Dana, K., van der Wal, G., and Burt, P. 1994. Real-time scene stabilization and mosaic construction. In Proc. 2nd IEEE Workshop on Applications of Computer Vision, Sarasota, FL, pp. 54-62.
25. Hsu, S., Sawhney, H.S., and Kumar, R. 2002. Automated mosaics via topology inference. IEEE Computer Graphics and Application, 22(2):44-54.
26. Irani, M. and Anandan, P. 1998a. Robust multi-sensor image alignment. In Proc. Int. Conf. Comp. Vis., Mumbai, India, pp. 959-966.
27. Irani, M. and Anandan, P. 1998b. Video indexing based on mosaic representations. Proceedings of the IEEE, 86:905-921.
28. Irani, M., Anandan, P., Bergen, J., Kumar, R., and Hsu, S. 1996. Efficient representations of video sequences and their application. Signal Processing: Image communication, 8:327-351.
29. Kang, S.B. and Weiss, R. 2000. Can we calibrate a camera using an image of a flat, textureless Lambertian surface? In Proc. ECCV, Dublin, Ireland, part 2, pp. 640-653.
30. Khoo, I.C., Wood, M.V., Shih, M.Y., and Chen, P.H. 1999. Extremely nonlinear photosensitive liquid crystals for image sensing and sensor protection. Optics Express, 4:432-442.
31. Kwok, R., Curlander, J.C., and Pang, S. 1990. An automated system for mosaicking spaceborne SAR imagery. Int. J. Remote Sensing, 11:209-223.
32. Lada, C.J., DePoy, D.L., Merrill, K.M., and Gatley, I. 1991. Infrared images of M17. The Astronomical Journal, 374:533-539.
33. Larson, G.W., Rushmeier, H., and Piatko, C. 1997. A visibility matching tone reproduction operator for high dynamic range scenes. IEEE Trans. on Visualization and Computer Graphics, 3:291-306.
34. Mann, S. 1996. 'Pencigraphy' with AGC: Joint parameter estimation in both domain and range of functions in same orbit of the projective-Wyckoff group. In Proc. Int. Conf. Imag. Process., Lausanne, Switzerland, vol. 3, pp. 193-196.
35. Mann, S. and Picard, R.W. 1995. On being 'Undigital' with digital cameras: Extending dynamic range by combining differently exposed pictures. In IS&T 48th Annual Conference, Washington, DC, pp. 422-428.
36. Marshall, J.A., Burbeck, C.A., Ariely, D., Rolland, J.P., and Martin, K.E. 1996. Occlusion edge blur: A cue to relative visual depth. J. Opt. Soc. Amer. A, 13:681-688.
37. Mitsunaga, T. and Nayar, S.K. 1999. Radiometric self calibration. In Proc. Comp. Vis. Patt. Rec, Fort Collins, CO, vol. I, pp. 374-380.
38. Nayar, S.K. and Mitsunaga, T. 2000. High dynamic range imaging: Spatially varying pixel exposures. In Proc. Comp. Vis. Patt. Rec., Hilton Head Island, SC, vol. I, pp. 472-479.
39. Negahdaripour, S., Xu, X., Khemene, A., and Awan, Z. 1998. 3-D motion and depth estimation from sea-floor images for mosaic-based station-keeping and navigation of ROV's/AUV's and high-resolution sea-floor mapping. In Proc. IEEE Workshop on Autonomous Underwater Vehicles, Cambridge, MA, pp. 191-200.
40. Ogiers, W. 1997. Survey of CMOS imagers. In IMEC report P60280-MS-RP-002, Issue 1.1, part 1.
41. Pardo, A. and Sapiro, G. 2002. Visualization of high dynamic range images. In Proc. IEEE Int. Conf. Image Processing, vol. 1, pp. 633-636.
42. Peleg, S., Ben-Ezra, M., and Pritch, Y. 2001. Omnistereo: Panoramic stereo imaging. IEEE Trans. Patt. Analys. Machine Intell., 23:279-290.
43. Rajagopalan, A.N. and Chaudhuri, S. 1995. A block shift-invariant blur model from defocused images. In Proc. Int. Conf. Imag. Process., Washington DC, vol. 3, pp. 636-639.
44. Reynoso, E.M., Dubner, G.M., Goss, W.M., and Arnal, E.M. 1995. VLA observations of neutral hydrogen in the direction of Puppis A. The Astronomical Journal, 110:318-324.
45. Sawhney, H.S., Kumar, R., Gendel, G., Bergen, J., Dixon, D., and Paragano, V. 1998. VideoBrush™: Experiences with consumer video mosaicing. In Proc. IEEE Workshop on Applications of Computer Vision, Princeton, NJ, pp. 56-62.
46. Schechner, Y.Y. and Nayar, S.K. 2001. Generalized mosaicing. In Proc. IEEE Int. Conf. on Computer Vision, Vancouver, Canada, vol. I, pp. 17-24.
47. Schechner, Y.Y. and Nayar, S.K. 2002. Generalized mosaicing: Wide field of view multispectral imaging. IEEE Trans. Patt. Analys. Machine Intell., 24:1334-1348.
48. Schwartz, J. September 1999. CMOS camera won't be blinded by the light. Photonics Spectra.
49. Sharma, R.K. and Pavel, M. 1997. Multisensor image registration. In Society for Information Display, vol. XXVIII, pp. 951-954.
50. Shum, H.Y. and Szeliski, R. 2000. Systems and experiment paper: Construction of panoramic image mosaics with global and local alignment. Int. J. of Computer Vision, 36:101-130.
51. Smolić, A. and Wiegand, T. 2001. High-resolution image mosaicing. In Proc. IEEE Int. Conf. Imag. Process. Thessaloniki, Greece, vol. 3, pp. 872-875.
52. Socolinsky, D.A. 2000. Dynamic range constraints in image fusion and realization. In Proc. IASTED Int. Conf. Signal and Image Process., Las Vegas, NV, pp. 349-354.
53. Soderblom, L.A., Edwards, K., Eliason, E.M., Sanchez, E.M., and Charette, M.P. 1978. Global color variations on the Martian surface. Icarus, 34:446-464.
54. Surya, G. and Subbarao, M. 1993. Depth from defocus by changing camera aperture: A spatial domain approach. In Proc. Computer Vis. and Patt. Rec., New York, pp. 61-67.
55. Tabiryan, N. and Nersisyan, S. 2002. Liquid-crystal film eclipses the sun artificially. Laser Focus World, 38(5):105-108.
56. Thevenaz, P. and Unser, M. 2000. Optimization of mutual information for multiresolution image registration. IEEE Trans. Imag. Process., 9:2083-2099.
57. Tomasi, C. and Kanade, T. 1992. Shape and motion from image streams under orthography: A factorization method. Int. J. of Comp. Vision, 9:137-154.
58. Uson, J.M., Boughn, S.P., and Kuhn, J.R. 1990. The central galaxy in Abell 2029: An old supergiant. Science, 250:539-540.
59. Vasavada, A.R., Ingersoll, A.P., Banfield, D., Bell, M., Gierasch, P.J., and Belton, M.J.S. 1998. Galileo imaging of Jupiter's atmosphere: The great red spot, equatorial region, and white ovals. Icarus, 135:265-275.
60. Viola, P. and Wells III, W.M. 1997. Alignment by maximization of mutual information. Int. J. of Computer Vision, 24:137-154.