Light-efficient photography

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 33, Issue 11, 2011, Pages 2203-2214

  Hasinoff, Samuel W ^a   Kutulakos, Kiriakos N ^b  

^a Oyota Technological Institute at Chicago   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Computational photography; computer graphics; computer vision; shape from focus

Indexed keywords

CLOSED FORM SOLUTIONS; COMPUTATIONAL PHOTOGRAPHY; DEPTH OF FIELD; EXPOSURE LEVEL; EXPOSURE-TIME; INTEGER PROGRAMMING PROBLEMS; OPTIMAL SEQUENCE; SHAPE FROM FOCUS; SINGLE-SHOT; VARIABLE APERTURE;

COLOR PHOTOGRAPHY; COMPUTER GRAPHICS; INTEGER PROGRAMMING; OPTIMIZATION;

COMPUTER VISION;

EID: 80053103246     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2011.62     Document Type: Article

References (44)

1. G.E. Healey and R. Kondepudy, "Radiometric CCD Camera Calibration and Noise Estimation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 3, pp. 267-276, Mar. 1994.
2. S.W. Hasinoff and K.N. Kutulakos, "A Layer-Based Restoration Framework for Variable-Aperture Photography," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
3. A.P. Pentland, "A New Sense for Depth of Field," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, no. 4, pp. 523-531, July 1987.
4. E. Krotkov, "Focusing," Int'l J. Computer Vision, vol. 1, no. 3, pp. 223-237, 1987.
5. S. Hiura and T. Matsuyama, "Depth Measurement by the Multi-Focus Camera," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 953-959, 1998.
6. M. Watanabe and S.K. Nayar, "Rational Filters for Passive Depth from Defocus," Int'l J. Computer Vision, vol. 27, no. 3, pp. 203-225, 1998. (Pubitemid 128523360)
7. R. Raskar, A. Agrawal, and J. Tumblin, "Coded Exposure Photography: Motion Deblurring Using Fluttered Shutter," Proc. ACM SIGGRAPH, pp. 795-804, 2006. (Pubitemid 44481041)
8. L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Image Deblurring with Blurred/Noisy Image Pairs," Proc. ACM SIGGRAPH, 2007.
9. J. Telleen, A. Sullivan, J. Yee, P. Gunawardane, O. Wang, I. Collins, and J. Davis, "Synthetic Shutter Speed Imaging," Proc. Eurographics, pp. 591-598, 2007. (Pubitemid 47606937)
10. H. Farid and E.P. Simoncelli, "Range Estimation by Optical Differentiation," J. Optical Soc. Am. A, vol. 15, no. 7, pp. 1777-1786, 1998. (Pubitemid 128567515)
11. W.T. Cathey and E.R. Dowski, "New Paradigm for Imaging Systems," Applied Optics, vol. 41, no. 29, pp. 6080-6092, Oct. 2002. (Pubitemid 35263581)
12. G. Häusler, "A Method to Increase the Depth of Focus by Two Step Image Processing," Optics Comm., vol. 6, no. 1, pp. 38-42, 1972.
13. H. Nagahara, S. Kuthirummal, C. Zhou, and S. Nayar, "Flexible Depth of Field Photography," Proc. European Conf. Computer Vision, vol. 4, pp. 60-73, 2008.
14. A. Zomet and S.K. Nayar, "Lensless Imaging with a Controllable Aperture," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 339-346, June 2006. (Pubitemid 44931349)
15. A. Levin, R. Fergus, F. Durand, and W.T. Freeman, "Image and Depth from a Conventional Camera with a Coded Aperture," Proc. ACM SIGGRAPH, 2007.
16. A. Veeraraghavan, R. Raskar, A. Agrawal, A. Mohan, and J. Tumblin, "Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing," Proc. ACM SIGGRAPH, 2007.
17. A. Levin, S.W. Hasinoff, P. Green, F. Durand, and W.T. Freeman, "4D Frequency Analysis of Computational Cameras for Depth of Field Extension," Proc. ACM SIGGRAPH, 2009.
18. K. Aizawa, K. Kodama, and A. Kubota, "Producing Object-Based Special Effects by Fusing Multiple Differently Focused Images," IEEE Trans. Circuits and Systems for Video Technology, vol. 10, no. 2, pp. 323-330, Mar. 2000. (Pubitemid 30578346)
19. S. Chaudhuri, "Defocus Morphing in Real Aperture Images," J. Optical Soc. Am. A, vol. 22, no. 11, pp. 2357-2365, Nov. 2005. (Pubitemid 41684944)
20. S.W. Hasinoff and K.N. Kutulakos, "Confocal Stereo," Proc. European Conf. Computer Vision, vol. 1, pp. 620-634, 2006. (Pubitemid 44029811)
21. R. Ng, "Fourier Slice Photography," Proc. ACM SIGGRAPH, pp. 735-744, 2005.
22. M. Levoy, R. Ng, A. Adams, M. Footer, and M. Horowitz, "Light Field Microscopy," Proc. ACM SIGGRAPH, pp. 924-934, 2006. (Pubitemid 44481054)
23. P. Debevec and J. Malik, "Recovering High Dynamic Range Radiance Maps from Photographs," Proc. ACM SIGGRAPH, pp. 369-378, 1997.
24. A. Levin, W.T. Freeman, and F. Durand, "Understanding Camera Trade-Offs through a Bayesian Analysis of Light Field Projections," Proc. European Conf. Computer Vision, vol. 4, pp. 88-101, 2008.
25. S.W. Hasinoff, K.N. Kutulakos, F. Durand, and W.T. Freeman, "Time-Constrained Photography," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2009.
26. A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin, and M. Cohen, "Interactive Digital Photomontage," Proc. ACM SIGGRAPH, pp. 294-302, 2004.
27. R. Ng, M. Levoy, M. Brédif, G. Duval, M. Horowitz, and P. Hanrahan, "Light Field Photography with a Hand-Held Plenoptic Camera," Technical Report CTSR 2005-02, Dept. of Computer Science, Stanford Univ., 2005.
28. J. Ogden, E. Adelson, J.R. Bergen, and P. Burt, "Pyramid-Based Computer Graphics," RCA Engineer, vol. 30, no. 5, pp. 4-15, 1985.
29. W.J. Smith, Modern Optical Engineering, third ed. McGraw-Hill, 2000.
30. S.W. Hasinoff, F. Durand, and W.T. Freeman, "Noise-Optimal Capture for High Dynamic Range Photography," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
31. Canon Lens Specifications, http://www.usa.canon.com/eflenses/pdf/spec. pdf, 2011.
32. J. Nocedal and S.J. Wright, Numerical Optimization. Springer, 1999.
33. Y. Boykov, O. Veksler, and R. Zabih, "Fast Approximate Energy Minimization via Graph Cuts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1222-1239, Nov. 2001. (Pubitemid 33137959)
34. Y.Y. Schechner and N. Kiryati, "Depth from Defocus vs. Stereo: How Different Really Are They?" Int'l J. Computer Vision, vol. 39, no. 2, pp. 141-162, Sept. 2000.
35. R. Willson and S. Shafer, "What Is the Center of the Image?" J. Optical Soc. Am. A, vol. 11, no. 11, pp. 2946-2955, Nov. 1994.
36. P. Favaro and S. Soatto, "Seeing beyond Occlusions (and Other Marvels of a Finite Lens Aperture)," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 579-586, 2003.
37. Technical Innovations, http://www.robofocus.com/, 2011.
38. CHDK, http://chdk.wikia.com/, 2011.
39. S. Baker and I. Matthews, "Lucas-Kanade 20 Years On: A Unifying Framework," Int'l J. Computer Vision, vol. 56, no. 3, pp. 221-25, 2004.
40. A. Lumsdaine and T. Georgiev, "The Focused Plenoptic Camera," Proc. Int'l Conf. Computational Photography, 2009.
41. T. Bishop, S. Zanetti, and P. Favaro, "Light Field Superresolution," Proc. Int'l Conf. Computational Photography, 2009.
42. T. Georgiev, C. Zheng, S. Nayar, D. Salesin, B. Curless, and C. Intwala, "Spatio-Angular Resolution Tradeoffs in Integral Photography," Proc. Eurographics Symp. Rendering, pp. 263-272, 2006.
43. A. Levin, S.W. Hasinoff, P. Green, F. Durand, and W.T Freeman, "4D Frequency Analysis of Computational Cameras for Depth of Field Extension," Technical Report MIT-CSAIL-TR-2009-019, Massachusetts Inst. of Technology, 2009.
44. W.T. Welford, "Use of Annular Apertures to Increase Focal Depth," J. Optical Soc. Am. A, vol. 50, no. 8, pp. 749-753, Aug. 1960.