Light field analysis for modeling image formation

IEEE Transactions on Image Processing

Volumn 20, Issue 2, 2011, Pages 446-460

  Liang, Chia Kai ^a   Shih, Yi Chang ^a,b   Chen, Homer H ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b Department of Electrical Engineering and Computer Science   (United States)

Author keywords

Defocus blur; image formation; light field; light transport analysis; perspective transformation; vignetting

Indexed keywords

DEFOCUS BLUR; IMAGE FORMATIONS; LIGHT FIELDS; LIGHT TRANSPORT ANALYSIS; PERSPECTIVE TRANSFORMATION; VIGNETTING;

LINEAR TRANSFORMATIONS;

MATHEMATICAL TRANSFORMATIONS;

EID: 79551676724     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2063036     Document Type: Article

References (37)

1. B. K. P. Horn, Robot Vision. Cambridge, MA: MIT Press, 1986.
2. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 2003.
3. S. K. Nayar, M. Watanabe, and M. Noguchi, "Real-time focus range sensor," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 12, pp. 1186-1198, Dec. 1996.
4. S. B. Kang and R. S. Weiss, "Can we calibrate a camera using an image of a flat, textureless Lambertian surface?," in Proc. 6th Eur. Conf. Comput. Vis., D. Vernon, Ed., 2000, pp. 640-653, Lecture Notes In Computer Science, vol. 1843. Springer-Verlag.
5. M. Born and E. Wolf, Principles of Optics, 7th ed. Cambridge, U.K.: Cambridge Univ. Press, 1999.
6. N. Asada, H. Fujiwara, and T. Matsuyama, "Seeing behind the scene: Analysis of photometric properties of occluding edges by the reversed projection blurring model," IEEE Trans. Pattern. Anal. Mach. Intell., vol. 20, no. 2, pp. 155-67, Feb. 1998.
7. J. R. Bergen and E. H. Adelson, "The plenoptic function and the elements of early vision," in Computational Models of Visual Processing. Cambridge, MA: MIT Press, 1991, pp. 3-20.
8. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. 23rd Annu. Conf. Comput. Graph. Interactive Tech., New York, 1996, pp. 31-42.
9. A. V. Oppenheim, A. S. Willsky, and S. H. Nawab, Signals and Systems, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 1996.
10. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The lumi-graph," in Proc. 23rd Annu. Conf. Comput. Graph. Interactive Tech., New York, NY, 1996, pp. 43-54.
11. J. Chai, X. Tong, S. Chan, and H. Shum, "Plenoptic sampling," in Proc. 27th Annu. Conf. Comput. Graph. Interactive Tech., New York, 2000, pp. 307-318.
12. A. Isaksen, L. McMillan, and S. J. Gortler, "Dynamically reparameter-ized light fields," in Proc. 27th Annu. Conf. Comput. Graph. Interactive Te c h ., New York, 2000, pp. 297-306.
13. R. Ramamoorthi and P. Hanrahan, "A signal-processing framework for inverse rendering," in Proc. 28th Annu. Conf. Comput. Graph. Interactive Tech., New York, 2001, pp. 117-128.
14. R. Ramamoorthi and P. Hanrahan, "A signal-processing framework for reflection," ACM Trans. Graph., vol. 23, no. 4, pp. 1004-1042, Oct. 2004.
15. R. Ramamoorthi and P. Hanrahan, "Frequency space environment map rendering," in Proc. 29th Annu. Conf. Comput. Graph. Interactive Te c h ., New York, 2002, pp. 517-526.
16. J. Lehtinen, "A framework for precomputed and captured light transport," ACM Trans. Graph., vol. 26, no. 4, pp. 13:1-13:22, Oct. 2007.
17. J. Arvo, "The irradiance Jacobian for partially occluded polyhedral sources," in Proc. 21st Annu. Conf. Comput. Graph. Interactive Tech., New York, 1994, pp. 343-350.
18. F. Durand, N. Holzschuch, C. Soler, E. Chan, and F. X. Sillion, "A frequency analysis of light transport," ACM Trans. Graph, vol. 24, no. 3, pp. 1115-1126, Jul. 2005.
19. D.Lanman, R. Raskar, A. Agrawal, and G. Taubin, "Shieldfields: Modeling and capturing 3-D occluders," ACM Trans. Graph., vol. 27, no. 5, pp. 131:1-131:10, Dec. 2008.
20. R. Ramamoorthi, M. Koudelka, and P. Belhumeur, "A Fourier theory for cast shadows," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no.2, pp. 288-295, Feb. 2005.
21. A. Veeraraghavan, R. Raskar, A. Agrawal, A. Mohan, and J. Tumblin, "Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing," ACM Trans. Graph., vol. 26, no.3, pp. 69:1-69:12, Jul. 2007.
22. C.-K. Liang, T.-H. Lin, B.-Y. Wong, C. Liu, and H. H. Chen, "Programmable aperture photography: Multiplexed light field acquisition," ACM Trans. Graph, vol. 27, no. 3, pp. 55:1-55:10, Aug. 2008.
23. T. Georgiev, C. Zheng, S. K. Nayar, B. Curless, D. Salesin, and C. Intwala, "Spatio-angular resolution trade-offs in integral photography," in Proc. Eurograph. Symp. Rendering, 2006, pp. 263-272.
24. T. Georgiev, C. Intwala, S. Babacan, and A. Lumsdaine, "Unified frequency domain analysis of lightfield cameras," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 224-237.
25. M. Zwicker, W. Matusik, F. Durand, and H. Pfister, "Antialiasing for automultiscopic displays," in Proc. Eurograph. Symp. Rendering,2006, pp. 73-82.
26. R. Ng, "Fourier slice photography," ACM Trans. Graph., vol. 24, no. 3, pp. 735-744, Jul. 2005.
27. A. Levin, S. W. Hasinoff, P. Green, F. Durand, and W. T. Freeman, "4-D frequency analysis of computational cameras for depth of field extension," ACM Trans. Graph., vol. 28, no. 3, pp. 97:1-97:14, Aug. 2009.
28. D. N. Wood, D. I. Azuma, K. Aldinger, B. Curless, T. Duchamp, D. G. Salesin, and W. Stuetzle, "Surface light fields for 3-D photography," in Proc. 27th Annu. Conf. Comput. Graph. Interactive Tech., New York, 2000, pp. 287-296.
29. R. Ramamoorthi, D. Mahajan, and P. Belhumeur, "A first-order analysis of lighting, shading, and shadows," ACM Trans. Graph., vol. 26, no. 1, pp. 2:1-2:21, Jan. 2007.
30. A. Gerrard and J. M. Burch, Introduction to Matrix Methods in Optics. New York: Dover, 1994.
31. A. Adams and M. Levoy, "General linear cameras with finite aperture," in Proc. Eurograph. Symp. Rendering, 2007, pp. 121-126.
32. M. Watanabe and S. K. Nayar, "Telecentric optics for focus analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 12, pp. 1360-1365, Dec. 1997.
33. Y.-H. Kao, C.-K. Liang, L.-W. Chang, and H. H. Chen, "Depth detection of light field," in Proc. Int. Conf. Acoust., Speech Signal Process.,2007, vol. 1, pp. 893-896.
34. C.-K. Liang, "Analysis, acquisition, and processing of light field forcomputational photography," Ph.D. dissertation, National TaiwanUniv., Taipei, Taiwan, 2008.
35. Y. Y. Schechner and N. Kiryati, "Depth from defocus vs. stereo: Howdifferent really are they?," Int. J. Comput. Vis., vol. 39, no. 2, pp.141-162, Feb. 2000.
36. Z. Zhang and M. Levoy, "Wigner distributions and how they relate tothe light field," in Proc. Int. Conf. Comput. Photogr., 2009, pp. 1-10.
37. A. Levin, W. T. Freeman, and F. Durand, "Understanding cameratrade-offs through a Bayesian analysis of light field projections," inProc. 10th Eur. Conf. Comput. Vis., 2008, vol. 5305, pp. 88-101.