Programmable aperture photography: Multiplexed light field acquisition

ACM Transactions on Graphics

Volumn 27, Issue 3, 2008, Pages

  Liang, Chia Kai ^a   Lin, Tai Hsu ^a   Wong, Bing Yi ^a   Liu, Chi ^a   Chen, Homer H ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

[No Author keywords available]

Indexed keywords

ANGULAR RESOLUTIONS; DEPTH ESTIMATION; DEPTH MAPS; HIGH-QUALITY; LIGHT FIELDS; MULTI VIEWS; MULTIPLE EXPOSURES; NOVEL COMPONENT; POST-EXPOSURE; POST-PROCESSING; QUALITY DATA; SELF-CALIBRATION; SENSOR RESOLUTION; VIEW-DEPENDENT;

DATA ACQUISITION; DATA PROCESSING; MAPS; MERGERS AND ACQUISITIONS; MULTIPLEXING; TELECOMMUNICATION;

LIGHT;

EID: 49249138319     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1360612.1360654     Document Type: Article

References (47)

1. ADELSON, E. H., AND WANG, J. Y. A. 1992. Single lens stereo with a plenoptic camera. IEEE Trans. Pattern Anal. Mach. Intell. 14, 2, 99-106.
2. AGGARWAL, M., HUA, H., AND AHUJA, N. 2001. On cosine-fourth and vignetting effects in real lenses. In Proc. ICCV '01: Proc. the Eighth IEEE International Conference on Computer Vision, vol. 1, 472-479.
3. BOYKOV, Y., VEKSLER, O., AND ZABIH, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23, 11, 1222-1239.
4. CHAI, J.-X., CHAN, S.-C., AND TONG, H.-Y. S. X. 2000. Plenoptic sampling. In SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY,USA, 307-318.
5. DEBEVEC, P. E., TAYLOR, C. J., AND MALIK, J. 1996. Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In SIGGRAPH '96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, 11-20.
6. DONOHO, D. 2006. Compressed Sensing. IEEE Trans. Information Theory 52, 4, 1289-1306.
7. DURAND, F., HOLZSCHUCH, N., SOLER, C., CHAN, E., AND SILLION, F. X. 2005. A frequency analysis of light transport. In SIGGRAPH '05: ACM SIGGRAPH 2005 Papers, ACM Press, New York, NY, USA, 1115-1126.
8. FARID, H., AND SIMONCELLI, E. P. 1998. Range estimation by optical differentiation. Journal of the Optical Society of America A 15, 7, 1777-1786.
9. GEORGIEV, T., ZHENG, K. C., CURLESS, B., SALESIN, D., NAYAR, S., AND INTWALA, C. 2006. Spatio-angular resolution tradeoff in integral photography. In EGRW '06: Proc the 17th Eurographics workshop on Rendering.
10. GEORGIEV, T., INTWALA, C., AND BABACAN, D. 2007. Light-field capture by multiplexing in the frequency domain. Adobe technical report, Adobe Systems Incorporated.
11. GOLDMAN, D. B., AND CHEN, J.-H. 2005. Vignette and exposure calibration and compensation. In Proc. ICCV '05: Proc. the 10th IEEE International Conference on Computer Vision, 899-906.
12. GORTLER, S. J., GRZESZCZUK, R., SZELISKI, R., AND COHEN, M. F. 1996. The lumigraph. In SIGGRAPH '96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 43-54.
13. GREEN, P., SUN, W., MATUSIK, W., AND DURAND, F. 2007. Multi-aperture photography. ACM Trans. Graph. 26, 3, 68.
14. HARWIT, M., AND SLOANE, N. J. 1979. Hadamard Transform Optics. Academic Press, New York.
15. HP COMPONENTS GROUP. 1998. Noise sources in CMOS image sensors. Technical report, Hewlett-Packard Company.
16. ISAKSEN, A., MCMILLAN, L., AND GORTLER, S. J. 2000. Dynamically reparameterized light fields. In SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 297-306.
17. IVE, H. E. 1930. Parallax panoramagrams made with a large diameter lens. Journal of the Optical Society of America 20, 6 (June), 332-342.
18. JOSHI, N., MATUSIK, W., AND AVIDAN, S. 2006. Natural video matting using camera arrays. ACM Trans. Graph. 25, 3, 779-786.
19. KANG, S. B., AND SZELISKI, R. 2004. Extracting view-dependent depth maps from a collection of images. International Journal of Computer Vision 58, 2, 139-163.
20. KOLMOGOROV, V., AND ZABIH, R. 2002. Multi-camera scene reconstruction via graph cuts. Proc. European Conference on Computer Vision 3, 82-96.
21. KOLMOGOROV, V. 2006. Convergent tree-reweighted message passing for energy minimization. IEEE Trans. Pattern Anal. Mach. Intell. 28, 10, 1568-1583.
22. LEVIN, A., FERGUS, R., DURAND, F., AND FREEMAN, W. T. 2007. Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26, 3, 70.
23. LEVOY, M., AND HANRAHAN, P. 1996. Light field rendering. In SIGGRAPH '96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, ACM Press, New York, NY, USA, 31-42.
24. LIANG, C.-K., LIU, G., AND CHEN, H. H. 2007. Light field acquisition using programmable aperture camera. In Proc. IEEE International Conference on Image Processing, vol. 5, 233-236.
25. LIPPMANN, M. G. 1908. Epreuves reversible donnant la sensation du relief. J. Phys 7, 821-825.
26. LOWE, D. G. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 2, 91-110.
27. NAYAR, S. K., AND BRANZOI, V. 2003. Adaptive dynamic range imaging: Optical control of pixel exposures over space and time. In Proc ICCV '03: Proc. the Ninth IEEE International Conference on Computer Vision, vol. 2, 1168-1175.
28. NG, R., LEVOY, M., BRÉDIF, M., DUVAL, G., HOROWITZ, M., AND HANRAHAN, P. 2005. Light field photography with a hand-held plenoptic camera. CSTR 2005-02, Stanford University, April.
29. NG, R. 2005. Fourier slice photography. In SIGGRAPH '05: ACM SIGGRAPH 2005 Papers, ACM, New York, NY, USA, 735-744.
30. OKOSHI, T. 1976. Three-dimensional imaging techniques. Academic Press New York.
31. RASKAR, R., TAN, K.-H., FERIS, R., YU, J., AND TURK, M. 2004. Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging. In SIGGRAPH '04: ACM SIGGRAPH 2004 Papers, ACM Press, New York, NY, USA, 679-688.
32. RASKAR, R., AGRAWAL, A., AND TUMBLIN, J. 2006. Coded exposure photography: motion deblurring using fluttered shutter. ACM Trans. Graph. 25, 3, 795-804.
33. RATNER, N., AND SCHECHNER, Y. Y. 2007. Illumination multiplexing within fundamental limits. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 1-8.
34. SCHARSTEIN, D., AND SZELISKI, R. 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47, 1-3, 7-42.
35. SCHECHNER, Y. Y., AND NAYAR, S. K. 2004. Uncontrolled modulation imaging. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 197-204.
36. SCHECHNER, Y. Y., NAYAR, S. K., AND BELHUMEUR, P. N. 2003. A theory of multiplexed illumination. In Proc. ICCV '03: Proc. the Ninth IEEE International Conference on Computer Vision, vol. 2, 808-815.
37. SENKICHI, C., TOSHIO, M., TOSHINORI, H., YUICHI, M., AND HIDETOSHT, K., 2003. Device and method for correcting camera-shake and device for detecting camera shake. JP Patent No. 2003-138436.
38. SUN, J., LI, Y., KANG, S. B., AND SHUM, H.-Y. 2005. Symmetric stereo matching for occlusion handling. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 399-406.
39. SZELISKI, R., ZABIH, R., SCHARSTEIN, D., VEKSLER, O., KOLMOGOROV, V., AGARWALA, A., TAPPEN, M., AND ROTHER, C. 2006. A comparative study of energy minimization methods for markov random fields. In Proc. European Conference on Computer Vision, vol. 2, 16-29.
40. TSIN, Y., RAMESH, V., AND KANADE, T. 2001. Statistical calibration of CCD imaging process. In Proc. ICCV '01: Proc. the Eighth IEEE International Conference on Computer Vision, 480-487.
41. VEERARAGHAVAN, A., RASKAR, R., AGRAWAL, A., MOHAN, A., AND TUMBLIN, J. 2007. Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph. 26, 3, 69.
42. WENGER, A., GARDNER, A., TCHOU, C., UNGER, J., HAWKINS, T., AND DEBEVEC, P. 2005. Performance relighting and reflectance transformation with time-multiplexed illumination. In ACM SIGGRAPH '05: ACM SIGGRAPH 2005 Papers, ACM Press, New York, NY, USA, 756-764.
43. WILBURN, B., JOSHI, N., VAISH, V., TALVALA, E.-V., ANTUNEZ, E., BARTH, A., ADAMS, A., HOROWITZ, M., AND LEVOY, M. 2005. High performance imaging using large camera arrays. In SIGGRAPH '05: ACM SIGGRAPH 2005 Papers, ACM, New York, NY, USA, 765-776.
44. YANG, J. C., EVERETT, M., BUEHLER, C., AND MCMILLAN, L. 2002. A real-time distributed light field camera. In ECPW '02: Proc. the 13th Eurographics workshop on Rendering, 77-86.
45. YANG, Q., YANG, R., DAVIS, J., AND NISTER, D. 2007. Spatial-depth super resolution for range images. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 1-8.
46. ZOMET, A., AND NAYAR, S. K. 2006. Lensless imaging with a controllable aperture. Proc. IEEE Conference on Computer Vision and Pattern Recognition, 339-346.
47. ZWICKER, M., MATUSIK, W., DURAND, F., AND PFISTER, H. 2006. Antialiasing for automultiscopic 3d displays. In EGSR '06: Proc. the 17th Eurographics Symposium on Rendering.