Compressive light field photography using overcomplete dictionaries and optimized projections

ACM Transactions on Graphics

Volumn 32, Issue 4, 2013, Pages

  Marwah, Kshitij ^a   Wetzstein, Gordon ^a   Bando, Yosuke ^a,b   Raskar, Ramesh ^a  

^a MIT MEDIA LAB   (United States)

^b TOSHIBA CORPORATION   (Japan)

Author keywords

Compressive sensing; Computational photography

Indexed keywords

COMPRESSIVE SENSING; COMPUTATIONAL PHOTOGRAPHY; HIGH RESOLUTION; OVER-COMPLETE DICTIONARIES; PROPOSED ARCHITECTURES; RESEARCH INTERESTS; SPARSE RECONSTRUCTION; SPARSE REPRESENTATION;

CAMERAS; COLOR PHOTOGRAPHY; OPTICAL DESIGN;

OPTIMIZATION;

EID: 84880766672     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2461912.2461914     Document Type: Article

References (45)

1. ADELSON, E., AND WANG, J. 1992. Single Lens Stereo with a Plenoptic Camera. IEEE Trans. PAMI 14, 2, 99-106.
2. ASHOK, A., AND NEIFELD, M. A. 2010. Compressive Light Field Imaging. In Proc. SPIE 7690, 76900Q.
3. BABACAN, S., ANSORGE, R., LUESSI, M., MATARAN, P., MOLINA, R., AND KATSAGGELOS, A. 2012. Compressive Light Field Sensing. IEEE Trans. Im. Proc. 21, 12, 4746-4757.
4. BISHOP, T., ZANETTI, S., AND FAVARO, P. 2009. Light-Field Superresolution. In Proc. ICCP, 1-9.
5. CANDÈS, E., AND WAKIN, M. B. 2008. An Introduction to Compressive Sampling. IEEE Signal Processing 25, 2, 21-30.
6. CANDÈS, E. J., ELDAR, Y. C., NEEDELL, D., AND RANDALL, P. 2011. Compressed Sensing with Coherent and Redundant Dictionaries. Appl. and Comp. Harmonic Analysis 31, 1, 59-73.
7. CHEN, S. S., DONOHO, D. L., MICHAEL, AND SAUNDERS, A. 1998. Atomic Decomposition by Basis Pursuit. SIAM J. on Scientific Computing 20, 33-61.
8. DONOHO, D. 2006. Compressed Sensing. IEEE Trans. Inform. Theory 52, 4, 1289-1306.
9. DUARTE-CARVAJALINO, J., AND SAPIRO, G. 2009. Learning to sense sparse signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization. IEEE Trans. Im. Proc. 18, 7, 1395-1408.
10. ELAD, M., AND AHARON, M. 2006. Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries. IEEE Trans. Im. Proc. 15, 12, 3736-3745.
11. FEIGIN, M., FELDMAN, D., AND SOCHEN, N. A. 2012. From High Definition Image to Low Space Optimization. In Scale Space and Var. Methods in Comp. Vision, vol. 6667, 459-470.
12. FERGUS, R., TORRALBA, A., AND FREEMAN, W. T. 2006. Random Lens Imaging. Tech. Rep. TR-2006-058, MIT.
13. GEORGIEV, T., AND LUMSDAINE, A. 2006. Spatio-angular Resolution Tradeoffs in Integral Photography. Proc. EGSR, 263-272.
14. GORTLER, S., GRZESZCZUK, R., SZELINSKI, R., AND COHEN, M. 1996. The Lumigraph. In Proc. ACM SIGGRAPH, 43-54.
15. HEIDE, F., WETZSTEIN, G., RASKAR, R., AND HEIDRICH, W. 2013. Adaptive Image Synthesis for Compressive Displays. ACM Trans. Graph. (SIGGRAPH) 32, 4, 1-11.
16. HITOMI, Y., GU, J., GUPTA, M., MITSUNAGA, T., AND NAYAR, S. K. 2011. Video from a Single Coded Exposure Photograph using a Learned Over-Complete Dictionary. In Proc. IEEE ICCV.
17. IVES, H., 1903. Parallax Stereogram and Process of Making Same. US patent 725, 567.
18. KAMAL, M., GOLBABAEE, M., AND VANDERGHEYNST, P. 2012. Light Field Compressive Sensing in Camera Arrays. In Proc. ICASSP, 5413-5416.
19. LANMAN, D., RASKAR, R., AGRAWAL, A., AND TAUBIN, G. 2008. Shield Fields: Modeling and Capturing 3D Occluders. ACM Trans. Graph. (SIGGRAPH Asia) 27, 5, 131.
20. LANMAN, D., WETZSTEIN, G., HIRSCH, M., HEIDRICH, W., AND RASKAR, R. 2011. Polarization Fields: Dynamic Light Field Display using Multi-Layer LCDs. ACM Trans. Graph. (SIGGRAPH Asia) 30, 1-9.
21. LEVIN, A., FREEMAN, W. T., AND DURAND, F. 2008. Understanding Camera Trade-Offs through a Bayesian Analysis of Light Field Projections. In Proc. ECCV, 88-101.
22. LEVIN, A., HASINOFF, S. W., GREEN, P., DURAND, F., AND FREEMAN, W. T. 2009. 4D Frequency Analysis of Computational Cameras for Depth of Field Extension. ACM Trans. Graph. (SIGGRAPH) 28, 3, 97.
23. LEVOY, M., AND HANRAHAN, P. 1996. Light Field Rendering. In Proc. ACM SIGGRAPH, 31-42.
24. LIANG, C.-K., LIN, T.-H., WONG, B.-Y., LIU, C., AND CHEN, H. H. 2008. Programmable Aperture Photography: Multiplexed Light Field Acquisition. ACM Trans. Graph. (SIGGRAPH) 27, 3, 1-10.
25. LIPPMANN, G. 1908. La Photographie Intégrale. Academie des Sciences 146, 446-451.
26. LUMSDAINE, A., AND GEORGIEV, T. 2009. The Focused Plenoptic Camera. In Proc. ICCP, 1-8.
27. MAIRAL, J., BACH, F., PONCE, G., AND SAPIRO, G. 2009. Online Dictionary Learning For Sparse Coding. In International Conference on Machine Learning.
28. MARCIA, R. F., AND WILLETT, R. M. 2008. Compressive coded aperture video reconstruction. In EUSIPCO.
29. NATARAJAN, B. K. 1995. Sparse Approximate Solutions to Linear Systems. SIAM J. Computing 24, 227-234.
30. NG, R., LEVOY, M., BRÉDIF, M., DUVAL, G., HOROWITZ, M., AND HANRAHAN, P. 2005. Light Field Photography with a Hand-Held Plenoptic Camera. Tech. rep., Stanford University.
31. NG, R. 2005. Fourier Slice Photography. ACM Trans. Graph. (SIGGRAPH) 24, 3, 735-744.
32. PARK, J. Y., AND WAKIN, M. B. 2012. A geometric approach to multi-view compressive imaging. EURASIP Journal on Advances in Signal Processing 37.
33. PEERS, P., MAHAJAN, D. K., LAMOND, B., GHOSH, A., MATUSIK, W., RAMAMOORTHI, R., AND DEBEVEC, P. 2009. Compressive Light Transport Sensing. ACM Trans. Graph. 28
34. PERWASS, C., AND WIETZKE, L. 2012. Single Lens 3D-Camera with Extended Depth-of-Field. In Proc. SPIE 8291, 29-36.
35. REDDY, D., VEERARAGHAVAN, A., AND CHELLAPPA, R. 2011. P2C2: Programmable Pixel Compressive Camera for High Speed Imaging. In Proc. IEEE CVPR, 329-336.
36. SEN, P., AND DARABI, S. 2009. Compressive Dual Photography. Computer Graphics Forum 28, 609-618.
37. VEERARAGHAVAN, A., RASKAR, R., AGRAWAL, A., MOHAN, A., AND TUMBLIN, J. 2007. Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocussing. ACM Trans. Graph. (SIGGRAPH) 26, 3, 69.
38. WAKIN, M. B., LASKA, J. N., DUARTE, M. F., BARON, D., SARVOTHAM, S., TAKHAR, D., KELLY, K. F., AND BARANIUK, R. G. 2006. Compressive imaging for video representation and coding. In Picture Coding Symposium.
39. WETZSTEIN, G., LANMAN, D., HEIDRICH, W., AND RASKAR, R. 2011. Layered 3D: Tomographic Image Synthesis for Attenuation-based Light Field and High Dynamic Range Displays. ACM Trans. Graph. (SIGGRAPH).
40. WETZSTEIN, G., IHRKE, I., AND HEIDRICH, W. 2012. On Plenoptic Multiplexing and Reconstruction. IJCV, 1-16.
41. WETZSTEIN, G., LANMAN, D., HIRSCH, M., AND RASKAR, R. 2012. Tensor Displays: Compressive Light Field Synthesis using Multilayer Displays with Directional Backlighting. ACM Trans. Graph. (SIGGRAPH) 31, 1-11.
42. WILBURN, B., JOSHI, N., VAISH, V., TALVALA, E.-V., ANTUNEZ, E., BARTH, A., ADAMS, A., HOROWITZ, M., AND LEVOY, M. 2005. High Performance Imaging using Large Camera Arrays. ACM Trans. Graph. (SIGGRAPH) 24, 3, 765-776.
43. XU, Z., AND LAM, E. Y. 2012. A High-resolution Lightfield Camera with Dual-mask Design. In Proc. SPIE 8500, 85000U.
44. YANG, A., GANESH, A., SASTRY, S., AND MA, Y. 2010. Fast L1-Minimization Algorithms and An Application in Robust Face Recognition: A Review. Tech. rep., UC Berkeley.
45. YANG, J., WANG, Z., LIN, Z., COHEN, S., AND HUANG, T. 2012. Coupled Dictionary Training for Image Super-Resolution. IEEE Trans. Im. Proc. 21, 8, 3467-3478.