Compressive light field sensing

IEEE Transactions on Image Processing

Volumn 21, Issue 12, 2012, Pages 4746-4757

  Babacan, S Derin ^a   Ansorge, Reto ^b   Luessi, Martin ^c   Mataran, Pablo Ruiz ^d   Molina, Rafael ^d   Katsaggelos, Aggelos K ^e  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b VARIAN MEDICAL SYSTEMS   (Switzerland)

^c MASSACHUSETTS GENERAL HOSPITAL   (United States)

^d UNIVERSITY OF GRANADA   (Spain)

^e Northwestern University   (United States)

Author keywords

Bayesian methods; coded aperture; compressive sensing; computational photography; image reconstruction; light fields

Indexed keywords

BAYESIAN METHODS; CODED APERTURES; COMPRESSIVE SENSING; COMPUTATIONAL PHOTOGRAPHY; LIGHT FIELDS;

BAYESIAN NETWORKS; COLOR PHOTOGRAPHY; DESIGN; IMAGE RECONSTRUCTION;

RECOVERY;

EID: 84869383940     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2210237     Document Type: Article

References (48)

1. F. Durand and R. Szeliski, "Guest editors' introduction: Computational photography," IEEE Comput. Graph. Appl., vol. 27, no. 2, pp. 21-22, Mar.-Apr. 2007.
2. S. D. Babacan, R. Ansorge, M. Luessi, R. Molina, and A. K. Katsaggelos, "Compressive sensing of light fields," in Proc. IEEE Int. Conf. Image Process., Cairo, Egypt, Jul. 2009, pp. 2337-2340.
3. E. Candes, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006.
4. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
5. R. Baraniuk, "Compressive sensing," IEEE Signal Process. Mag., vol. 24, no. 4, pp. 118-121, Jul. 2007.
6. E. Candès, "Compressive sampling," in Proc. Int. Congr. Math., Madrid, Spain, 2006, pp. 1433-1452.
7. F. Ives, "Parallax stereogram and process of making same," U.S. Patent 3 725 567, Apr. 14, 1903.
8. G. Lippmann, "Epreuves reversible donnant la sensation du relief," J. Phys., vol. 7, no. 4, pp. 821-825, Nov. 1908.
9. T. Adelson and J. Wang, "Single lens stereo with a plenoptic camera," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 2, pp. 99-106, Feb. 1992.
10. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. 23rd Annu. Conf. Comput. Graph. Interact. Tech., 1996, pp. 31-42.
11. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The lumigraph," in Proc. 23rd Annu. Conf. Comput. Graph. Interact. Tech., 1996, pp. 43-54.
12. R. Ng, M. Levoy, M. Brèdif, G. Duval, M. Horowitz, and P. Hanrahan, "Light field photography with a hand-held plenoptic camera," Dept. Comput. Sci., Stanford Univ., Stanford, CA, Tech. Rep. CTSR 2005-02, 2005.
13. T. Georgiev, K. C. Zheng, B. Curless, D. Salesin, S. Nayar, and C. Intwala, "Spatio-angular resolution tradeoffs in integral photography," in Proc. Eurograph. Symp. Render., Jun. 2006, pp. 263-272.
14. B. Wilburn, N. Joshi, V. Vaish, E. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, and M. Levoy, "High performance imaging using large camera arrays," ACM Trans. Graph., vol. 24, no. 3, pp. 765-776, 2005.
15. A. Veeraraghavan, R. Raskar, A. Agrawal, A. Mohan, and J. Tumblin, "Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing," ACM Trans. Graph., vol. 26, no. 3, pp. 69-1-69-12, Jul. 2007.
16. T. Georgiev, C. Intwala, S. D. Babacan, and A. Lumsdaine, "Unified frequency domain analysis of lightfield cameras," in Proc. Eur. Conf. Comput. Vis., Marseille, France, Dec. 2008, pp. 1-15.
17. C.-K. Liang, T.-H. Lin, B.-Y. Wong, C. Liu, and H. H. Chen, "Programmable aperture photography: Multiplexed light field acquisition," ACM Trans. Graph., vol. 27, no. 3, pp. 1-10, Aug. 2008.
18. A. Ashok and M. Neifeld, "Compressive light field imaging," Proc. SPIE 3-D Visuali. Process. II, vol. 7690, p. 76900Q, Apr. 2010.
19. E. E. Fenimore and T. M. Cannon, "Coded aperture imaging with uniformly redundant arrays," Appl. Opt., vol. 17, no. 3, pp. 337-347, 1978.
20. S. R. Gottesman and E. E. Fenimore, "New family of binary arrays for coded aperture imaging," Appl. Opt., vol. 28, no. 20, pp. 4344-4352, 1989.
21. R. Raskar, A. Agrawal, and J. Tumblin, "Coded exposure photography: Motion deblurring using fluttered shutter," in Proc. SIGGRAPH, 2006, pp. 795-804.
22. A. Levin, R. Fergus, F. Durand, and W. T. Freeman, "Image and depth from a conventional camera with a coded aperture," in Proc. ACM Graph. SIGGRAPH Conf., 2007, p. 70.
23. A. Zomet and S. K. Nayar, "Lensless imaging with a controllable aperture," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2006, pp. 339-346.
24. S. K. Nayar and V. Branzoi, "Adaptive dynamic range imaging: Optical control of pixel exposures over space and time," in Proc. 9th IEEE Int. Conf. Comput. Vis., Oct. 2003, pp. 1168-1175.
25. A. Mohan, X. Huang, J. Tumblin, and R. Raskar, "Sensing increased image resolution using aperture masks," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
26. H. Farid and E. P. Simoncelli, "Range estimation by optical differentiation," J. Opt. Soc. Amer. A, vol. 15, no. 7, pp. 1777-1786, 1998.
27. M. E. Gehm, R. John, D. J. Brady, R. M. Willett, and T. J. Schulz, "Single-shot compressive spectral imaging with a dual-disperser architecture," Opt. Exp., vol. 15, no. 21, pp. 14013-14027, 2007.
28. P. Sen and S. Darabi, "Compressive dual photography," Comput. Graph. Forum, vol. 28, no. 2, pp. 609-618, 2009.
29. J. Gu, S. K. Nayar, E. Grinspun, P. N. Belhumeur, and R. Ramamoorthi, "Compressive structured light for recovering inhomogeneous participating media," in Proc. Eur. Conf. Comput. Vis., Oct. 2008, pp. 1-14.
30. R. Marcia and R. Willett, "Compressive coded aperture superresolution image reconstruction," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Apr. 2008, pp. 833-836.
31. R. F. Marcia, Z. T. Harmany, and R. M. Willett, "Compressive coded aperture imaging" Proc. SPIE, Comput. Imag., vol. 7246, no. 1, pp. 72460G-1-72460G-13, Feb. 2009.
32. W. T. Cathey and E. R. Dowski, "New paradigm for imaging systems," Appl. Opt., vol. 41, no. 29, pp. 6080-6092, 2002.
33. H. Nagahara, C. Zhou, T. Watanabe, H. Ishiguro, and S. Nayar, "Programmable aperture camera using LCoS," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 337-350.
34. C.-K. Liang, Y.-C. Shih, and H. Chen, "Light field analysis for modeling image formation," IEEE Trans. Image Process., vol. 20, no. 2, pp. 446-460, Feb. 2011.
35. Z. Zhang and M. Levoy, "Wigner distributions and how they relate to the light field," in Proc. Int. Conf. Comput. Photography, Apr. 2009, pp. 1-10.
36. E. J. Candes and T. Tao, "Decoding by linear programming," IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4203-4215, Dec. 2005.
37. D. Donoho and X. Huo, "Uncertainty principles and ideal atomic decomposition," IEEE Trans. Inf. Theory, vol. 47, no. 7, pp. 2845-2862, Nov. 2001.
38. Z. Ben-Haim, Y. C. Eldar, and M. Elad, "Coherence-based performance guarantees for estimating a sparse vector under random noise," IEEE Trans. Signal Process., vol. 58, no. 10, pp. 5030-5043, Oct. 2010.
39. L. Gan, T. Do, and T. Tran, "Fast compressive imaging using scrambled block Hadamard ensemble," in Proc. EUSIPCO, Lausanne, Switzerland, Aug. 2008, pp. 1-5.
40. L. I. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Phys. D, vol. 60, nos. 1-4, pp. 259-268, 1992.
41. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001.
42. R. Marcia and R. Willet, "Compressive coded aperture video reconstruction," in Proc. EUSIPCO, Lausanne, Switzerland, Aug. 2008, pp. 1-5.
43. S. D. Babacan, R. Molina, and A. K. Katsaggelos, "Parameter estimation in TV image restoration using variational distribution approximation," IEEE Trans. Image Process., vol. 17, no. 3, pp. 326-339, Mar. 2008.
44. J. O. Berger, Statistical Decision Theory and Bayesian Analysis. New York: Springer-Verlag, 1985, chs. 3 and 4.
45. T. Chan, S. Esedoglu, F. Park, and A. Yip, "Recent developments in total variation image restoration," in Handbook of Mathematical Models in Computer Vision, N. Paragios, Y. Chen, and O. Faugeras, Eds. New York: Springer-Verlag, 2005.
46. S. Ma, W. Yin, Y. Zhang, and A. Chakraborty, "An efficient algorithm for compressed MR imaging using total variation and wavelets," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
47. Blender Software [Online]. Available: http://www.blender.org
48. M. Harwit and N. J. A. Sloane, Hadamard Transform Optics. New York: Academic, 1979.