Variational light field analysis for disparity estimation and super-resolution

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 3, 2014, Pages 606-619

  Wanner, Sven ^a   Goldluecke, Bastian ^a  

^a UNIVERSITY OF HEIDELBERG   (Germany)

Author keywords

3D reconstruction; epipolar plane images; Light fields; super resolution; variational methods; view interpolation

Indexed keywords

EID: 84894523748     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2013.147     Document Type: Article

References (36)

1. E. Adelson and J. Bergen, "The Plenoptic Function and the Elements of Early Vision, " Computational Models of Visual Proces sing, vol. 1, MIT Press, 1991.
2. S. Baker and T. Kanade, "Limits on Super-Resolution and How to Break Them, " IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 9, pp. 1167-1183, Sept. 2002. (Pubitemid 35242579)
3. A. Beck and M. Teboulle, "Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems, " SIAM J. Imaging Sciences, vol. 2, pp. 183-202, 2009.
4. J. Berent and P. Dragotti, "Segmentation of Epipolar-Plane Image Volumes with Occlusion and Disocclusion Competition, " Proc. Eighth IEEE Workshop Multimedia Signal Processing, pp. 182-185, 2006.
5. J. Bigün and G.H. Granlund, "Optimal Orientation Detection of Linear Symmetry, " Proc. IEEE Int'l Conf. Computer Vision, pp. 433-438, 1987. (Pubitemid 17613787)
6. T. Bishop and P. Favaro, "Full-Resolution Depth Map Estimation from an Aliased Plenoptic Light Field, " Proc. 10th Asian Conf. Computer Vision (ACCV '10), vol. 1, pp. 186-200, 2011.
7. R. Bolles, H. Baker, and D. Marimont, "Epipolar-Plane Image Analysis: An Approach to Determining Structure from Motion, " Int'l J. Computer Vision, vol. 1, no. 1, pp. 7-55, 1987.
8. J.-X. Chai, X. Tong, S.-C. Chany, and H.-Y. Shum, "Plenoptic Sampling, " Proc. ACM SIGGRAPH, pp. 307-318, 2000. (Pubitemid 32393994)
9. A. Chambolle, "An Algorithm for Total Variation Minimization and Applications, " J. Math. Imaging and Vision, vol. 20, nos. 1/2, pp. 89-97, 2004.
10. A. Criminisi, S. Kang, R. Swaminathan, R. Szeliski, and P. Anandan, "Extracting Layers and Analyzing Their Specular Properties Using Epipolar-Plane-Image Analysis, " Computer Vision and Image Understanding, vol. 97, no. 1, pp. 51-85, 2005. (Pubitemid 40049161)
11. T. Georgiev and A. Lumsdaine, "Focused Plenoptic Camera and Rendering, " J. Electronic Imaging, vol. 19, p. 021106, 2010.
12. I. Geys, T.P. Koninckx, and L.V. Gool, "Fast Interpolated Cameras by Combining a GPU Based Plane Sweep with a Max-Flow Regularisation Algorithm, " Proc. Second Int'l Symp. 3D Data Processing, Visualization, and Transmission (3DPVT), pp. 534-541, 2004. (Pubitemid 40456340)
13. B. Goldluecke, "cocolib-A Library for Continuous Convex Optimization, " http://cocolib.net, 2013.
14. B. Goldluecke and D. Cremers, "Superresolution Texture Maps for Multiview Reconstruction, " Proc. IEEE Int'l Conf. Computer Vision, 2009.
15. S. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen, "The Lumigraph, " Proc. ACM SIGGRAPH, pp. 43-54, 1996.
16. A. Katayama, K. Tanaka, T. Oshino, and H. Tamura, "Viewpoint- Dependent Stereoscopic Display Using Interpolation of Multi-viewpoint Images, " Proc. SPIE, vol. 2409, p. 11, 1995.
17. A. Kubota, K. Aizawa, and T. Chen, "Reconstructing Dense Light Field from Array of Multifocus Images for Novel View Synthesis, " IEEE Trans. Image Processing, vol. 16, no. 1, pp. 269-279, Jan. 2007. (Pubitemid 46437489)
18. M. Levoy, "Light Fields and Computational Imaging, " Computer, vol. 39, no. 8, pp. 46-55, Aug. 2006. (Pubitemid 44275791)
19. M. Levoy and P. Hanrahan, "Light Field Rendering, " Proc. ACM SIGGRAPH, pp. 31-42, 1996.
20. M. Matousek, T. Werner, and V. Hlavac, "Accurate Correspondences from Epipolar Plane Images, " Proc. Computer Vision Winter Workshop, pp. 181-189, 2001.
21. L. McMillan and G. Bishop, "Plenoptic Modeling: An Image-Based Rendering System, " Proc. ACM SIGGRAPH, pp. 39-46, 1995.
22. R. Ng, M. Levoy, M. Bredif, G. Duval, M. Horowitz, and P. Hanrahan, "Light Field Photography with a Hand-Held Plenoptic Camera, " Technical Report CSTR 2005-02, Stanford Univ., 2005.
23. C. Perwass and L. Wietzke, "The Next Generation of Photography, " www.raytrix.de, 2010.
24. T. Pock, D. Cremers, H. Bischof, and A. Chambolle, "Global Solutions of Variational Models with Convex Regularization, " SIAM J. Imaging Sciences, vol. 3, pp. 1122-1145, 2010.
25. M. Protter and M. Elad, "Super-Resolution with Probabilistic Motion Estimation, " IEEE Trans. Image Processing, vol. 18, no. 8, pp. 1899-1904, Aug. 2009.
26. S. Seitz and C. Dyer, "Physically-Valid View Synthesis by Image Interpolation, " Proc. IEEE Workshop Representation of Visual Scenes, pp. 18-25, 1995.
27. H. Shum, S. Chan, and S. Kang, Image-Based Rendering. Springer-Verlag, 2007.
28. A. Siu and E. Lau, "Image Registration for Image-Based Rendering, " IEEE Trans. Image Processing, vol. 14, no. 1, pp. 241-252, Feb. 2005. (Pubitemid 40181982)
29. E. Strekalovskiy and D. Cremers, "Generalized Ordering Constraints for Multilabel Optimization, " Proc. IEEE Int'l Conf. Computer Vision (ICCV), 2011.
30. V. Vaish and A. Adams, "The (New) Stanford Light Field Archive, " http://lightfield.stanford.edu, 2008.
31. V. Vaish, B. Wilburn, N. Joshi, and M. Levoy, "Using Plane + Parallax for Calibrating Dense Camera Arrays, " Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2004.
32. Z. Wang and A. Bovik, "Mean Squared Error: Love It or Leave It?" IEEE Signal Processing Magazine, vol. 26, no. 1, pp. 98-117, Jan. 2009.
33. S. Wanner, "HCI Light Field Archive, " http://lightfield- analysis.net, 2012.
34. S. Wanner, J. Fehr, and B. Jahne, "Generating EPI Representations of 4D Light Fields with a Single Lens Focused Plenoptic Camera, " Proc. Seventh Int'l Conf. Advances in Visual Computing, pp. 90-101, 2011.
35. S. Wanner and B. Goldluecke, "Globally Consistent Depth Labeling of 4D Light Fields, " Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 41-48, 2012.
36. S. Wanner and B. Goldluecke, "Spatial and Angular Variational Super-Resolution of 4D Light Fields, " Proc. European Conf. Computer Vision, 2012.