Reconstructing dense light field from array of multifocus images for novel view synthesis

IEEE Transactions on Image Processing

Volumn 16, Issue 1, 2007, Pages 269-279

  Kubota, Akira ^a   Aizawa, Kiyoharu ^b   Chen, Tsuhan ^c  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b UNIVERSITY OF TOKYO   (Japan)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Blur; Image based rendering (IBR); Light field rendering (LFR); Spatial invariant filter; View interpolation

Indexed keywords

FOCUSING; IMAGE QUALITY; INTERPOLATION; VECTOR QUANTIZATION;

IMAGE-BASED RENDERING; LIGHT-FIELD RENDERING; VIEW INTERPOLATION;

IMAGE RECONSTRUCTION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; PHOTOGRAPHY; THREE DIMENSIONAL IMAGING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFORMATION STORAGE AND RETRIEVAL; PHOTOGRAMMETRY;

EID: 33847730256     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2006.884938     Document Type: Article

References (29)

1. M. Oliveira, "Image-based modeling and rendering techniques: A survey," RITA - Rev. Inf. Teor. Apl., vol. IX, pp. 37-66, 2002.
2. U. R. Dhond and J. K. Aggarwal, "Structure from stereo: A review," IEEE Trans. Syst., Man, Cybern., vol. 19, no. 6, pp. 1489-1510, Jun. 1989.
3. C. Zhang and T. Chen, "A survey on image-based rendering - representation, sampling and compression," EURASIP Signal Process.: Image Commun., vol. 19, pp. 1-28, 2004.
4. H.-Y. Shum, S. B. He, and S.-C. Chan, "Survey of image-based representations and compression techniques," IEEE Trans. Circuit Syst. Video Technol., vol. 13, no. 11, pp. 1020-1037, Nov. 2003.
5. E. H. Adelson and J. R. Bergen, "The plenoptic function and the elements of early vision," in Computat. Models of Visual Processing, M. S. Landy and J.A. Movshon, Eds. Cambridge, MA: MIT Press, 1991, pp. 3-20.
6. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. ACM SIGGRAPH, 1996, pp. 31-42.
7. H.-Y. Shum and L.-W. He, "Rendering with concentric mosaics," in Proc. ACM SIGGRAPH, 1999, pp. 299-306.
8. J-X. Chai, X. Tong, S.-C. Chany, and H.-Y. Shum, "Plenoptic sampling," in Proc. ACM SIGGRAPH, 2000, pp. 307-318.
9. R. Ng, M. Levoy, M. Bredif, G. Duval, M. Horowitz, and P. Hanrahan, "Light Field Photography With a Hand-Held Plenoptic Camera," Tech. Rep. CSTR 2005-02, Comput. Sci. Dept., Stanford Univ, Stanford, CA, 2005.
10. D. G. Aliaga, T. Funkhouser, D. Yanovsky, and I. Carlbom, "Sea of images," IEEE Comput. Graph. Appl., vol. 23, no. 6, pp. 22-30, Jun. 2003.
11. A. M. K. Sju and E. W. H. Lau, "Image registration for image-based rendering," IEEE Trans. Image Process., vol. 14, no. 2, pp. 241-252, Feb. 2005.
12. R. T. Collins, "Space-sweep approach to true multi-image matching," in Proc. CVPR, 1996, pp. 358-363.
13. S. M. Seitz and C. R. Dyer, "Photorealistic scene reconstruction by voxel coloring," in Proc. CVPR, 1997, pp. 1067-1073.
14. K. Kutulakos and S. M. Seitz, "A theory of shape by space carving," Int. J. Comput. Vis., vol. 38, no. 3, pp. 199-218, Jul. 2000.
15. R. Yang, G. Welch, and G. Bishop, "Real-time consensus-based scene reconstruction using commodity graphics hardware," in Proc. Pacific Conf. Computer Graphics and Applications, 2002, pp. 225-235.
16. I. Geys, T. P. Koninckx, and L. V. Gool, "Fast interpolated cameras by combining a GPU based plane sweep with a max-flow regularisation algorithm," in Proc. Int. Symp. 3D Data Processing, Visualization and Transmission, 2004, pp. 534-541.
17. K. Takahashi, A. Kubota, and T. Naemura, "A focus measure for light field rendering," in Proc. Int. Conf. Image Processing, 2004, pp. 2475-2478.
18. C. Zhang and T. Chen, "A self-reconfigurable camera array," in Proc. Eurographics Symp. Rendering, 2004, pp. 243-254.
19. J. Ens and P. Lawrence, "An investigation of methods for determining depth from focus," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 5, pp. 97-107, May 1993.
20. S. K. Nayar and Y. Nakagawa, "Shape from focus: An effective approach for rough surfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, no. 8, pp. 824-831, Aug. 1994.
21. N. Rajagopalan, S. Chaudhuri, and U. Mudenagudi, "Depth estimation and image restoration using defocused stereo pairs," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 11, pp. 1521-1525, Nov. 2004.
22. K. Aizawa, K. Kodama, and A. Kubota, "Producing object based special effects by fusing multiple differently focused images," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 2, pp. 323-330, Feb. 2000.
23. M. Subbarao, T.-C. Wei, and G. Surya, "Focused image recovery from two defocused images recorded with different camera settings," IEEE Trans. Image Process., vol. 4, no. 12, pp. 1613-1627, Dec. 1995.
24. A. Kubota and K. Aizawa, "Reconstructing arbitrarily focused images from two differently focused images using linear filters," IEEE Trans. Image Process., vol. 14, no. 11, pp. 1848-1859, Nov. 2005.
25. N. Asada, H. Fujiwara, and T. Matsuyama, "Seeing behind the scene: Analysis of photometric properties of occluding edges by the reversed projection blurring model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 2, pp. 155-167, Feb. 1998.
26. R. Hsu, K. Kodama, and K. Harashima, "View interpolation using epipolar plane images," in Proc. IEEE Int. Conf. Image Processing, 1994, pp. 745-749.
27. A. Katayama, K. Tanaka, T. Oshino, and H. Tamura, "A viewpoint dependent stereoscopic display using interpolation of multi-viewpoint images," in Proc. SPIE Int. Conf. Stereoscopic Displays and Virtual Reality Systems II, 1995, vol. 2409, pp. 11-20.
28. M. Droese, T. Fujii, and M. Tanimoto, "Ray-space interpolation constraining smooth disparities based on loopy belief propagation," in Proc. Int. Workshop Systems, Signals, Image Processing, 2004, pp. 247-250.
29. A. Isaksen, M. Leonard, and S. J. Gortler, "Dynamically reparameterized light fields," MIT-LCS-TR-778, 1999.