Pop-up light field: An interactive image-based modeling and rendering system

ACM Transactions on Graphics

Volumn 23, Issue 2, 2004, Pages 143-162

  Shum, Heung Yeung ^a   Sun, Jian ^a   Yamazaki, Shuntaro ^b,d   Li, Yin ^c   Tang, Chi Keung ^c  

^a MICROSOFT RESEARCH ASIA   (China)

^b UNIVERSITY OF TOKYO   (Japan)

^c HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^d 3/F Sigma Building ^*  (Japan)

Author keywords

Image based rendering; Interactive techniques; Layers; Light field; Lumigraph; Matting

Indexed keywords

COHERENT LIGHT; COMPUTATIONAL COMPLEXITY; FEEDBACK; INTERACTIVE COMPUTER SYSTEMS; REAL TIME SYSTEMS; USER INTERFACES;

IMAGE-BASED RENDERING; INTERACTIVE TECHNIQUES; LAYERS; LIGHT FIELD; LUMIGRAPH; MATTING;

IMAGING SYSTEMS;

EID: 12844276956     PISSN: 07300301     EISSN: 07300301     Source Type: Journal    
DOI: 10.1145/990002.990005     Document Type: Article

References (39)

1. BAKER, H. AND BOLLES, R. 1989. Generalizing epipolar-plane image analysis on the spatiotemporal surface. Int. J. Comput. Vis. 3, 1, 33-39.
2. BAKER, S., SZELISKI, R., AND ANANDAN, P. 1998. A layered approach to stereo reconstruction. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'98). IEEE Computer Society Press, Los Alamitos, Calif., 434-441.
3. BERMAN, A., DADOURIAN, A., AND VLAHOS, P. 2000. Method for removing from an image the background surrounding a selected object. U. S. Patent 6, 134, 346.
4. BUEHLER, C., BOSSE, M., MCMILLAN, L., GORTLER, S., AND COHEN, M. 2001. Unstructured lumigraph rendering. In Proceedings of ACM SIGGRAPH'01. ACM, New York, 425-432.
5. CHAI, J.-X., TONG, X., CHAN, S.-C., AND SHUM, H.-Y. 2000. Plenoptic sampling. In Proceedings of ACM SIGGRAPH'00. ACM, New York, 307-318.
6. CHUANG, Y.-Y., AGARWALA, A., CURLESS, B., SALESIN, D. H., AND SZELISKI, R. 2002. Video matting of complex scenes. In Proceedings of ACM SIGGRAPH'02. ACM, New York, 243-248.
7. CHUANG, Y.-Y., CURLESS, B., SALESIN, D. H., AND SZELISKI, R. 2001. A Bayesian approach to digital matting. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'01). II:264-271.
8. CRIMINISI, A., REID, I., AND ZISSERMAN, A. 1999. Single view metrology. In Proceedings of 7th International Conference on Computer Vision (ICCV'99). ACM, New York, 434-441.
9. DEBEVEC, P. E., TAYLOR, C. J., AND MALIK, J. 1996. Modeling and rendering architecture from photographs: a hybrid geometry -and image-based approach. Proceedings of ACM SIGGRAPH'96. ACM, New York, 11-20.
10. DËCORET, X., DURAND, F., BILLION, F., AND DORSEY, J. 2003. Billboard clouds for extreme model simplification. In Proceedings of the ACM Siggraph 2003. ACM, New York.
11. GORTLER, S. J., GRZESZCZUK, R., SZELISKI, R., AND COHEN, M. F. 1996. The lumigraph. In Proceedings of ACM SIGGRAPH'96. ACM, New York, 43-54.
12. HEIGL, B., KOCH, R., POLLEFEYS, M., DENZLER, J., AND GOOL, L. V. 1999. Plenoptic modeling and rendering from image sequences taken by a hand-held camera. In Symposium fur Mustererkennung. 94-101.
13. HORN, B. K. P. AND BROOKS, M. J. 1989. Shape From Shading. MIT Press, Cambridge, Mass.
14. HORRY, Y., ANJYO, K.-I., AND ARAI, K. 1997. Tour into the picture: Using a spidery mesh interface to make animation from a single image. In Proceedings of ACM SIGGRAPH'97. ACM, New York, 225-232.
15. ISAKSEN, A., MCMILLAN, L., AND GORTLER, S. J. 2000. Dynamically reparameterized light fields. In Proceedings of ACM SIGGRAPH'00. ACM, New York, 297-306.
16. KANG, S. B., SZELISKI, R., AND CHAI, J. 2001. Handling occlusions in dense multi-view stereo. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'Ol). IEEE Computer Society Press, Los Alamitos, Calif., 103-110.
17. KE, Q. AND KANADE, T. 2002. A robust subspace approach to layer extraction. In Proceedings of the IEEE Workshop on Motion and Video Computing. IEEE Computer Society Press, Los Alamitos, Calif, 233-242.
18. KOLMOGOROV, V. AND ZABIH, R. 2002. Multi-camera scene reconstruction via graph cuts. In Proceedings of the European Conference on Computer Vision. 82-97.
19. LENGYEL, J. AND SNYDER, J. 1997. Rendering with coherent layers. In Proceedings of ACM SIGGRAPH'97. ACM, New York, 233-242.
20. LEVOY, M. AND HANRAHAN, P. 1996. Light field rendering. In Proceedings of ACM SIGGRAPH'96. ACM, New York, 31-42.
21. MATUSIK, W., BUEHLER, C., RASKAR, R., GORTLER, S. J., AND MCMILLAN, L. 2000. Image-based visual hulls. In Proceedings of ACM SIGGRAPH'00. ACM, New York, 369-374.
22. MATUSIK, W., PFISTER, H., NGAN, A., BEARDSLEY, P., ZIEGLER, R., AND MCMILLAN., L. 2002. Image-based 3d photography using opacity hulls. In Proceedings of ACM SIGGRAPH'02. ACM, New York, 427-437.
23. MISHIMA, Y. 1993. Soft edge chroma-key generation based upon hexoctahedral color space. U.S. Patent 5,355,174.
24. MOK, B., CHEN, M., DORSEY, J., AND DURAND, F. 2001. Image-based modeling and photo editing. In Proceedings of ACM SIGGRAPH'01. ACM, New York, 433-442.
25. PORTER, T. AND DUFF, T. 1984. Compositing digital images. Comput. Graph. 18, 3 (July), 253-259.
26. RADEMACHER, P. 1999. View-dependent geometry. In Proceedings of ACM SIGGRAPH'99. ACM, New York, 439-446.
27. RUSINKIEWICZ, S., HALL-HOLT, O., AND LEVOY, M. 2002. Real-time 3d model acquisition. In Proceedings of ACM SIGGRAPH'02. ACM, New York, 438-446.
28. RUZON, M. A. AND TOMASI, C. 2000. Alpha estimation in natural images. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'00). IEEE Computer Society Press, Los Alamitos, Calif., 18-25.
29. SCHAUFLER, G. 1995. Dynamically generated impostors. In Proceedings of the GI Workshop on Modeling, Virtual Worlds, Distributed Graphics. 129-135.
30. SCHIRMACHER, H., HEIDRICH, W., AND SEIDEL, H.-P. 2000. High-quality interactive lumigraph rendering through warping. In Graphics Interface. 87-94.
31. SEITZ, S. AND KUTULAKOS, K. 1998. Plenoptic image editing. In Proceedings of 7th International Conference on Computer Vision (ICCV98). 17-24.
32. SHADE, J., GORTLER, S., WEI HE, L., AND SZELISKI, R. 1998. Layered depth images. In Proceedings of ACM SIGGRAPH'98. ACM, New York, 231-242.
33. SMITH, A. R. AND BLINN, J. F. 1996. Blue screen matting. In Proceedings of ACM SIGGRAPH'96. ACM, New York, 259-268.
34. STEWART, J., Yu, J., GORTLER, S., AND MCMILLAN, L. 2003. A new reconstruction filter for undersampled light fields. In Eurographics Symposium on Rendering, 2003.
35. SZELISKI, R. AND SHUM, H.-Y. 1997. Creating full view panoramic image mosaics and environment maps. In Proceedings of ACM SIGGRAPH 1997. ACM, New York, 251-258.
36. WANG, J. AND ADELSON, E. 1994. Representing moving images with layers. IEEE Trans. Image Proc. 3, 233-242.
37. WEXLER, Y., FITZGIBBON, A., AND ZISSERMAN., A. 2002. Image-based environment matting. In Proceedings of the 13th Eurographics Workshop on Rendering, Italy.
38. YAMAZAKI, S., SAGAWA, R., KAWASAKI, H., IKEUCHI, K., AND SAKAUCHI, M. 2002. Microfacet billboarding. In Proceedings of the 13th Eurographics Workshop on Rendering. 175-186.
39. ZHANG, Z., WANG, L., GUO, B., AND SHUM, H.-Y. 2002. Feature-based light field morphing. In Proceedings of ACM SIGGRAPH'02. ACM, New York, 457-464.