Multi-view synthesis: A novel view creation approach for free viewpoint video

Signal Processing: Image Communication

Volumn 21, Issue 6, 2006, Pages 476-492

  Cooke, Eddie ^a   Kauff, Peter ^b   Sikora, Thomas ^c  

^a DUBLIN CITY UNIVERSITY   (Ireland)

^b FRAUNHOFER HEINRICH HERTZ INSTITUTE   (Germany)

^c TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

Free viewpoint video; Image based rendering; Multi view synthesis

Indexed keywords

ALGORITHMS; IMAGE PROCESSING; IMAGE RECONSTRUCTION; INTERACTIVE DEVICES; VIDEO CAMERAS;

FREE VIEWPOINT VIDEO; FREE VIEWPOINT VIDEO (FVV); IMAGE-BASED RENDERING; MULTI VIEW SYNTHESIS;

VISUAL COMMUNICATION;

EID: 33747101328     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2006.03.004     Document Type: Article

References (31)

1. Adelson E., and Bergen J. The plenoptic function and the elements of early vision. Computational Models of Visual Processing (1991), MIT Press, Cambridge, MA 3-20
2. S. Chen, L. Williams, View interpolation for image synthesis, in: Proceedings of ACM SIGGRAPH'93, 1993, pp. 279-288.
3. E. Cooke, Modular multi-view synthesis in a scalable image-based rendering system, Ph.D. thesis, Technical University of Berlin, March 2005.
4. E. Cooke, I. Feldmann, P. Kauff, O. Schreer, A modular approach to virtual view creation for a scalable immersive teleconferencing configuration, in: Proceedings of IEEE International Conference on Image Processing, vol. III, 2003, pp. 41-44.
5. E. Cooke, P. Kauff, O. Schreer, Image-based rendering for tele-conference systems, in: Proceedings of Workshop on Computer Graphics Ninth International Conference on Computer Graphics, Visualization and Computer Vision, 2002, pp. 119-126.
6. E. Cooke, P. Kauff, O. Schreer, Image analysis and synthesis for multiple stereo camera teleconferencing systems, in: Proceedings of fourth International Workshop on Image Analysis for Mutlimedia Interactive Services, 2003, pp. 405-410.
7. E. Cooke, N. O'Connor, Multiple image view synthesis for free viewpoint video applications, in: IEEE International Conference on Image Processing, vol. I, 2005, pp. 1029-1032.
8. O. Faugeras, L. Robert, What can two images tell us about a third one, Technical Report 2018, INRIA, July 1993.
9. Fehn C., Cooke E., Schreer O., and Kauff P. 3d analysis and image-based rendering for immersive tv applications. Image Comm. J. 17 9 (2002) 705-715
10. S. Gortler, R. Grzeszczuk, R. Szeliski, M. Cohen, The lumigraph, in: Proceedings of ACM SIGGRAPH'96, 1996, pp. 43-54.
11. P. Heckbert, Fundamentals of texture mapping and image warping, Master's thesis, Department of Computer Science and Electrical Engineering, University of California, June 1989.
12. ISO/IEC/JTC1/SC29/WG11, Introduction to multi-view video coding, Doc N7328 Poznan Poland (July 2005).
13. Lengyel J. The convergence of graphics and vision. IEEE Comput. 31 7 (1998) 46-53
14. M. Levoy, P. Hanrahan, Light field rendering, in: Proceedings of ACM SIGGRAPH'96, 1996, pp. 31-42.
15. L. McMillan, Computing visibility without depth, Technical Report TR95-047, University of North Carolina, Chapel Hill, 1995.
16. L. McMillan, An image-based approach to three-dimensional computer graphics, Ph.D. thesis, University of North Carolina at Chapel Hill, Technical Report TR97-013, 1997.
17. L. McMillan, G. Bishop, Plenoptic modeling: an image-based rendering system, in: Proceedings of ACM SIGGRAPH'95, 1995, pp. 39-46.
18. K. Müller, A. Smolic, M. Droese, P. Voigt, T. Wiegand, Multi-texture modelling of 3d traffic scenes, in: IEEE International Conference on Multimedia and Expo, 2003, pp. 657-660.
19. M. Oliveira, G. Bishop, D. McAllister, Relief texture mapping, in: Proceedings of ACM SIGGRAPH '00, 2000, pp. 259-268.
20. Scharstein D., and Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Internat. J. Comput. Vision 47 1/2/3 (2002) 7-42
21. J. Shade, S. Gortler, L. He, R. Szeliski, Layered depth images, in: Proceedings of ACM SIGGRAPH'98, 1998, pp. 231-242.
22. Shashua A. Algebraic functions for recognition. IEEE Trans. Pattern Anal. Machine Intell. 17 8 (1995) 779-789
23. H. Shum, L. He, Rendering with concentric mosaics, in: Proceedings of ACM SIGGRAPH'99, 1999, pp. 299-306.
24. H. Shum, S. Kang, A review of image-based rendering techniques, in: Proceedings of IEEE/SPIE Visual Communications and Image Processing, 2000, pp. 2-13.
25. Smolic A., and Kauff P. Interactive 3d video representation and coding technologies. IEEE Spec. Issue Adv. Video Coding Delivery 93 1 (2005) 98-110
26. Smolic A., and McCutchen D. 3dav exploration of video-based rendering technology in mpeg. IEEE Trans. Circuits Systems Video Technol. Spec. Issue Immersive Comm. 14 9 (2004) 348-356
27. A. Smolic, K. Müller, P. Merkle, T. Rien, M. Kautzner, P. Eisert, T. Wiegand, Free viewpoint video extraction, representation, coding, and rendering, in: IEEE International Conference on Image Processing, 2004, pp. 379-382.
28. M. Tanimoto, Ftv (free viewpoint television) creating ray-based image engineering, in: Proceedings of the International Conference on Image Processing, vol. II, 2005, pp. 25-28.
29. C. Theobalt, G. Ziegler, M. Magnor, H. Seidel, Model-based free-viewpoint video: acquisition, rendering, and encoding, in: Proceedings of Picture Coding Symposium, vol. Special Session V, 2004, pp. 1-6.
30. Tsai R. A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE J. Robotics and Automation 3 4 (1987) 323-344
31. Wolberg G. Digital Image Warping (1992), IEEE Computer Society Press, Silver Spring, MD