High-quality reconstruction from multiview video streams

IEEE Signal Processing Magazine

Volumn 24, Issue 6, 2007, Pages 45-57

  Theobalt, Christian ^a   Ahmed, Naveed ^b   Ziegler, Gernot ^b   Seidel, Hans Peter ^c  

^a Stanford University   (United States)

^b MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^c SAARLAND UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; IMAGE CODING; IMAGE QUALITY; IMAGE RECONSTRUCTION; THREE DIMENSIONAL; VISUALIZATION; VOLUME RENDERING;

MULTIVIEW VIDEO STREAMS; REAL-TIME VISUALIZATION;

VIDEO STREAMING;

EID: 85032752231     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2007.905701     Document Type: Article

References (34)

1. N. Ahmed, C. Theobalt, and H.-P. Seidel, "Spatio-temporal reflectance sharing for relightable 3-D video," in Proc. Mirage 2007, pp. 46-58.
2. S. Boivin and A. Gagalowicz, "Image-based rendering of diffuse, specular and glossy surfaces from a single image," in Proc. SIGGRAPIT01, 2001, pp. 107-116.
3. R.L. Carceroni and K.N. Kutulakos, "Multi-view scene capture by surfel sampling: From video streams to non-rigid 3-D motion shape & reflectance," in Proc. ICCV, 2001, pp. 60-67.
4. J. Carranza, C. Theobalt, M.A. Magnor, and H.-P. Seidel, "Free-viewpoint video of human actors," Proc. SIGGRAPH'03, vol. 22, no. 3, pp. 569-577, July 2003.
5. E. de Aguiar, C. Teobalt, M.A. Magnor, and H.-P. Seidel, "Reconstructing human shape and motion from multi-view video," in Proc. CVMP'05, London, U.K., Dec. 2005,pp.42-49.
6. E. de Aguiar, C. Theobalt, C. Stoll, and H.-P. Seidel, "Marker-less deformable mesh tracking for human shape and motion capture," in Proc. IEEE CVPR, Minneapolis, USA, June 2007, pp. 1-8.
7. E. de Aguiar, R. Zayer, C. Theobalt, M. Magnor, and H.-P. Seidel, "Video-driven animationlof human body scans," in Proc. IEEE 3-DTV Conf., Kos Island, Greece, 2007, pp. 1-4.
8. P. Einarsson, C.-F. Chabert, A. Jones, W.-C. Ma, B. Lamond, T. Hawkins, M.B., S. Sylwan, and P. Debevec, "Relighting human locomotion with flowed reflectance fields," in Proc. Eurographics Symp. Rendering 2006, pp. 183-194.
9. D. Goldman, B. Curless, A. Hertzmann, and S. Seitz, "Shape and spatially-varying brdfs from photometric stereo," in Proc. ICCV, 2004, pp. 341-448.
10. M.H. Gross, S. Würmlin, M. Näf, E. Lamboray, C.P. Spagno, A.M. Kunz, E. Koller-Meier, T. Svoboda, L.J. Van Gool, S. Lang, K. Strehlke, A.V. Moere, and O.G. Staadt, "Blue-c: A spatially immersive display and 3-D video portal for telepresence," Proc. SIGGRAPH'03, vol. 22, no. 3, pp. 819-827, 2003.
11. T. Hawkins, A. Wenger, C. Tchou, A. Gardner, F. Göransson, and P. Debevec, "Animatable facial reflectance fields," in Proc. EGSR, 2004, pp. 309-319.
12. E. Lafortune, S.-C. Foo, K.E. Torrance, and D.P. Greenberg, "Non-linear approximation of reflectance functions," in Proc. SIGGRAPH'97, 1997, pp. 117-126.
13. H. Lensch, J. Kautz, M. Goesele, W. Heidrich, and H.-P. Seidel, "Image-based reconstruction of spatial appearance and geometric detail," ACM Trans. Graphics, vol. 22, no. 2, p. 27, 2003.
14. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. SIGGPAPH'96, 1996, pp. 31-42.
15. M. Li, H. Schirmacher, M.A. Magnor, and H.-P. Seidel, "Combining stereo and visual hull information for on-line reconstruction and rendering of dynamic scenes," in Proc. IEEE Multimedia Signal Processing, 2002, pp. 9-12.
16. M. Magnor, P. Ramanathan, and B. Girod, "Multi-view coding for image-based rendering using 3-D scene geometry," IEEE T-CSVT, vol. 13, no. 11, pp. 1092-1106, Nov. 2003.
17. T. Matsuyama and T. Takai, "Generation, visualization, and editing of 3-D video," in Proc. 3-DPVT'02, 2002, p. 234ff.
18. W. Matusik, C. Buehler, R. Raskar, S.J. Gortler, and L. McMillan, "Image-based visual hulls," in Proc. SIGGRAPH'00, 2000, pp. 369-374.
19. W. Matusik and H. Pfister, "3-D TV: A scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes," in Proc. SIGGRAPH'04, 2004, pp. 814-824.
20. W. Matusik, H. Pfister, M. Brand, and L. McMillan, "A data-driven reflectance model," Proc. SIGGRAPH'03, vol. 22, no. 3, pp. 759-769, 2003.
21. B.-T. Phong, "Illumnation for computer generated pictures," Commun. ACM, vol. 16, no. 6, pp. 311-317, 1975.
22. R. Ramamoorthi and P. Hanrahan, "A signal-processing framework for inverse rendering," in Proc. SIGGRAPH'01, 2001, pp. 117-128.
23. H. Rushmeier, G. Taubin, and A. Guéziec, "Applying shape from lighting variation to bump map capture," in Proc. EGSR'97, June 1997, pp. 35-44.
24. J. Starck and A. Hilton, "Surface capture for performance based animation," IEEE Comput. Graph. Appl., vol. 27, no. 3, pp. 21-31, 2007.
25. C. Theobalt, N. Ahmed, H. Lensch, M. Magnor, and H.-P. Seidel, "Seing people in different light: Joint shape, motion and reflectance capture," IEEE TVCG, vol. 13, no. 4, pp. 663-674.
26. C. Theobalt, N. Ahmed, H. Lensch, M.A. Magnor, and H.-P. Seidel, "Enhanced dynamic reflectometry for relightable free-viewpoint video," Max-Planck-Institut fuer Informatik, Saarbrücken, Germany, Res. Rep. MPI-I-2006-4-006, 2006.
27. C. Theobalt, J. Carranza, M. Magnor, and H.-P. Seidel, "Enhancing silhouette-based human motion capture with 3-D motion fields," in Proc. of Pacific Graphics'03, Canmore, Canada, Oct. 2003, pp. 185-193.
28. C. Theobalt, J. Carranza, M. Magnor, and H.-P. Seidel, "A parallel framework for silhouette-based human motion capture," in Proc. VMV'03, Munich, Germany, Nov. 2003, pp. 207-214.
29. M. Waschbüsch, S. Würmlin, D. Cotting, F. Sadlo, and M. Gross, "Scalable 3-D video of dynamic scenes," in Proc. Pacific Graphics 2005, pp. 629-638.
30. A. Wenger, A. Gardner, C. Tchou, J. Unger, T. Hawkins, and P. Debevec, "Performance relighting and reflectance transformation with time-multiplexed illumination," in Proc. SIGGRAPH'05, vol. 24, no. 3, pp. 756-764,2005.
31. S. Würmlin, E. Lamboray, M. Waschbüsch, P. Kaufmann, A. Smolic, and M. Gross, "Image-space free-viewpoint video," in Proc. Vision, Modeling, Visualization (VMV) 2005, 2005, pp. 453-460.
32. G. Ziegler, H. Lensch, N. Ahmed, M.A. Magnor, and H.-P. Seidel, "Multi-video compression in texture space," in Proc. ICIP'04, 2004, pp. 2467-2470.
33. G. Ziegler, H. Lensch, M. Magnor, and H.P. Seidel, "Multi-video compression in texture space using 4-D SPIHT," in Proc. IEEE MMSP 2004, pp. 39-42.
34. C.L. Zitnick, S.B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation," Proc. SIGGPAPH'04, vol. 23, no. 3, pp. 600-608, 2004.