Generation of multi-view video using a fusion camera system for 3D displays

IEEE Transactions on Consumer Electronics

Volumn 56, Issue 4, 2010, Pages 2797-2805

  Lee, Eun Kyung ^a   Ho, Yo Sung ^a  

^a Gwangju Institute of Science and Technology (GIST)   (South Korea)

Author keywords

3D display; depth camera; depth estimation; multi view image generation

Indexed keywords

3-D DISPLAYS; 3D WARPING; CAMERA SYSTEMS; COLOR DIFFERENCE; DEPTH CAMERA; DEPTH ESTIMATION; DEPTH MAP; DEPTH VALUE; FUSION SYSTEMS; MOVING OBJECTS; MULTI-VIEW IMAGE; MULTIVIEW VIDEO; OBJECT BOUNDARIES; SEGMENT-BASED; STEREO MATCHING; STEREO VIDEO; TIME OF FLIGHT;

CAMERAS; DETECTOR CIRCUITS; THREE DIMENSIONAL; VIDEO RECORDING;

VIDEO CAMERAS;

EID: 78651440994     PISSN: 00983063     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCE.2010.5681171     Document Type: Article

References (25)

1. P. Kauff, N. Atzpadin, C. Fehn, M. Müller, O. Schreer, A. Smolic, and R. Tanger, "Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability," Signal Processing Image Communication, vol. 22, no. 2, pp. 217-234, Feb. 2007.
2. C. Fehn, R. Barre, and S. Pastoor, "Interactive 3DTV- concepts and key technologies," Proceedings of the IEEE, vol. 94, no. 3, pp. 524-538, March 2006.
3. ISO/IEC JTC1/SC29/WG11 N8944 Preliminary FTV model and requirements April 2007.
4. A. Smolic and D. McCutchen, "3DAV exploration of video-based rendering technology in MPEG", IEEE Trans. on Circuits and Systems for Video Technology, vol. 14, no. 3, .pp. 348-356, March 2004.
5. S. Kim, S. Lee, and Y. Ho, "Three-dimensional Natural Video System based on Layered Representation of Depth Maps," IEEE Trans. Consumer Electronics, vol. 52, no. 3, pp. 1035-1042, August 2006.
6. H. Shin, Y. Kim, H. Parl, and J. Park, "Fast View Synthesis using GPU for 3D Display," IEEE Trans. Consumer Electronics, vol. 54, no. 4, pp. 2068-2076, November 2006.
7. C. Zitnick, S. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation, " Proc. of ACM SIGGRAPH, pp. 600-608, August 2004.
8. C. Zitnick, S. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation, " Proc. of ACM SIGGRAPH, pp. 600-608, August 2004
9. D. Scharstein, and R. Szeliski, "High-accuracy stereo depth maps using structured light," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 195-202, June 2003.
10. G. Iddan and G. Yahav, "3D imaging in the studio and elsewhese," Proc. of SPIE Vidometrics and Optical Methods for 3D Shape Measurements, pp. 48-55, Jan. 2001.
11. M. Kawakita, T. Kurita, H. Kikuchi, and S. Inoue, "HDTV axi-vision camera," Proc. of International Broadcasting Conference, pp. 397-404, Sept. 2002.
12. S. Gokturk, H. Yalcin, C. Bamji, "A time-of-flight depth sensor - system description, issues and solutions," Proc. of IEEE Conference on Computer Vision and Pattern Recognition Workshop, vol. 3, pp. 35, June 2004.
13. Y. Kim, D. Chan, C. Theobalt, and S. Thrun, "Design and calibration of a multi-view TOF sensor fusion system," Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 539-546, June 2008.
14. G. Um, K. Kim, C. Ahn, and K. Lee, "Three-dimensional scene reconstruction using multi-view images and depth camera," Proc. of SPIE Stereoscopic Displays and Virtual Reality Systems XII, vol. 5664, pp. 271-280, Jan. 2005.
15. J. Diebel and S. Thrun, "An application of Markov random fields to range sensing," Proc. of Advances in Neural Information Processing systems, pp. 291-298, Dec. 2005.
16. J. Zhu, L. Wang, R. Yang, and J. Davis, "Fusion of time-of-flight depth and stereo for high accuracy depth maps," Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 231-236, June 2008.
17. E. Lee, Y. Kang,Y. Jung, Y. Ho, "3D video generation using hybrid camera system," Proc. of International Conference on Immersive Telecommunications (IMMERSCOM) , pp. T5(1-6), June 2009.
18. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 22, pp. 1330- 1334, Nov. 2000.
19. Y. Kang, and Y. Ho, "Geometrical compensation for multi-view video in multiple camera array," Proc. of International Symposium ELMAR, vol. 1, pp 83-86, Sept. 2008.
20. N. Joshi, B. Wilburn, V. Vaish, M. Levoy, and M. Horowitz, "Automatic color calibration for large camera arrays," in UCSD CSE Technical. Report. CS2005-0821, May 2005.
21. J. Cho, I. Chang, S. Kim, and K. Lee, "Depth image processing technique for representing human actors in 3DTV using single depth camera," Proc. of 3DTV conference, paper no. 15, May 2007.
22. S. Schuon, C. Theobalt, J. Davis, and S. Thrun, "High-quality scanning using time-of-flight depth superresolution," Proc. of IEEE Conference on Computer Vision and Pattern Recognition on Time-of-Flight Computer Vision, pp.1-8 2008.
23. A. Wang, T. Qiu, and L. Shao, "A simple method of radial distortion correction with centre of distortion estimation," Journal of Mathematic Imaging and Vision, vol. 35, no. 3, pp. 165-172 Nov. 2009.
24. D. Comaniciu and P. Meer, "Mean shift: a robust approach toward feature space analysis," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 603-619, May 2002.
25. ISO/IEC JTC1/SC29/WG11 M15377, "Reference softwares for depth estimation and view synthesis," April 2008