Generation of ROI enhanced depth maps using stereoscopic cameras and a depth camera

IEEE Transactions on Broadcasting

Volumn 54, Issue 4, 2008, Pages 732-740

  Kim, Sung Yeol ^a   Lee, Eun Kyung ^a   Ho, Yo Sung ^a  

^a Gwangju Institute of Science and Technology (GIST)   (South Korea)

Author keywords

Depth camera; Depth map generation; ROI enhanced depth map; Stereo matching

Indexed keywords

IMAGE ENHANCEMENT; MAPS; MERGERS AND ACQUISITIONS; OPTICAL PROJECTORS; SPECIAL EFFECTS; THREE DIMENSIONAL; WEAVING;

ACQUISITION SYSTEMS; CAMERA SYSTEMS; COLOR IMAGES; DEPTH CAMERA; DEPTH CAMERAS; DEPTH INFORMATIONS; DEPTH MAP GENERATION; DEPTH MAPS; HIGH RESOLUTIONS; IMAGE WARPING; MEASURING DISTANCES; ROI ENHANCED DEPTH MAP; STEREO MATCHING; STEREO MATCHING ALGORITHMS; STEREOSCOPIC CAMERAS; SYNCHRONIZED IMAGES;

CAMERAS;

EID: 57349140009     PISSN: 00189316     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBC.2008.2002338     Document Type: Article

References (29)

1. C. Fehn, "A 3D-TV system, based on video plus depth information," in Proc. of Asilomar Conference on Signals, Systems and Computers, 2003, vol. 2, pp. 1529-1533.
2. L. Zhang and W. Tam, "Stereoscopic image generation based on depth images for 3D TV," IEEE Trans. Broadcast., vol. 51, no. 2, pp. 191-199, 2005.
3. Preliminary FTV Model and Requirements, ISO/IEC JTC1/SC29/ WG11 N8944, 2007.
4. P. Kauff, N. Atzpadin, C. Fehn, M. Müller, O. Schreer, A. Smolic, and R. Tanger, "Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability," Signal Processing Image Communication, vol. 22, no. 2, pp. 217-234, 2007.
5. C. Fehn, R. de la Barré, and S. Pastoor, "Interactive 3-DTV-concepts and key technologies," Proceedings of the IEEE, vol. 94, no. 3, pp. 524-538, 2006.
6. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," International Jour, of Computer Vision, vol. 47, no. 1-3, pp. 7-42, 2002.
7. C. Zitnick, S. Rang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation, " in Proc. of SIGGRAPH, 2004, pp. 600-608.
8. N. Atzpadin, P. Kauff, and O. Schreer, "Stereo analysis by hybrid recursive matching for real-time immersive video conferencing," IEEE Trans. Circuits and Systems for Video Technology, vol. 14, no. 3, pp. 321-334, 2004.
9. A. Hengel, A. Dick, T. Thormahlen, B. Ward, and P. H. S. Torr, "Videotrace: Rapid interactive scene modelling from video," in Proc. of SIGGRAPH, 2007, article 86.
10. S. K. Nayar and Y. Nakagawa, "Shape from focus," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 8, pp. 824-831, 1994.
11. M. Waschbüsch, S. Würmlin, D. Cotting, and M. Gross, "Point-sampled 3D video of real-world scenes," Signal Processing Image Communication, vol. 22, no. 2, pp. 203-216, 2007.
12. S. M. Kim, J. Cha, J. Ryu, and K. H. Lee, "Depth video enhancement of haptic interaction using a smooth, surface reconstruction," IEICE Trans. Information and System, vol. E89-D, pp. 37-44, 2006.
13. G. J. Iddan and G. Yahav, "3D Imaging in the Studio and Elsewhere...," in Proc. of SPUE Videometrics and Optical Methods for 3D Shape Measurements, 2001, pp. 48-55.
14. M. Kawakita, T. Kurita, H. Kikuchi, and S. Inoue, "HDTV axi-vision camera," in Proc. of International Broadcasting Conference, 2002, pp. 397-404.
15. G. Um, K. Y. Kim, C. Ahn, and K. H. Lee, "Three-dimensional scene reconstruction using multi-view images and depth camera," in Proc. of SPIE Stereoscopic Displays and Virtual Reality Systems XII, 2005, vol. 5664, pp. 271-280.
16. J. Diebel and S. Thrun, "An application of Markov random fields to range sensing," Proc. of Advances in Neural Information Processing systems, pp. 291-298, 2005.
17. B. Huhle, S. Fleck, and A. Schilling, "Integrating 3D time-of-flight camera and high resolution images for 3DTV applications," presented at the Proc. of 3DTV conference, 2007, paper no. 89, unpublished.
18. "Camera Calibration Toolbox Program for Matlab Provided by Caltech," [Online]. Available: http://www.vision.caltech.edu/bouguetj/ calib-doc/
19. Y. S. Kang, C. Lee, and Y. S. Ho, "An efficient rectification algorithm for multi-view images in parallel camera array," in Proc. of 3DTV Conference, 2008, pp. 61-64.
20. J. H. Cho, I. Y. Chang, S. M. Kim, and K. H. Lee, "Depth image processing technique for representing human actors in 3DTV using single depth camera," presented at the Proc. of 3DTV Conference, 2007, paper no. 15, unpublished.
21. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient belief propagation for early vision," International Jour, of Computer Vision, vol. 70, no. 1, pp. 41-54, 2006.
22. S. U. Yoon and Y. S. Ho, "Multiple color and depth video coding using a hierarchical representation," IEEE Trans. Circuits and Systems for Video Technology, vol. 17, no. 11, pp. 1450-1460, 2007.
23. Description of Exploration Experiment in 3D video, ISO/IEC JTC1/ SC29/WG11 N9596, 2008.
24. H. Hirschmuller, "Improvements in real-time correlation-based stereo vision," Proc. of Stereo and Multi-Baseline Vision, pp. 141-148, 2001.
25. V. Kolmogorov and R. Zabih, "Computing visual correspondence with occlusions using graph cuts," in Proc. of International Conference on Computer Vision, 2001, pp. 508-515.
26. A. F. Bobick and S. S. Intille, "Large occlusion stereo," International Jour, of Computer Vision, vol. 33, no. 3, pp. 181-200, 1999.
27. Depth Map Estimation Software, ISO/IEC JTC1/SC29/WG11 M15175, 2008.
28. "LMS-Z390i," [Online]. Available: http://www.riegl.com/
29. S. Y. Kim, S. B. Lee, and Y. S. Ho, "Three-dimensional natural video system based on layered representation of depth maps," IEEE Trans. Consumer Electronics, vol. 52, no. 3, pp. 1035-1042, 2006.