3DTV view generation using uncalibrated pure rotating and zooming cameras

Signal Processing: Image Communication

Volumn 24, Issue 1-2, 2009, Pages 17-30

  Jarusirisawad, Songkran ^a   Saito, Hideo ^a  

^a KEIO UNIVERSITY   (Japan)

Author keywords

Free viewpoint video; Projective grid space; Trifocal tensor; View interpolation

Indexed keywords

CAMERAS; DIGITAL TELEVISION; FOURIER TRANSFORMS; INTERPOLATION; ROTATION; TELEVISION BROADCASTING;

3D SPACES; CAMERA CALIBRATIONS; EPIPOLAR GEOMETRY; FREE VIEWPOINT VIDEO; NATURAL SCENES; NOVEL METHODS; PROJECTIVE GRID SPACE; SCALE-INVARIANT FEATURE TRANSFORM (SIFT); TRIFOCAL TENSOR; VIEW INTERPOLATION; VISUAL HULL (VH);

TENSORS;

EID: 58549096509     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2008.10.003     Document Type: Article

References (33)

1. Beier T., and Neely S. Feature-based image metamorphosis. ACM Comput. Graph. 26 2 (1992) 35-42 (in: Proceedings of SIGGRAPH'92)
2. Carranza J., Theobalt C., Magnor M., and Seidel H.-P. Free-viewpoint video of human actors. Proceedings of ACM SIGGRAPH'03 (2003) 569-577
3. Chen S., and Williams L. View interpolation for image synthesis. Proceedings of ACM SIGGRAPH'93 (1993) 279-288
4. Eckert G., Wingbermuhle J., and Niem W. Mesh based shape refinement for reconstructing 3D-objects from multiple images. The First European Conference on Visual Media Production (CVMP) (2004) 103-110
5. Eisert P., Steinbach E., and Girod B. Automatic reconstruction of stationary 3-D objects from multiple uncalibrated camera views. IEEE Trans. Circuits Systems Video Technol. 10 (2000) 261-277 (special issue on 3D Video Technology)
6. Fischler M.A., and Bolles R.C. Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography. Comm. ACM 24 6 (1981) 381-395
7. Goldluecke B., and Magnor M. Real-time microfacet billboarding for free-viewpoint video rendering. Proceedings of the IEEE International Conference on Image Processing (2003) 713-716
8. Grau O., Pullen T., and Thomas G. A combined studio production system for 3D capturing of live action and immersive actor feedback. IEEE Trans. Circuits Systems Video Technol. 3 (2004) 370-380
9. Hartley R.I., and Zisserman A. Multiple View Geometry in Computer Vision. second ed. (2004), Cambridge University Press, Cambridge ISBN: 0521540518
10. Ito Y., and Saito H. Free-viewpoint image synthesis from multiple-view images taken with uncalibrated moving cameras. IEEE International Conference on Image Processing (ICIP) (2005) 29-32
11. Jarusirisawad S., and Saito H. Free viewpoint video synthesis based on natural features using uncalibrated moving cameras. ECTI Trans. Electrical Eng. Electronics Comm. 5 2 (2007) 181-190
12. Jarusirisawad S., and Saito H. 3DTV view generation using uncalibrated cameras. Proceedings of the 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (2008) 57-60
13. Kanade T., Rander P.W., and Narayanan P.J. Virtualized reality: concepts and early results. IEEE Workshop on Representation of Visual Scenes (1995) 69-76
14. Kato H., and Billinghurst M. Marker tracking and HMD calibration for a video-based augmented reality conferencing system. Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality (1999) 85-94
15. Laurentini A. The visual hull concept for silhouette based image understanding. IEEE Trans. Pattern Anal. Machine Intell. 16 2 (1994) 150-162
16. V. Lempitsky, D. Ivanov, Seamless mosaicing of image-based texture maps, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Los Alamitos, CA, USA, 2007, pp. 1-6.
17. Lorensen W.E., and Cline H.E. Marching cubes: a high resolution 3D surface construction algorithm. Proceedings of ACM SIGGRAPH'87 (1987) 163-169
18. Lowe D.G. Distinctive image features from scale-invariant keypoints. Internat. J. Comput. Vision 60 2 (2004) 91-110
19. Matei B., and Meer P. A general method for errors-in-variables problems in computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition vol. 2 (2000) 18-25
20. Matusik W., Buehler C., Raskar R., Gortler S.J., and McMillan L. Image-based visual hulls. Proceedings of ACM SIGGRAPH'00 (2000) 369-374
21. Moezzi S., Tai L.C., and Gerard P. Virtual view generation for 3D digital video. IEEE Multimedia 4 1 (1997) 18-26
22. Moreels P., and Perona P. Evaluation of features detectors and descriptors based on 3D objects. Internat. J. Comput. Vision 73 3 (2007) 263-284
23. Nozick V., Michelin S., and Arques D. Real-time plane-sweep with local strategy. J. WSCG 14 1-3 (2006) 121-128
24. Okutomi M., and Kanade T. A multiple-baseline stereo. IEEE Trans. Pattern Anal. Machine Intell. 15 4 (1993) 353-363
25. Pollefeys M., Van Gool L., Vergauwen M., Verbiest F., Cornelis K., Tops J., and Koch R. Visual modeling with a hand-held camera. Internat. J. Comput. Vision 59 3 (2004) 207-232
26. Rodriguez T., Sturm P., Gargallo P., Guilbert N., Heyden A., Menendez J.M., and Ronda J.I. Photorealistic 3D reconstruction from handheld cameras. Machine Vision and Applications 16 4 (2005) 246-257
27. Saito H., Baba S., and Kanade T. Appearance-based virtual view generation from multicamera videos captured in the 3-D room. IEEE Trans. Multimedia 5 3 (2003) 303-316
28. Saito H., and Kanade T. Shape reconstruction in projective grid space from large number of images. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'99) vol. 2 (1999) 49-54
29. Seitz S.M., and Dyer C.R. Physically-valid view synthesis by image interpolation. Proceedings of the IEEE Workshop on Representations of Visual Scenes (1995) 18-25
30. Starck J., and Hilton A. Towards a 3D virtual studio for human appearance capture. Proceedings of the IMA International Conference on Vision, Video and Graphics (VVG) (2003) 17-24
31. Starck J., Kilner J., and Hilton A. Objective quality assessment in free-viewpoint video production. Proceedings of the 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (2008) 225-228
32. Yaguchi S., and Saito H. Improving quality of free-viewpoint image by mesh based 3D shape deformation. J. WSCG 14 1-3 (2006) 57-64
33. Zhang C., and Chen T. A self-reconfigurable camera array. ACM SIGGRAPH Sketches (2004) 151