6-DOF VR videos with a single 360-camera

Proceedings - IEEE Virtual Reality

Volumn , Issue , 2017, Pages 37-44

  Huang, Jingwei ^a   Chen, Zhili ^b   Ceylan, Duygu ^b   Jin, Hailin ^b  

^a STANFORD UNIVERSITY   (United States)

^b ADOBE RESEARCH   (United States)

Author keywords

I.2.10 Artificial Intelligence : Vision and Scene Understanding Video analysis; I.3.7 Computer graphics : Three dimensional graphics and realism Virtual reality; I.4.8 Image Processing and Computer Vision : Scene Analysis Motion

Indexed keywords

COMPUTER GRAPHICS; DEGREES OF FREEDOM (MECHANICS); IMAGE PROCESSING; PROGRAM PROCESSORS; THREE DIMENSIONAL COMPUTER GRAPHICS; VIDEO SIGNAL PROCESSING; VIRTUAL REALITY;

6 DEGREE OF FREEDOM; I.2.10 [ARTIFICIAL INTELLIGENCE]: VISION AND SCENE UNDERSTANDING - VIDEO ANALYSIS; I.3.7 [COMPUTER GRAPHICS]: THREE-DIMENSIONAL GRAPHICS AND REALISM - VIRTUAL REALITIES; RECONSTRUCTION ALGORITHMS; SCENE ANALYSIS; STRUCTURE FROM MOTION; TRANSLATIONAL MOTIONS; WARPING ALGORITHMS;

STEREO IMAGE PROCESSING;

EID: 85018390056     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VR.2017.7892229     Document Type: Conference Paper

References (30)

1. C. Buehler, M. Bosse, and L. McMillan. Non-metric image-based rendering for video stabilization. In IEEE CVPR, Volume 2, 2001.
2. D. Caruso, J. Engel, and D. Cremers. Large-scale direct slam for omnidirectional cameras. In Intelligent Robots and Systems (IROS), 2015 IEEE/RSJ International Conference on, pages 141-148. IEEE, 2015.
3. P. Chang and M. Hebert. Omni-directional structure from motion. In Proc. of IEEE Workshop on Omnidirectional Vision, pages 127-133, June 2000.
4. G. Chaurasia, S. Duchêne, O. Sorkine-Hornung, and G. Drettakis. Depth synthesis and local warps for plausible image-based navigation. ACM TOG, 32, 2013.
5. A. Collet, M. Chuang, P. Sweeney, D. Gillett, D. Evseev, D. Calabrese, H. Hoppe, A. Kirk, and S. Sullivan. High-quality streamable free-viewpoint video. In ACM SIGGRAPH, pages 69:1-69:13, 2015.
6. O. Diamanti, A. Vaxman, D. Panozzo, and O. Sorkine-Hornung. Designing n-polyvector fields with complex polynomials. In Computer Graphics Forum, Volume 33, pages 1-11. Wiley Online Library, 2014.
7. Y. Furukawa and J. Ponce. Accurate, dense, and robust multiview stereopsis. IEEE PAMI, 32(8): 1362-1376, Aug. 2010.
8. M. Germann, A. Hornung, R. Keiser, R. Ziegler, S. Würmlin, and M. Gross. Articulated billboards for video-based rendering. In CGF Eurographics, 2010.
9. M. Goesele, N. Snavely, B. Curless, H. Hoppe, and S. M. Seitz. Multiview stereo for community photo collections. In IEEE ICCV, 2007.
10. C. Häne, L. Heng, G. H. Lee, A. Sizov, and M. Pollefeys. Real-time direct dense matching on fisheye images using plane-sweeping stereo. In Int. Conf. 3D Vision, pages 57-64, 2014.
11. R. I. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, ISBN: 0521540518, second edition, 2004.
12. S. Im, H. Ha, F. Rameau, and H. Jeon. All-around depth from small motion with a spherical panoramic camera. In ECCV, 2016.
13. M. Kamali, A. Banno, J.-C. Bazin, I. S. Kweon, and K. Ikeuchi. Stabilizing omnidirectional videos using 3d structure and spherical image warping. In Conf. Machine Vis. App., 2011.
14. T. Kanade, P. Rander, and P. J. Narayanan. Virtualized reality: Constructing virtual worlds from real scenes. IEEE MultiMedia, 4(1): 34-47, Jan. 1997.
15. S. Li. Binocular spherical stereo. IEEE Trans. on Intelligent Transportation Systems, 9(4): 589-600, 2008.
16. F. Liu, M. Gleicher, H. Jin, and A. Agarwala. Content-preserving warps for 3d video stabilization. In ACM SIGGRAPH, pages 44: 1-44:9, 2009.
17. F. Liu, M. Gleicher, J. Wang, H. Jin, and A. Agarwala. Subspace video stabilization. ACM TOG, 30(1): 4:1-4:10, Feb. 2011.
18. F. Liu, Y. Niu, and H. Jin. Joint subspace stabilization for stereoscopic video. In IEEE ICCV, 2013.
19. Y. Liu, Q. Dai, and W. Xu. A point-cloud based multiview stereo algorithm for free-viewpoint video. IEEE TVCG, 2010.
20. B. D. Lucas and T. Kanade. An iterative image registration technique with an application to stereo vision. In Int. Joint Conf. on Artificial Intelligence - Volume 2, pages 674-679, 1981.
21. B. Micusik and T. Pajdla. Structure from motion with wide circular field of view cameras. IEEE Trans. Pattern Anal. Mach. Intell., 28(7): 1135-1149, July 2006.
22. C. Morimoto and R. Chellappa. Evaluation of image stabilization algorithms. In ICASSP, Volume 2, 1998.
23. D. Scaramuzza, A. Martinelli, and R. Siegwart. A flexible technique for accurate omnidirectional camera calibration and structure from motion. In IEEE ICVS, 2006.
24. M. Schönbein and A. Geiger. Omnidirectional 3d reconstruction in augmented manhattan worlds. In IEEE Int. Conf. Intelligent Robots and Systems, pages 716-723, 2014.
25. S. Shen. Accurate multiple view 3d reconstruction using patch-based stereo for large-scale scenes. IEEE transactions on image processing, 22(5): 1901-1914, 2013.
26. N. Snavely, S. M. Seitz, and R. Szeliski. Photo tourism: Exploring photo collections in 3d. In ACM SIGGRAPH, pages 835-846, 2006.
27. C. Tomasi and T. Kanade. Detection and tracking of point features. IJCV, 1991.
28. J. Ventura. Structure from motion on a sphere. In ECCV, 2016.
29. S. Yaguchi and H. Saito. Improving quality of free-viewpoint image by mesh based 3d shape deformation. In WSCG, pages 57-64, 2006.
30. C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski. High-quality video view interpolation using a layered representation. In ACM SIGGRAPH, pages 600-608, 2004.