Cube2Video: Navigate between cubic panoramas in real-time

IEEE Transactions on Multimedia

Volumn 15, Issue 8, 2013, Pages 1745-1754

  Zhao, Qiang ^a   Wan, Liang ^a   Feng, Wei ^a   Zhang, Jiawan ^a   Wong, Tien Tsin ^b  

^a TIANJIN UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Cubic panoramas; Temporal smoothness; Triangle to triangle homography based warping; Video viewing mode; Virtual navigation

Indexed keywords

NAVIGATION SYSTEMS; ONLINE SYSTEMS; VIDEO RECORDING;

CUBIC PANORAMAS; HOMOGRAPHIES; TEMPORAL SMOOTHNESS; VIDEO-VIEWING MODE; VIRTUAL NAVIGATION;

INTERPOLATION;

EID: 84888372577     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2013.2280249     Document Type: Article

References (35)

1. D. Anguelov, C. Dulong, D. Filip, C. Frueh, S. Lafon, R. Lyon, A. Ogale, L. Vincent, and J. Weaver, "Google street view: Capturing the world at street level," Computer, vol. 43, no. 6, pp. 32-38, 2010.
2. M. Corporation, Bing maps driving directions, traffic and road conditions [Online]. Available: http://www.bing.com/maps/explore.
3. S. E. Chen, "Quicktime vr-an image-based approach to virtual environment navigation," in Proc. Siggraph, Aug. 1995, pp. 29-38.
4. X. Guan, L. K. Shark, G. Hall, and W. Deng, "Distortion correction for immersive navigation in spherical image environment," in Proc. Int. Conf. Cyber Worlds, 2009, pp. 96-101.
5. L. McMillan and G. Bishop, "Plenoptic modeling: An image based rendering system," in Proc. Siggraph, Aug. 1995, pp. 39-46.
6. Y.-F. Chan, M.-H. Fok, C.-W. Fu, P.-A. Heng, and T.-T. Wong, "A panoramic-based walkthrough system using real photos," in Proc. 7th Pacific Conf. Computer Graphics and Applicat. (PG), 1999, pp. 231-240.
7. K. H. Yeung, "Panorama interpolation for novel view composition," Master's thesis, Univ. Hong Kong, Hong Kong, China, 2000.
8. D.-H kim and J.-S choi, "View transition algorithmfor the walkthrough on the panorama based navigation," in Proc. Asian Conf. Computer Vision (ACCV), 2004, pp. 1109-1114.
9. F. Shi, R. Laganiere, E. Dubois, and F. Labrosse, "On the use of raytracing for viewpoint interpolation in panoramic imagery," in Proc. Canadian Conf. Computer and Robot Vision (CRV), May 2009, pp. 200-207.
10. C. Zhang, Y. Zhao, and F. Wu, "Triangulation of cubic panorama for view synthesis," Appl. Optics, vol. 50, no. 22, pp. 4286-4294, Aug. 2011.
11. C.-W. Fu, T.-T. Wong, and P.-A. Heng, "Computing visibility for triangulated panoramas," in Proc. Eurographics Rendering Workshop, 1999, pp. 169-182.
12. W. Chen, W. Xu, Z. Xiong, and M. Zhang, "View synthesis for realistic virtual walk through based on omni-directional images," Int. J. Virtual Reality, vol. 8, pp. 87-92, 2009.
13. S. Kolhatkar and R. Laganière, "Real-time virtual viewpoint generation on the GPU for scene navigation," in Proc. Canadian Conf. Computer and Robot Vision (CRV), 2010, pp. 55-62.
14. A. Siu and R. Lau, "Image registration for image-based rendering," IEEE Trans. Image Process., vol. 14, no. 2, pp. 241-252, 2005. (Pubitemid 40181982)
15. S. E. Chen and L. Williams, "View interpolation for image synthesis," in Proc. 20th Annu. Conf. Computer graphics and Interactive Techniques (Siggraph '93), 1993, pp. 279-288.
16. C. L. Zitnick and S. B. Kang, "Stereo for image-based rendering using image over-segmentation," Int. J. Comput. Vision, vol. 75, no. 1, pp. 49-65, 2007. (Pubitemid 47120245)
17. M. Goesele, J. Ackermann, S. Fuhrmann, C. Haubold, R. Klowsky, D. Steedly, and R. Szeliski, "Ambient point clouds for view interpolation," in ACM SIGGRAPH 2010 papers, 2010, pp. 95:1-95:6.
18. S. M. Seitz and C. R. Dyer, "View morphing," in Proc. 23rd Annu. Conf. Computer Graphics and Interactive Techniques (Siggraph '96), 1996, pp. 21-30.
19. Y. Wexler and A. Shashua, "On the synthesis of dynamic scenes from reference views," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2000, vol. 1, pp. 576-581.
20. R. Manning and C. Dyer, "Interpolating view and scene motion by dynamic view morphing," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 1999, vol. 1, pp. 388-394.
21. J. Xiao, C. Rao, and M. Shah, "View interpolation for dynamic scenes," in Proc. Euro Graphics, 2002, pp. 153-162.
22. M. Lhuillier and L. Quan, "Image interpolation by joint view triangulation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 1999, pp. 139-145.
23. A. M. K. Siu and R. W. H. Lau, "Relief occlusion-adaptive meshes for 3d imaging," in Proc. IEEE Int. Conf. Multimedia and Expo (ICME), 2003, pp. 101-104.
24. M. J. Tsai, C. L. Kao, and J. Liu, "The gentle spherical panorama image construction for the web navigation system," in Proc. Int. Conf. Acoustics Speech and Signal Processing (ICASSP), 2010, pp. 1578-1581.
25. B. Chen, B. Neubert, E. Ofek, O. Deussen, and M. F. Cohen, "Integrated videos and maps for driving directions," in Proc. 22nd Annu. ACM symp. User interface Software and Technol. (UIST), 2009, pp. 223-232.
26. C. Peng, B.-Y. Chen, and C.-H. Tsai, "Integrated Google maps and smooth street view videos for route planning," in Proc. 2010 Int. Computer Symp. (ICS), Dec. 2010, pp. 319-324.
27. J. Lim, N. Barnes, and H. Li, "Estimating relative camera motion from the antipodal-epipolar constraint," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 10, pp. 1907-1914, Oct. 2010.
28. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, Nov. 2004.
29. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. New York, NY, USA: Cambridge Univ. Press, 2003.
30. M. A. Fischler and R. C. Bolles, "Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
31. M. Domin, S. Langner, N. Hosten, and L. Linsen, "Direct glyph-based visualization of diffusion MR data using deformed spheres," Visualiz. Med. Life Sci., pp. 185-204, 2008.
32. Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, "Image quality assessment: from error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
33. H. Bay, T. Tuytelaars, and L. Gool, "Surf: Speeded up robust features," in Proc. Eur. Conf. Computer Vision (ECCV), 2006, vol. 3951, pp. 404-417.
34. S. Leutenegger, M. Chli, and R. Siegwart, "Brisk: Binary robust invariant scalable keypoints," in Proc. IEEE Int. Conf. Computer Vision (ICCV), Nov. 2011, pp. 2548-2555.
35. B. Fan, F. Wu, and Z. Hu, "Line matching leveraged by point correspondences," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), Jun. 2010, pp. 390-397.