Nonlinear disparity mapping for stereoscopic 3D

ACM Transactions on Graphics

Volumn 29, Issue 4, 2010, Pages

  Lang, Manuel ^a   Hornung, Alexander ^a   Wang, Oliver ^a   Poulakos, Steven ^a,b   Smolic, Aljoscha ^a   Gross, Markus ^a,b  

^a DISNEY RESEARCH   (United States)

^b ETH ZURICH   (Switzerland)

Author keywords

3D video; Depth perception; Disparity mapping; Stereoscopy; Warping

Indexed keywords

3-D DISPLAYS; 3D CONTENT; 3D VIDEO; 3D VIEWING; CAMERA CALIBRATION; CONTENT CREATION; DENSE DEPTH MAP; DISPARITY MAPPING; GROUND TRUTH; IMAGE-BASED; INPAINTING; INPUT VIDEOS; MAPPING OPERATORS; NEW STRATEGY; OCCLUSION HANDLING; PERCEPTUAL ASPECTS; POST-PRODUCTION; PRACTICAL SOLUTIONS; REMAPPING; SPARSE SET; STEREO CORRESPONDENCES; STEREOSCOPIC IMAGE; STEREOSCOPY; USER STUDY; WARPING;

DEPTH PERCEPTION; MAPPING; MATHEMATICAL OPERATORS; THREE DIMENSIONAL; WEAVING;

STEREO VISION;

EID: 77956399846     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1778765.1778812     Document Type: Article

References (47)

1. 3DTV. AT, 2010. Stereoscopic player, Jan. http://www.3dtv. at/.
2. AGRAWAL, A., AND RASKAR, R. 2007. Gradient domain manipulation techniques in vision and graphics. In ICCV Courses.
3. AKELEY, K., WATT, S. J., GIRSHICK, A. R., AND BANKS, M. S. 2004. A stereo display prototype with multiple focal distances. ACM Trans. Graph. 23, 3, 804-813.
4. BAKER, S., AND MATTHEWS, I. 2004. Lucas-Kanade 20 years on: A unifying framework. IJCV 56, 3, 221-255.
5. BANKS, M. S., GEPSHTEIN, S., AND LANDY, M. S. 2004. Why is spatial stereoresolution so low? Journal of Neuroscience 24, 2077-2089.
6. BLEYER, M., GELAUTZ, M., ROTHER, C., AND RHEMANN, C. 2009. A stereo approach that handles the matting problem via image warping. In CVPR, 501-508.
7. BURT, P., AND JUELSZ, B. 1980. A disparity gradient limit for binocular fusion. Science 208, 4444 (5), 615-617.
8. CARROLL, R., AGRAWALA, M., AND AGARWALA, A. 2009. Optimizing content-preserving projections for wide-angle images. ACM Trans. Graph. 28, 3.
9. CRIMINISI, A., BLAKE, A., ROTHER, C., SHOTTON, J., AND TORR, P. H. 2007. Efficient dense stereo with occlusions for new view-synthesis by four-state dynamic programming. Int. J. Comput. Vision 71, 1, 89-110.
10. CUTTING, J. E., AND VISHTON, P. M. 1995. Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth. In Handbook of perception and cognition, Perception of space and motion, W. Epstein and S. Rogers, Eds., vol. 5. Academic Press, San Diego, CA.
11. DAVID, H. A. 1963. The Method of Paired Comparisons. Charles Griffin & Company.
12. FELDMANN, I., SCHREER, O., AND KAUFF, P. 2003. Nonlinear depth scaling for immersive video applications. WIAMIS.
13. GORTLER, S. J., GRZESZCZUK, R., SZELISKI, R., AND COHEN, M. F. 1996. The lumigraph. In SIGGRAPH, 43-54.
14. GUO, C., MA, Q., AND ZHANG, L. 2008. Spatio-temporal saliency detection using phase spectrum of quaternion Fourier transform. CVPR.
15. GUTTMANN, M., WOLF, L., AND COHEN-OR, D. 2009. Semiautomatic stereo extraction from video footage. In ICCV.
16. HOFFMAN, D. M., GIRSHICK, A. R., AKELEY, K., AND BANKS, M. S. 2008. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision 8, 3 (3), 1-30.
17. HOWARD, I. P., AND ROGERS, B. J. 2002. Seeing in Depth. Oxford University Press, New York, USA.
18. KIM, M.-B., LEE, S., CHOI, C., UM, G.-M., HUR, N.-H., AND KIM, J.-W. 2008. Depth scaling of multiview images for automultiscopic 3D monitors. In 3DTV08.
19. KRÄHENBÜHL, P., LANG, M., HORNUNG, A., AND GROSS, M. 2009. A system for retargeting of streaming video. ACM Trans. Graph. 28, 5.
20. LAMBOOIJ, M., IJSSELSTEIJN, W., FORTUIN, M., AND HEYNDERICKX, I. 2009. Visual discomfort and visual fatigue of stereoscopic displays: A review. Journal of Imaging Science and Technology 53, 3, 030201.
21. LEVOY, M., AND HANRAHAN, P. 1996. Light field rendering. In SIGGRAPH, 31-42.
22. LIU, F., GLEICHER, M., JIN, H., AND AGARWALA, A. 2009. Content-preserving warps for 3D video stabilization. ACM Trans. Graph. 28, 3.
23. LOWE, D. G. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 2, 91-110.
24. MAHAJAN, D., HUANG, F.-C., MATUSIK, W., RAMAMOORTHI, R., AND BELHUMEUR, P. N. 2009. Moving gradients: a pathbased method for plausible image interpolation. ACM Trans. Graph. 28, 3.
25. MATUSIK, W., AND PFISTER, H. 2004. 3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. ACM Trans. Graph. 23, 3, 814-824.
26. MENDIBURU, B. 2009. 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen. Focal Press.
27. MOBILE 3DTV, 2010. Stereo video data-sets, Jan. http://sp. cs.tut.fi/mobile3dtv/stereo-video/.
28. NEUMAN, R., 2009. Personal Communication with Robert Neuman, Chief Stereographer, Disney Animation Studios.
29. PARIS, S., AND DURAND, F. 2006. A fast approximation of the bilateral filter using a signal processing approach. In ECCV (4), 568-580.
30. PRITCH, Y., BEN-EZRA, M., AND PELEG, S. 2000. Automatic disparity control in stereo panoramas (omnistereo). In OMNIVIS.
31. REINHARD, E., WARD, G., PATTANAIK, S., AND DEBEVEC, P. 2005. High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting. Morgan Kaufmann.
32. SATTLER, T., LEIBE, B., AND KOBBELT, L. 2009. SCRAMSAC: Improving RANSAC's efficiency with a spatial consistency filter. In ICCV.
33. SEITZ, S., AND DYER, C. 1996. View morphing. In SIGGRAPH 96, 21-30.
34. SHADE, J., GORTLER, S. J., LI-WEI, H., AND SZELISKI, R. 1998. Layered depth images. In SIGGRAPH, 231-242.
35. SHAMIR, A., AND SORKINE, O. 2009. Visual media retargeting. In SIGGRAPH ASIA Courses.
36. SIEGEL, M., AND NAGATA, S. 2000. Just enough reality: Comfortable 3-D viewing via microstereopsis. IEEE Transactions on Circuits and Systems for Video Technology 10, 3 (4), 387-396.
37. SMOLIC, A., MLLER, K., DIX, K., MERKLE, P., KAUFF, P., AND WIEGAND, T. 2008. Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems. In ICIP, IEEE, 2448-2451.
38. STELMACH, L. B., TAM, W. J., MEEGAN, D. V., AND VINCENT, A. 2000. Stereo image quality: effects of mixed spatio-temporal resolution. IEEE Transactions on Circuits and Systems for Video Technology 10, 2, 188-193.
39. SUN, G., AND HOLLIMAN, N. 2009. Evaluating methods for controlling depth perception in stereoscopic cinematography. Stereoscopic Displays and Virtual Reality Systems XX, Proceedings of SPIE 7237 (1).
40. THE FOUNDRY, 2010. Ocular, Nuke, Jan. http://www.thefoundry.co.uk/.
41. VAN DEN HENGEL, A., DICK, A. R., THORMÄHLEN, T., WARD, B., AND TORR, P. H. S. 2007. Videotrace: rapid interactive scene modelling from video. ACM Trans. Graph. 26, 3, 86.
42. WANG, C., AND SAWCHUK, A. A. 2008. Disparity manipulation for stereo images and video. SPIE, vol. 6803.
43. WANG, Z., BOVIK, A. C., SHEIKH, H. R., AND SIMONCELLI, E. P. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4, 600-612.
44. WANG, Y.-S., FU, H., SORKINE, O., LEE, T.-Y., AND SEIDEL, H.-P. 2009. Motion-aware temporal coherence for video resizing. ACM Trans. Graph. 28, 5.
45. WERLBERGER, M., TROBIN, W., POCK, T., WEDEL, A., CREMERS, D., AND BISCHOF, H. 2009. Anisotropic Huber-L1 optical flow. In British Machine Vision Conference (BMVC).
46. WEYRICH, T., DENG, J., BARNES, C., RUSINKIEWICZ, S., AND FINKELSTEIN, A. 2007. Digital bas-relief from 3D scenes. ACM Trans. Graph. 26, 3, 32.
47. ZITNICK, C. L., KANG, S. B., UYTTENDAELE, M., WINDER, S. A. J., AND SZELISKI, R. 2004. High-quality video view interpolation using a layered representation. ACM Trans. Graph. 23, 3, 600-608.