Practical temporal consistency for image-based graphics applications

ACM Transactions on Graphics

Volumn 31, Issue 4, 2012, Pages

  Lang, Manuel ^a,b   Wang, Oliver ^a   Aydin, Tunc ^a   Smolic, Aljoscha ^a   Gross, Markus ^a,b  

^a DISNEY RESEARCH   (United States)

^b ETH ZURICH   (Switzerland)

Author keywords

Filtering; Optical flow; Regularization; Temporal coherence; Video

Indexed keywords

COMPUTATIONAL BURDEN; DISPARITY ESTIMATIONS; EFFICIENCY GAIN; FILTERING OPERATIONS; IMAGE-BASED; ITERATIVE APPROACH; ITERATIVE JOINTS; MEMORY REQUIREMENTS; MOTION PATH; REGULARIZATION; RUNNING TIME; SIMPLE METHOD; SPARSE DATA; TEMPORAL COHERENCE; TEMPORAL CONSISTENCY; VIDEO; VIDEO DATA; VISUAL SALIENCY;

COMPUTER GRAPHICS; DIGITAL STORAGE; FILTRATION; OPTICAL FLOWS;

ITERATIVE METHODS;

EID: 84872228034     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2185520.2185530     Document Type: Article

References (29)

1. BAKER, S., SCHARSTEIN, D., LEWIS, J. P., ROTH, S., BLACK, M. J., AND SZELISKI, R. 2011. A database and evaluation methodology for optical flow. International Journal of Computer Vision 92, 1, 1-31.
2. BHAT, P., ZITNICK, C. L., COHEN, M. F., AND CURLESS, B. 2010. Gradientshop: A gradient-domain optimization framework for image and video filtering. ACM Trans. Graph. 29, 2.
3. CHEN, J., PARIS, S., AND DURAND, F. 2007. Real-time edgeaware image processing with the bilateral grid. ACM Trans. Graph. 26, 3, 103.
4. CRIMINISI, A., SHARP, T., ROTHER, C., AND PÉREZ, P. 2010. Geodesic image and video editing. ACM Trans. Graph. 29, 5, 134.
5. DOLSON, J., BAEK, J., PLAGEMANN, C., AND THRUN, S. 2010. Upsampling range data in dynamic environments. In CVPR, 1141-1148.
6. DURAND, F., AND DORSEY, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 3, 257-266.
7. GASTAL, E. S. L., AND OLIVEIRA, M. M. 2011. Domain transform for edge-aware image and video processing. ACM Trans. Graph. 30, 4, 69.
8. GUO, C., MA, Q., AND ZHANG, L. 2008. Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In CVPR, IEEE Computer Society.
9. HE, K., SUN, J., AND TANG, X. 2010. Guided image filtering. In ECCV (1), Springer, vol. 6311 of Lecture Notes in Computer Science, 1-14.
10. HÖFFKEN, M., OBERHOFF, D., AND KOLESNIK, M. 2011. Temporal prediction and spatial regularization in differential optical flow. In ACIVS, Springer, vol. 6915 of Lecture Notes in Computer Science, 576-585.
11. HORN, B. K. P., AND SCHUNCK, B. G. 1981. Determining optical flow. Artif. Intell. 17, 1-3, 185-203.
12. HOSNI, A., RHEMANN, C., BLEYER, M., AND GELAUTZ, M. 2011. Temporally consistent disparity and optical flow via efficient spatio-temporal filtering. In PSIVT (1), Springer, vol. 7087 of Lecture Notes in Computer Science, 165-177.
13. KOPF, J., COHEN, M. F., LISCHINSKI, D., AND UYTTENDAELE, M. 2007. Joint bilateral upsampling. ACM Trans. Graph. 26, 3, 96.
14. KRÄHENBÜHL, P., LANG, M., HORNUNG, A., AND GROSS, M. H. 2009. A system for retargeting of streaming video. ACM Trans. Graph. 28, 5.
15. LEVIN, A., LISCHINSKI, D., AND WEISS, Y. 2004. Colorization using optimization. ACM Trans. Graph. 23, 3, 689-694.
16. LEVIN, A., LISCHINSKI, D., AND WEISS, Y. 2006. A closed form solution to natural image matting. In CVPR (1), IEEE Computer Society, 61-68.
17. NEHAB, D., MAXIMO, A., LIMA, R. S., AND HOPPE, H. 2011. Gpu-efficient recursive filtering and summed-area tables. ACM Trans. Graph. 30, 6, 176.
18. PARIS, S., KORNPROBST, P., AND TUMBLIN, J. 2009. Bilateral Filtering. Now Publishers Inc., Hanover, MA, USA.
19. PERONA, P., AND MALIK, J. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12, 7, 629-639.
20. RHEMANN, C., HOSNI, A., BLEYER, M., ROTHER, C., AND GELAUTZ, M. 2011. Fast cost-volume filtering for visual correspondence and beyond. In CVPR, IEEE, 3017-3024.
21. SCHARSTEIN, D., AND SZELISKI, R. 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47, 1-3, 7-42.
22. SUN, D., ROTH, S., AND BLACK, M. J. 2010. Secrets of optical flow estimation and their principles. In CVPR, 2432-2439.
23. TOMASI, C., AND MANDUCHI, R. 1998. Bilateral filtering for gray and color images. In ICCV, 839-846.
24. VOLZ, S., BRUHN, A., VALGAERTS, L., AND ZIMMER, H. 2011. Modeling temporal coherence for optical flow. In Proc. 13th International Conference on Computer Vision (ICCV), IEEE Computer Society Press, Barcelona.
25. WANG, O., LANG, M., FREI, M., HORNUNG, A., SMOLIC, A., AND GROSS, M. H. 2011. Stereobrush: Interactive 2d to 3d conversion using discontinuous warps. In SBM, Eurographics Association, 47-54.
26. WILDEBOER, M. O., YENDO, T., TEHRANI, M. P., AND TANIMOTO, M. 2010. A semi-automatic multi-view depth estimation method. Proceedings of SPIE, Visual Communications and Image Processing 7744.
27. XIAO, J., CHENG, H., SAWHNEY, H. S., RAO, C., AND ISNARDI, M. A. 2006. Bilateral filtering-based optical flow estimation with occlusion detection. In ECCV (1), Springer, vol. 3951 of Lecture Notes in Computer Science, 211-224.
28. YANG, Q., YANG, R., DAVIS, J., AND NISTÉR, D. 2007. Spatialdepth super resolution for range images. In CVPR, IEEE Computer Society.
29. ZIMMER, H., BRUHN, A., AND WEICKERT, J. 2011. Optic flow in harmony. International Journal of Computer Vision 93, 3, 368-388.