JumpCut: Non-successive mask transfer and interpolation for video cutout

ACM Transactions on Graphics

Volumn 34, Issue 6, 2015, Pages

  Fan, Qingnan ^a   Zhong, Fan ^a   Lischinski, Dani ^b   Cohen Or, Daniel ^c   Chen, Baoquan ^a  

^a SHANDONG UNIVERSITY   (China)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^c TEL AVIV UNIVERSITY   (Israel)

Author keywords

Foreground extraction; Object cutout; Video segmentation

Indexed keywords

IMAGE SEGMENTATION; INTERPOLATION; PIXELS;

FOREGROUND EXTRACTION; FOREGROUND REGIONS; INTERACTIVE VIDEO; INTERPOLATION METHOD; NEAREST NEIGHBORS; OBJECT CUTOUT; STATE OF THE ART; VIDEO SEGMENTATION;

NUMERICAL METHODS;

EID: 84996533970     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2816795.2818105     Document Type: Article

References (30)

1. AGARWALA, A., HERTZMANN, A., SALESIN, D. H., AND SEITZ, S. M. 2004. Keyframe-based tracking for rotoscoping and animation. ACM Trans. Graph. 23, 3 (Aug.), 584-591.
2. BAI, X., WANG, J., SIMONS, D., AND SAPIRO, G. 2009. Video Snap Cut: Robust video object cutout using localized classifiers. ACM Trans. Graph. 28, 3 (July), 70:1-11.
3. BAI, X., WANG, J., AND SAPIRO, G. 2010. Dynamic color flow: A motion-adaptive color model for object segmentation in video. In Proc. ECCV, Springer-Verlag, vol. V, 617-630.
4. BAO, L., YANG, Q., AND JIN, H. 2014. Fast edge-preserving patchmatch for large displacement optical flow. IEEE Trans. Image Processing 23, 12 (Dec.), 4996-5006.
5. BARNES, C., SHECHTMAN, E., FINKELSTEIN, A., AND GOLDMAN, D. 2009. Patch Match: A randomized correspondence algorithm for structural image editing. ACM Trans. Graph 28, 3, 24.
6. BAY, H., ESS, A., TUYTELAARS, T., AND VAN GOOL, L. 2008. Speeded-up robust features (SURF). Computer Vision and Image Understanding 110, 3, 346-359.
7. BROX, T., BRUHN, A., PAPENBERG, N., AND WEICKERT, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Proc. ECCV'04. Springer, 25-36.
8. CASELLES, V., KIMMEL, R., AND SAPIRO, G. 1997. Geodesic active contours. Intl. J. Comp. Vision 22, 1, 61-79.
9. CHEN, Z., JIN, H., LIN, Z., COHEN, S., AND WU, Y. 2013. Large displacement optical flow from nearest neighbor fields. In Proc. CVPR'13, 2443-2450.
10. CHUANG, Y.-Y., CURLESS, B., SALESIN, D. H., AND SZELISKI, R. 2001. A bayesian approach to digital matting. In Proc. CVPR 2001, IEEE Computer Society, vol. 2, 264-271.
11. CHUANG, Y.-Y., AGARWALA, A., CURLESS, B., SALESIN, D. H., AND SZELISKI, R. 2002. Video matting of complex scenes. ACM Trans. Graph. 21, 3 (July), 243-248.
12. CREMERS, D., ROUSSON, M., AND DERICHE, R. 2007. A review of statistical approaches to level set segmentation: Integrating color, texture, motion and shape. Intl. J. Comp. Vision 72, 2, 195-215.
13. DOLLÁR, P., AND ZITNICK, C. L. 2013. Structured forests for fast edge detection. In Proc. ICCV, IEEE, 1841-1848.
14. FAKTOR, A., AND IRANI, M. 2014. Video segmentation by nonlocal consensus voting. In Proc. BMVC 2014.
15. LI, Y., SUN, J., AND SHUM, H.-Y. 2005. Video object cut and paste. ACM Trans. Graph. 24, 3 (July), 595-600.
16. LING, H., AND JACOBS, D. W. 2007. Shape classification using the inner-distance. IEEE Trans. PAMI 29, 2, 286-299.
17. LIU, Y., AND YU, Y. 2012. Interactive image segmentation based on level sets of probabilities. IEEE Trans. Vis. Comp. Graphics 18, 2 (Feb), 202-213.
18. MUJA, M., AND LOWE, D. G. 2009. Fast approximate nearest neighbors with automatic algorithm configuration. In International Conference on Computer Vision Theory and Applications (VISAPP'09).
19. OSHER, S. J., AND FEDKIW, R. P. 2003. Level Set Methods and Dynamic Implicit Surfaces, 1st ed. Springer-Verlag.
20. PRICE, B., MORSE, B., AND COHEN, S. 2009. LIVEcut: Learning-based interactive video segmentation by evaluation of multiple propagated cues. In Proc. ICCV, 779-786.
21. RAMAKANTH, S. A., AND BABU, R. V. 2014. Seam Seg: Video object segmentation using patch seams. In Proc. CVPR'14.
22. RUBIN, E. 2001. Figure and ground. In Visual Perception, S. Yantis, Ed. Psychology Press, Philadelphia, 225-229.
23. SCHAEFER, S., MCPHAIL, T., AND WARREN, J. 2006. Image deformation using moving least squares. ACM Trans. Graph. 25, 3, 533-540.
24. SMITH, A. R., AND BLINN, J. F. 1996. Blue screen matting. In Proc. SIGGRAPH '96, ACM, 259-268.
25. TONG, R.-F., ZHANG, Y., AND DING, M. 2011. Video brush: A novel interface for efficient video cutout. Computer Graphics Forum 30, 7, 2049-2057.
26. TSAI, D., FLAGG, M., AND REHG, J. M. 2010. Motion coherent tracking with multi-label MRF optimization. In Proc. BMVC.
27. WANG, J., BHAT, P., COLBURN, R. A., AGRAWALA, M., AND COHEN, M. F. 2005. Interactive video cutout. ACM Trans. Graph. 24, 3 (July), 585-594.
28. WANG, T., HAN, B., AND COLLOMOSSE, J. 2014. Touch Cut: Fast image and video segmentation using single-touch interaction. Comp. Vis. Im. Understanding 120, 14-30.
29. WEINZAEPFEL, P., REVAUD, J., HARCHAOUI, Z., AND SCHMID, C. 2013. Deep Flow: Large displacement optical flow with deep matching. In Proc. ICCV, IEEE, 1385-1392.
30. ZHONG, F., QIN, X., PENG, Q., AND MENG, X. 2012. Discontinuity-aware video object cutout. ACM Trans. Graph. (SIGGRAPH Asia 2012) 31, 6 (November), 175:1-10.