Image and video matting: A survey

Foundations and Trends in Computer Graphics and Vision

Volumn 3, Issue 2, 2007, Pages 97-175

  Wang, Jue ^a   Cohen, Michael F ^b  

^a ADOBE RESEARCH   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

(E ,3E) PROCESS; BEST FIT; COLOR SAMPLING; COMPREHENSIVE REVIEW; COST ANALYSIS; FILM PRODUCTION; FOREGROUND/BACKGROUND; HIGH QUALITY (HQ); IMAGE EDITING; IMAGE MATTING; KEY TECHNIQUES; OBJECTIVE EVALUATION; PRACTICAL GUIDANCE; READERS (USER EXPERIENCE); SPECIFIC REQUIREMENTS; STILL IMAGES; VIDEO MATTING; VIDEO PROCESSING; VIDEO SEQUENCING;

CAMERAS; COST ACCOUNTING; IMAGE ENHANCEMENT; PHOTOGRAPHY; VIDEO RECORDING; WELL STIMULATION;

SURVEYS;

EID: 45849111405     PISSN: 15722740     EISSN: 15722759     Source Type: Journal    
DOI: 10.1561/0600000019     Document Type: Article

References (54)

1. A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Col burn, B. Curless, D. Salesin, and M. Cohen, "Interactive digital photomontage," in Proceedings of ACM SIGGRAPH, pp. 294-302, 2004.
2. A. Agarwala, A. Hertzmann, D. H. Salesin, and S. M. Seitz, "Keyframe-based tracking for rotoscoping and animation," in Proceedings of ACM SIGGRAPH, pp. 584-591, 2004.
3. X. Bai and G. Sapiro, "A geodesic framework for fast interactive image and video segmentation and matting," in Proceedings of IEEE ICCV, 2007.
4. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509-522, 2002.
5. M. J. Black and P. Anandan, "The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields," Computer Vision and Image Understanding, vol. 63, no. 1, pp. 75-104, 1996.
6. Y. Boykov and G. Funka-Lea, "Graph cuts and efficient n-d image segmentation," International Journal of Computer Vision, vol. 70, no. 2, pp. 109-131, 2006.
7. W. L. Briggs, V. E. Henson, and S. F. Mccormick, A Multigrid Tutorial. Philadelphia: Society for Industrial and Applied Mathematics, 2000.
8. Y.-Y. Chuang, A. Agarwala, B. Curless, D. Salesin, and R. Szeliski, "Video matting," in Proceedings of ACM SIGGRAPH, pp. 243-248, 2002.
9. Y.-Y. Chuang, B. Curless, D. H. Salesin, and R. Szeliski, "A bayesian approach to digital matting," in Proceedings of IEEE CVPR, pp. 264-271, 2001.
10. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, 2002.
11. C. CORPORATION, "Knockout user guide," 2002.
12. J. Dennis, J. Robert, and B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations. Prentice-Hall, 1983.
13. I. S. Duff, A. M. Erisman, and J. K. Reid, Direct Methods for Sparse Matrices. Oxford: Clarendon Press, 1986.
14. V. Eijkhout, "Overview of iterative linear system solver packages," Technical Report, USA, Knoxville, TN: University of Tennessee, 1998.
15. E. Eisemann and F. Durand, "Flash photography enhancement via intrinsic relighting," in Proceedings of ACM SIGGRAPH, pp. 673-678, 2004.
16. L. Grady, T. Schiwietz, S. Aharon, and R. Westermann, "Random walks for interactive alpha-matting," in Proceedings of VIIP 2005, pp. 423-429, 2005.
17. Y. Guan, W. Chen, X. Liang, Z. Ding, and Q. Peng, "Easy matting: A stroke based approach for continuous image matting," in Proceeding of Eurographics, pp. 567-576, 2006.
18. X. He and P. Niyogi, "Locality preserving projections," in Proceedings of Advances in Neural Information Processing Systems (NIPS), 2003.
19. J. Jia, J. Sun, C.-K. Tang, and H.-Y. Shum, "Drag-and-drop pasting," in Proceedings of ACM SIGGRAPH, 2006.
20. N. Joshi, W. Matusik, and S. Avidan, "Natural video matting using camera arrays," in Proceedings of ACM SIGGRAPH, pp. 779-786, 2006.
21. A. Levin, D. Lischinski, and Y. Weiss, "A closed form solution to natural image matting," in Proceedings of IEEE CVPR, pp. 228-242, 2006.
22. A. Levin, A. Rav-Acha, and D. Lischinski, "Spectral matting," in Proceedings of IEEE CVPR, 2007.
23. A. Levin, A. Rav-Acha, and D. Lischinski, "Spectral matting," Hebrew University Technical Report, 2007.
24. Y. Li, J. Sun, C.-K. Tang, and H.-Y. Shum, "Lazy snapping," in Proceedings of ACM SIGGRAPH, pp. 303-308, 2004.
25. Y. S. Y. Li and H. Y. Shum, "Video object cut and paste," in Proceedings of ACM SIGGRAPH, pp. 595-600, 2005.
26. M. McGuire, W. Matusik, H. Pfister, J. F. Hughes, and F. Durand, "Defocus video matting," in Proceedings of ACM SIGGRAPH, pp. 567-576, 2005.
27. Y. Mishima, "Soft edge chroma-key generation based upon hexoctahedral color space," U.S. Patent 5,355,174, 1993.
28. G. Petschnigg, M. Agrawala, H. Hoppe, R. Szeliski, and M. Cohen, "Digital photography with flash and no-flash image pairs," in Proceedings of ACM SIGGRAPH, pp. 664-672, 2004.
29. T. Porter and T. Duff, "Compositing digital images," in Proceedings of ACM SIGGRAPH, pp. 253-259, July 1984.
30. R. Raskar, K. Tan, R. Feris, J. Yu, and M. Turk, "Non-photorealistic camera: Depth edge detection and stylized rendering using multi-flash imaging," in Proceedings of ACM SIGGRAPH, pp. 673-678, 2004.
31. C. Rhemann, C. Rother, A. Rav-Acha, and T. Sharp, "High resolution matting via interactive trimap segmentation," in Proceedings of IEEE CVPR, 2008.
32. C Rother, V. Kolmogorov, and A. Blake, "Grabcut - Interactive foreground extraction using iterated graph cut," in Proceedings of ACM SIGGRAPH, pp. 309-314, 2004.
33. C. Rother, V. Kolmogorov, and A. Blake, "Image blending," Tech. Rep., European Patent EP1748389, 2007.
34. M. A. Ruzon and C. Tomasi, "Alpha estimation in natural images," in Proceedings of IEEE CVPR, pp. 18-25, 2000.
35. Y. Saad, Iterative methods for sparse linear systems. SIAM, 2003.
36. H. Y. Shum, J. Sun, S. Yamazaki, Y. Li, and C. Tang, "Pop-up light field: An interactive image-based modeling and rendering system," in A CM Transactions on Graphics, vol. 23, pp. 143-162, 2004.
37. A. R. Smith and J. F. Blinn, "Blue screen matting," in Proceedings of ACM SIGGRAPH, pp. 259-268, 1996.
38. J. Sun, J. Jia, C.-K. Tang, and H.-Y. Shum, "Poisson matting," in Proceedings of ACM SIGGRAPH, pp. 315-321, 2004.
39. J. Sun, Y. Li, S.-B. Kang, and H.-Y. Shum, "Flash matting," in Proceedings of ACM SIGGRAPH, pp. 772-778, 2006.
40. R. Szeliski, "Fast surface interpolation using hierarchical basis functions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, no. 6, pp. 513-528, 1990.
41. R. Szeliski, "Locally adapted hierarchical basis preconditioning," in Proceedings of ACM SIGGRAPH, pp. 1135-1143, 2006.
42. R. Szeliski and H. Y. Shum, "Creating full view panoramic mosaics and environment maps," in Proceedings of ACM SIGGRAPH, pp. 251-258, 1997.
43. J. K. Udupa, and S. Samarasekera, "Fuzzy connectedness and object definition: Theory, algorithms, and applications in image segmentation," Graphical Models and Image Processing, vol. 58, pp. 246-261, 1996.
44. P. Villegas and X. Marichal, "Perceptually-weighted evaluation criteria for segmentation masks in video sequences," in IEEE Transactions on Image Processing, vol. 13, pp. 1092-1103, 2004.
45. L. Vincent and P. Soille, "Watersheds in digital spaces: An efficient algorithm based on immersion simulations," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, pp. 583-598, 1991.
46. J. Wang, M. Agrawala, and M. Cohen, "Soft scissors: An interactive tool for realtime high quality matting," in Proceedings of ACM SIGGRAPH, 2007.
47. J. Wang, P. Bhat, A. Colburn, M. Agrawala, and M. Cohen, "Interactive video cutout," in Proceedings of ACM SIGGRAPH, 2005.
48. J. Wang and M. Cohen, "An iterative optimization approach for unified image segmentation and matting," in Proceedings of ICCV 2005, pp. 936-943, 2005.
49. J. Wang and M. Cohen, "Optimized color sampling for robust matting," in Proceedings of IEEE CVPR, 2007.
50. J. Wang and M. Cohen, "Simultaneous matting and compositing," in Proceedings of IEEE CVPR, 2007.
51. Y. Weiss and W. T. Freeman, "On the optimality of solutions of the max-product belief propagation algorithm in arebitrary graphs," IEEE Transactions on Information Theory, vol. 47, no. 2, pp. 303-308, 2001.
52. G. Wyszecki and W. Stiles, Color Science: Concepts and Methods, Quantitative Data and Formulae. New York, NY: John Wiley and Sons, 1982.
53. C. Yang, R. Duraiswami, N. Gumerov, and L. Davis, "Improved fast gauss transform and efficient kernel density estimation," in Proceedings of IEEE ICCV, 2003.
54. Y. Zheng, C. Kambhamettu, J. Yu, T. Bauer, and K. Steiner, "Fuzzymatte: A computationally efficient scheme for interactive matting," in Proceedings of IEEE CVPR, 2008.