TouchCut: Fast image and video segmentation using single-touch interaction

Computer Vision and Image Understanding

Volumn 120, Issue , 2014, Pages 14-30

  Wang, Tinghuai ^a   Han, Bo ^b   Collomosse, John ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

^b Sony China Research Lab   (China)

Author keywords

Image and video segmentation; Level set methods; Object cut out; Touch interaction

Indexed keywords

EID: 84894040119     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2013.10.013     Document Type: Article

References (72)

1. C. Primo, A. Hernandez, S. Escalera, Automatic user interaction correction via multi-label graph cuts, in: Proceedings of the ICCV Workshop on HCI in Computer Vision, 2011.
2. P. Mehrani, O. Veksler, Saliency segmentation based on learning and graph cut refinement, in: Proceedings of the BMVC, 2010, pp. 110.1-110.12.
3. M. Gleicher, Image snapping, in: Proceedings of the SIGGRAPH, ACM, 1995, pp. 183-190.
4. A. Blake, C. Rother, M. Brown, P. Perez, P. Torr, Interactive image segmentation using an adaptive GMMRF model, in: Proceedings of the ECCV, 2004, pp. 428-441.
5. J. Wang, M. Agrawala, M.F. Cohen, Soft scissors: an interactive tool for realtime high quality matting, in: Proceedings of the SIGGRAPH, ACM, 2007, pp. 585-594.
6. Y. Boykov, M.-P. Jolly, Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images, in: Proceedings of the ICCV, 2001, pp. 105-112. (Pubitemid 32794944)
7. L. Grady Random walks for image segmentation IEEE Transactions on Pattern Analysis and Machine Intelligence 2006 1768 1783 (Pubitemid 46405425)
8. X. Bai, G. Sapiro, A Geodesic framework for fast interactive image and video segmentation and matting, in: Proceedings of the ICCV, 2007, pp. 1-8.
9. C. Rother, V. Kolmogorov, A. Blake, Grabcut - interactive foreground extraction using iterated graph cuts, in: Proceedings of the SIGGRAPH, ACM, 2004.
10. V. Lempitsky, P. Kohli, C. Rother, T. Sharp, Image segmentation with a bounding box prior, in: Proceedings of the ICCV, 2009, pp. 277-284.
11. H. Zhao, T. Chan, B. Merriman, and S. Osher A variational level set approach to multiphase motion Journal of Computational Physics 1996 179 195 (Pubitemid 126162336)
12. N. Paragios, and R. Deriche Geodesic active regions: a new paradigm to deal with frame partition problems in computer vision Journal of Visual Communication and Image Representation 2002 249 268 (Pubitemid 34278494)
13. H. Lombaert, Y. Sun, L. Grady, C. Xu, A multilevel banded graph cuts method for fast image segmentation, in: Proceedings of the ICCV, 2005, pp. 259-265. (Pubitemid 44054967)
14. D. Singaraju, L. Grady, R. Vidal, P-brush: Continuous valued MRFs with normed pairwise distributions for image segmentation, in: Proceedings of the CVPR, 2009, pp. 1303-1310.
15. T.H. Kim, K.M. Lee, S.U. Lee, Nonparametric higher-order learning for interactive segmentation, in: Proceedings of the CVPR, 2010, pp. 3201-3208.
16. A. Protiere, and G. Sapiro Interactive image segmentation via adaptive weighted distances IEEE Transactions on Image Processing 16 2007 1046 1057 (Pubitemid 46542392)
17. D. Mumford, J. Shah, Boundary detection by minimizing functionals, in: Proceedings of the CVPR, IEEE, 1985, pp. 22-26.
18. S. Zhu, and A. Yuille Region competition: unifying snakes, region growing, and Bayes/MDL for multiband image segmentation IEEE Transactions on Pattern Analysis and Machine Intelligence 1996 884 900 (Pubitemid 126772831)
19. V. Caselles, R. Kimmel, G. Sapiro, Geodesic active contours, in: Proceedings of the ICCV, 1995, pp. 694-699.
20. S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum, A. Yezzi, Gradient flows and geometric active contour models, in: Proceedings of the ICCV, 1995, pp. 810-815.
21. N. Paragios, R. Deriche, A PDE-based level-set approach for detection and tracking of moving objects, in: Proceedings of the ICCV, 1998, pp. 1139-1145.
22. T. Chan, and L. Vese Active contours without edges IEEE Transactions on Image Processing 2001 266 277 (Pubitemid 32254596)
23. M. Heiler, C. Schnoerr, Natural image statistics for natural image segmentation, in: IJCV, 2003, pp. 1259-1266.
24. A. Herbulot, S. Jehan-Besson, M. Barlaud, G. Aubert, Shape gradient for image segmentation using information theory, in: Proceedings of the ICASSP, 2004, pp. 17-21.
25. J. Kim, J.W. Fisher, A. Yezzi, M. Cetin, and A.S. Willsky A nonparametric statistical method for image segmentation using information theory and curve evolution IEEE Transactions on Image Processing 14 2005 1486 1502 (Pubitemid 41623080)
26. T. Brox, and J. Weickert Level set segmentation with multiple regions IEEE Transactions on Image Processing 15 10 2006 3213 3218 (Pubitemid 44473660)
27. T. Brox, D. Cremers, On the statistical interpretation of the piecewise smooth Mumford-Shah functional, in: Proceedings of the SSVM, 2007, pp. 203-213. (Pubitemid 350269796)
28. S. Lankton, and A. Tannenbaum Localizing region-based active contours IEEE Transactions on Image Processing 2008 2029 2039
29. C. Li, C. Kao, J.C. Gore, and Z. Ding Minimization of region-scalable fitting energy for image segmentation IEEE Transactions on Image Processing 17 10 2008 1940 1949
30. M. Rousson, and N. Paragios Shape priors for level set representations Proceedings of the ECCV 2002 Springer 78 92
31. N. Paragios, M. Rousson, V. Ramesh, Matching distance functions: a shape-to-area variational approach for global-to-local registration, in: ECCV, 2002, pp. 775-789.
32. D. Cremers, N.A. Sochen, C. Schnörr, Towards recognition-based variational segmentation using shape priors and dynamic labeling, in: Scale-Space, 2003, pp. 388-400.
33. X. Bresson, P. Vandergheynst, J. Thiran, A priori information in image segmentation: energy functional based on shape statistical model and image information, in: Proceedings of the ICIP, 2003, pp. 425-428.
34. A. Tsai, A.J. Yezzi, W.M. W III, C.M. Tempany, D. Tucker, A.C. Fan, W.E. Grimson, A.S. Willsky, A shape-based approach to the segmentation of medical imagery using level sets, IEEE Transactions on Medical Imaging 22(2) (2003) 137-154.
35. M. Rousson, D. Cremers, Efficient kernel density estimation of shape and intensity priors for level set segmentation, in: MICCAI, 2005, pp. 757-764. (Pubitemid 43828433)
36. D. Cremers Dynamical statistical shape priors for level set-based tracking IEEE Transactions on Pattern Analysis and Machine Intelligence 28 8 2006 1262 1273 (Pubitemid 46405024)
37. D. Cremers, F.R. Schmidt, F. Barthel, Shape priors in variational image segmentation: convexity, Lipschitz continuity and globally optimal solutions, in: Proceedings of the CVPR, 2008.
38. N. Paragios, User-aided boundary delineation through the propagation of implicit representations, in: MICCAI, vol. 2, 2003, pp. 678-686.
39. S. Dambreville, M. Niethammer, A. Yezzi, A. Tannenbaum, A variational framework combining level-sets and thresholding, in: Proceedings of the British Machine Vision Conference (BMVC), 2007, pp. 1-10.
40. J. Jackson, A. Yezzi, S. Soatto, Joint priors for variational shape and appearance modeling, in: Proceedings of the CVPR, 2007, pp. 1-10.
41. D. Cremers, M. Rousson, and R. Deriche A review of statistical approaches to level set segmentation: integrating color, texture, motion and shape International Journal of Computer Vision 72 2 2007 195 215 (Pubitemid 46094760)
42. O. Veksler, Star shape prior for graph-cut image segmentation, in: ECCV, ECCV '08, Springer-Verlag, Berlin/Heidelberg, 2008, pp. 454-467, http://dx.doi.org/10.1007/978-3-540-88690-7-34 (ISBN 978-3-540-88689-1).
43. V. Gulshan, C. Rother, A. Criminisi, A. Blake, A. Zisserman, Geodesic star convexity for interactive image segmentation, in: Proceedings of the CVPR, 2010, pp. 3129-3136.
44. R. Duda, and P. Hart Pattern Classification and Scene Analysis 1973 Wiley
45. J. Canny A computational approach to edge detection IEEE Transaction on Pattern Analysis and Machine Intelligence 8 6 1986 679 698
46. D.R. Martin, C. Fowlkes, and J. Malik Learning to detect natural image boundaries using local brightness, color, and texture cues IEEE Transaction on Pattern Analysis and Machine Intelligence 26 5 2004 530 549
47. P. Dollar, Supervised learning of edges and object boundaries, in: Proceedings of the CVPR, 2006, pp. 1964-1971. (Pubitemid 44931556)
48. Y. Deng, and B.S. Manjunath Unsupervised segmentation of color-texture regions in images and video IEEE Transaction on Pattern Analysis and Machine Intelligence 2001 1139 1145
49. T. Lin, Automatic video scene extraction by shot grouping, in: Proceedings of the ICPR, 2000, pp. 39-42.
50. L. Wang, B. Zeng, S. Lin, G. Xu, H.-Y. Shum, Automatic extraction of semantic colors in sports video, in: Proceedings of the ICASSP, 2004, pp. 617-620.
51. Y. Deng, C. Kenney, M. Moore, B.S. Manjunath, Peer group filtering and perceptual color image quantization, in: Proceedings of the ISCAS, 1999, pp. 21-24.
52. Y. Deng, and B.S. Manjunath Unsupervised segmentation of color-texture regions in images and video IEEE Transaction on Pattern Analysis and Machine Intelligence 23 8 2001 800 810 (Pubitemid 32780009)
53. D. Comaniciu, and P. Meer Mean shift: a robust approach toward feature space analysis IEEE Transaction on Pattern Analysis and Machine Intelligence 24 2002 603 619 (Pubitemid 34550429)
54. A. Agarwala, A. Hertzmann, D. Salesin, S. Seitz, Keyframe-based tracking for rotoscoping and animation, in: Proceedings of the SIGGRAPH, 2004, pp. 584-591.
55. B. Price, B. Morse, S. Cohen, Learning-based interactive video segmentation by evaluation of multiple propogated cues, in: Proceedings of the ICCV, 2009.
56. Y. Li, J. Sun, H.-Y. Shum, Video object cut and paste, in: Proceedings of the SIGGRAPH, 2005, pp. 595-600.
57. J. Wang, P. Bhat, A. Colburn, M. Agrawala, M.F. Cohen, Interactive video cutout, in: Proceedings of the SIGGRAPH, 2005, pp. 585-594.
58. C. Armstrong, B. Price, and W. Barrett Interactive segmentation of image volumes with live surface Computers & Graphics 31 2 2007 212 229 (Pubitemid 46517644)
59. X. Bai, J. Wang, D. Simons, G. Sapiro, Video SnapCut: robust video object cutout using localized classifiers, in: Proceedings of the SIGGRAPH, 2009, pp. 1-11.
60. X. Bai, J. Wang, G. Sapiro, Dynamic color flow: a motion-adaptive color model for object segmentation in video, in: Proceedings of the ECCV, 2010, pp. 617-630.
61. T. Wang, J.-Y. Guillemaut, J.P. Collomosse, Multi-label propagation for coherent video segmentation and artistic stylization, in: Proceedings of the ICIP, 2010, pp. 3005-3008.
62. T. Wang, J.P. Collomosse, R. Hu, D. Slatter, D. Greig, and P. Cheatle Stylized ambient displays of digital media collections Computers & Graphics 35 1 2011 54 66
63. C. Li, C. Xu, C. Gui, M.D. Fox, Level set evolution without re-initialization: a new variational formulation, in: Proceedings of the CVPR, IEEE, 2005, pp. 430-436.
64. D. Adalsteinsson, and J. Sethian A fast level set method for propagating interfaces Journal of Computational Physics 1995 269 277
65. D. Martin, C. Fowlkes, D. Tal, J. Malik, A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics, in: Proceedings of the ICCV, 2001, pp. 416-423. (Pubitemid 32795086)
66. M. Everingham, L.J.V. Gool, C.K.I. Williams, J.M. Winn, and A. Zisserman The pascal visual object classes (VOC) challenge International Journal of Computer Vision 88 2 2010 303 338
67. M. Shugrina, M. Betke, J. Collomosse, Empathic painting: interactive stylization using observed emotional state, in: Proceedings of the NPAR, 2006, pp. 87-96. (Pubitemid 44059876)
68. P. Chockalingam, S.N. Pradeep, S. Birchfield, Adaptive fragments-based tracking of non-rigid objects using level sets, in: Proceedings of the ICCV, 2009, pp. 1530-1537.
69. D. Tsai, M. Flagg, J. Rehg, Motion Coherent Tracking with Multi-label MRF optimization, in: Proceedings of the BMVC, 2010, pp. 56.1-56.11.
70. J.-E. Kyprianidis, J. Döllner, Image abstraction by structure adaptive filtering, in: Proceedings of the EG UK Theory and Practice of Computer Graphics, 2008, pp. 51-58.
71. J. Collomosse, D. Rowntree, and P.M. Hall Stroke surfaces: temporally coherent artistic animations from video IEEE Transactions on Visual Computational Graphics 11 5 2005 540 549 (Pubitemid 46547545)
72. T. Wang, J.P. Collomosse, D. Slatter, P. Cheatle, D. Greig, Video stylization for digital ambient displays of home movies, in: Proceedings of the NPAR, 2010, pp. 137-146.