Probabilistic motion diffusion of labeling priors for coherent video segmentation

IEEE Transactions on Multimedia

Volumn 14, Issue 2, 2012, Pages 389-400

  Wang, Tinghuai ^a   Collomosse, John ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Computer vision; image segmentation; image sequences

Indexed keywords

APPEARANCE MODELS; COMPARATIVE EVALUATIONS; CONSISTENCY CONSTRAINTS; CURRENT FRAME; DIFFUSION MODEL; ESTIMATION ERRORS; GRAPH CUT; HARD DECISIONS; IMAGE REGIONS; IMAGE SEQUENCE; MEAN SHIFT; MULTI-LABEL; ROBUST ALGORITHM; SPATIAL COHERENCE; STATE-OF-THE-ART METHODS; VIDEO SEGMENTATION;

COMPUTER VISION; PIXELS;

IMAGE SEGMENTATION;

EID: 84859090685     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2177078     Document Type: Article

References (44)

1. D. B. Goldman, B. Curless, S. Seitz, and D. Salesin, "Schematic storyboarding for video visualization and editing," in Proc. ACM SIGGRAPH, 2006, pp. 862-871. (Pubitemid 44481048)
2. J. Collomosse, G. McNeill, and Y. Qian, "Storyboard sketches for content based video retrieval," in Proc. ICCV, 2009.
3. M. A. Ahmed, F. Pitie, and A. Kokaram, "Extraction of non-binary blotch mattes," in Proc. Int. Conf. Image Processing (ICIP), 2009, pp. 2757-2760.
4. T.Wang, C. J. , D. Slatter, P. Cheatle, and D. Greig, "Video stylization for digital ambient displays of home movies," in Proc. ACM NPAR, Jun. 2010, pp. 137-146.
5. X. He, R. S. Zemel, and D. Ray, "Learning and incorporating top-down cues in image segmentation," in Proc. ECCV, 2006, pp. 338-351. (Pubitemid 44029790)
6. A. Rabinovich, S. Belongie, T. Lange, and J. M. Buhmann, "Model order selection and cue combination for image segmentation," in Proc. CVPR, 2006, pp. 1130-1137. (Pubitemid 44931448)
7. P. Arbelaez and L. D. Cohen, "Constrained image segmentation from hierarchical boundaries," in Proc. CVPR, 2008, pp. 1-8.
8. P. Kohli, L. Ladicky, and P. H. S. Torr, "Robust higher order potentials for enforcing label consistency," Int. J. Comput. Vis. (IJCV), 2009.
9. T. H. Kim, K. M. Lee, and S. U. Lee, "Nonparametric higher-order learning for interactive segmentation," in Proc. CVPR, 2010, pp. 3201-3208.
10. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002. (Pubitemid 34550429)
11. X. Ren and J. Malik, "Learning a classification model for segmentation," in Proc. ICCV, 2003, vol. 1, pp. 10-17.
12. Y. Boykov and M. Jolly, "Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images," in Proc. ICCV, 2001, vol. 1, pp. 105-112. (Pubitemid 32794944)
13. I. Patras, E. A. Hendriks, and R. L. Lagendijk, "Video segmentation by map labeling of watershed segments," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1553-1567, Sep. 2001.
14. S. Paris, "Edge-preserving smoothing and mean-shift segmentation of video streams," in Proc. ECCV, 2008, pp. 460-473.
15. D. Martin, C. Fowlkes, D. Tal, and J.Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," in Proc. 8th Int. Conf. Computer Vision, 2001, pp. 416-423. (Pubitemid 32795086)
16. D. Dementhon, "Spatio-temporal segmentation of video by hierarchical mean shift analysis," J. Image Vis. Comput., 2002.
17. J. Wang, B. Thiesson, Y. Xu, and M. Cohen, "Image and video segmentation by anisotropic kernel mean shift," in Proc. ECCV, 2004, pp. 238-249.
18. J. Shi and J. Malik, "Motion segmentation and tracking using normalized cuts," in Proc. ICCV, 1998, pp. 1154-1160.
19. M. Ristivojevic and J. Konrad, "Space-time image sequence analysis: Object tunnels and occlusion volumes," IEEE Trans. Image Process., vol. 15, no. 2, pp. 364-376, Feb. 2006. (Pubitemid 43126161)
20. H. Greenspan, J. Goldberger, and A. Mayer, "A probabilistic framework for spatio-temporal video representation and indexing," in Proc. ECCV, 2002, pp. 461-475.
21. M. Grundmann, V. Kwatra,M. Han, and I. Essa, "Efficient hierarchical graph based video segmentation," in Proc. CVPR, 2010.
22. F. Moscheni, S. Bhattacharjee, andM. Kunt, "Spatiotemporal segmentation based on region merging," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 9, pp. 897-915, Sep. 1998. (Pubitemid 128741354)
23. J. Collomosse, D. Rowntree, and P. Hall, "Stroke surfaces: Temporally coherent artistic animations from video," Trans. Vis. Comput. Graph., vol. 11, no. 5, pp. 540-549, Sep./Oct. 2005. (Pubitemid 46547545)
24. W. Brendel and S. Todorovic, "Video object segmentation by tracking regions," in Proc. ICCV, 2009.
25. T. Wang, J.-Y. Guillemaut, and J. Collomosse, "Multi-label propagation for coherent video segmentation and artistic stylization," in Proc. IEEE Int. Conf. Image Processing (ICIP), 2010.
26. B. Price, B. Morse, and S. Cohen, "Learning-based interactive video segmentation by evaluation of multiple propagated cues," in Proc. ICCV, 2009.
27. X. Bai, J. Wang, and G. Sapiro, "Dynamic color flow: A motion-adaptive color model for object segmentation in video," in Proc. Eur. Conf. Computer Vision (ECCV), 2010, pp. 617-630.
28. D. Hoiem, A. A. Efros, and M. Hebert, "Geometric context from a single image," in Proc. ICCV, Oct. 2005, pp. 654-661. (Pubitemid 44055018)
29. B. C. Russell, W. T. Freeman, A. A. Efros, J. Sivic, and A. Zisserman, "Using multiple segmentations to discover objects and their extent in image collections," in Proc. CVPR, 2006, pp. 1605-1614.
30. Y. J. Lee and K. Grauman, "Object-graphs for context-aware category discovery," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 2, pp. 346-358, Feb. 2012.
31. J. D. Lafferty, A. McCallum, and F. C. N. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. ICML, 2001, pp. 282-289.
32. C. Liu, J. Yuen, A. B. Torralba, J. Sivic, andW. T. Freeman, "Sift flow: Dense correspondence across different scenes," in Proc. ECCV, 2008, pp. 28-42.
33. T. Leung and J. Malik, "Representing and recognizing the visual appearance of materials using three-dimensional textons," Int. J. Comput. Vision, vol. 43, pp. 29-44, Jun. 2001. (Pubitemid 32720091)
34. M. Varma and A. Zisserman, "A statistical approach to texture classification from single images," Int. J. Comput. Vision, vol. 62, pp. 61-81, 2005.
35. J. Winn, A. Criminisi, and T. Minka, "Object categorization by learned universal visual dictionary," in Proc. Int. Conf. Computer Vision (ICCV), 2005, pp. 1800-1807. (Pubitemid 44042395)
36. J. Shotton, J. Winn, C. Rother, and A. Criminisi, "Textonboost for image understanding: Multi-class object recognition and segmentation by jointly modeling texture, layout, and context," Int. J. Comput. Vision, vol. 81, pp. 2-23, Jan. 2009.
37. C. Rother, V. Kolmogorov, and A. Blake, "Grabcut: Interactive foreground extraction using iterated graph cuts," ACM Trans. Graph., vol. 23, pp. 309-314, 2004.
38. Y. Boykov and G. Funka-Lea, "Graph cuts and efficient n-d image segmentation," Int. J. Comput. Vision, vol. 2, no. 70, pp. 109-131, 2006. (Pubitemid 44127252)
39. B. C. Russell, W. T. Freeman, A. A. Efros, J. Sivic, and A. Zisserman, "Using multiple segmentations to discover objects and their extent in image collections," in Proc. CVPR, 2006, pp. 1605-1614.
40. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001. (Pubitemid 33137959)
41. Y. Boykov and V. Kolmogorov, "An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1124-1137, Sep. 2004.
42. K. Alahari, P. Kohli, and Torr, "Reduce, reuse & recycle: Efficiently solving multi-label mrfs," in Proc. CVPR, 2008, pp. 1-8.
43. S.Khan andM. Shah, "Object based segmentation of video using color, motion and spatial information," in Proc. Computer Vision and Pattern Recognition (CVPR), 2001.
44. R. Hu, T. Wang, and J. Collomosse, "A bag of regions based approach to sketch based image retrieval," in Proc. Int. Conf. Image Processing (ICIP), 2011.