Online video stream abstraction and stylization

IEEE Transactions on Multimedia

Volumn 13, Issue 6, 2011, Pages 1286-1294

  Zhang, Song Hai ^a   Li, Xian Ying ^a   Hu, Shi Min ^a   Martin, Ralph R ^b  

^a TSINGHUA NATIONAL LABORATORY FOR INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC METHOD; COLOR SCHEMES; ERROR CONTROL; LARGE REGIONS; NOVEL COMPONENT; ONLINE VIDEO; REAL TIME PERFORMANCE; REPLACEMENT ALGORITHM; SEGMENTATION INFORMATIONS; VIDEO STREAMS;

ABSTRACTING;

VIDEO STREAMING;

EID: 82055208412     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2165052     Document Type: Article

References (43)

1. D. DeCarlo and A. Santella, "Stylization and abstraction of photographs," in Proc. 29th Annu. Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '02), 2002, pp. 769-776.
2. A. Santella and D. DeCarlo, "Visual interest and NPR: An evaluation and manifesto," in Proc. 3rd Int. Symp. Non-Photorealistic Animation and Rendering (NPAR '04), 2004, pp. 71-150.
3. J. Fischer, M. Haller, and B. Thomas, "Stylized depiction in mixed reality," Int. J. Virtual Reality, vol. 7, no. 4, pp. 71-79, 2009.
4. H.Winnemöller, S. C. Olsen, and B. Gooch, "Real-time video abstraction," ACM Trans. Graph., vol. 25, no. 3, pp. 1221-1226, 2006. (Pubitemid 44481088)
5. J. E. Kyprianidis and J. Döllner, "Image abstraction by structure adaptive filtering," in Proc. EG UK Theory and Practice of Computer Graphics, 2008, pp. 51-58.
6. H. Kang, S. Lee, and C. K. Chui, "Flow-based image abstraction," IEEE Trans. Vis. Comput. Graph., vol. 15, no. 1, pp. 62-76, Jan. 2009.
7. J. E. Kyprianidis, H. Kang, and J. Döllner, "Image and video abstraction by anisotropic Kuwahara filtering," Comput. Graph. Forum, vol. 26, no. 7, pp. 1955-1963, 2009.
8. C.-K. Yang and H.-L. Yang, "Realization of Seurat's pointillism via non-photorealistic rendering," Vis. Comput., vol. 24, no. 5, pp. 303-322, 2008.
9. W.-M. Pang, Y. Qu, T.-T. Wong, D. Cohen-Or, and P.-A. Heng, "Structure-aware halftoning," ACM Trans. Graph., vol. 27, no. 3, pp. 89:1-89:8, 2008.
10. F. Wen, Q. Luan, L. Liang, Y.-Q. Xu, and H.-Y. Shum, "Color sketch generation," in Proc. 4th Int. Symp. Non-Photorealistic Animation and Rendering (NPAR '06), 2006, pp. 47-54. (Pubitemid 44059871)
11. A. Hertzmann, "Painterly rendering with curved brush strokes of multiple sizes," in Proc. 25th Annu. Conf. Computer Graphics and Interactive (SIGGRAPH '98), 1998, pp. 453-460.
12. A. Agarwala, "Snaketoonz: A semi-automatic approach to creating cel animation from video," in Proc. 2nd Int. Symp. Non-Photorealistic Animation and Rendering (NPAR '02), 2002, vol. 163, pp. 139-146.
13. A. Agarwala, A. Hertzmann, D. H. Salesin, and S. M. Seitz, "Keyframe-based tracking for rotoscoping and animation," ACM Trans. Graph., vol. 23, no. 3, pp. 584-591, 2004.
14. J.Wang, Y. Xu, H.-Y. Shum, and M. F. Cohen, "Video tooning," ACM Trans. Graph., vol. 23, no. 3, pp. 574-583, 2004.
15. D. Dementhon, "Spatio-temporal segmentation of video by hierarchical mean shift analysis," in Proc. Statistical Methods in Video Processing Workshop (SMVP '02), 2002.
16. H. Huang, L. Zhang, and T.-N. Fu, "Video painting via motion layer manipulation," Comput. Graph. Forum, vol. 29, no. 7, pp. 2055-2064, 2010.
17. S. Paris, "Edge-preserving smoothing and mean-shift segmentation of video streams," in Proc. 10th Eur. Conf. Computer Vision (ECCV '08): Part II, 2008, pp. 460-473.
18. J. P. Collomosse, D. Rowntree, and P. M. Hall, "Stroke surfaces: Temporally coherent artistic animations from video," IEEE Trans. Vis. Comput. Graph., vol. 11, no. 5, pp. 540-549, Sep./Oct. 2005. (Pubitemid 46547545)
19. P. C. Litwinowicz, "Processing images and video for an impressionist effect," in Proc. 24th Annu. Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '97), 1997, pp. 407-414.
20. A. Hertzmann and K. Perlin, "Painterly rendering for video and interaction," in Proc. 1st Int. Symp. Non-Photorealistic Animation and Rendering (NPAR '00), 2000, pp. 7-12.
21. A. Hertzmann, "Paint by relaxation," in Proc. Computer Graphics Int. 2001, 2001, pp. 47-54. (Pubitemid 32797562)
22. L. Kovács and T. Szirányi, "Creating animations combining stochastic paintbrush transformation and motion detection," in Proc. 16th Int. Conf. Pattern Recognition (ICPR'02): Part II, 2002, pp. 1090-1093. (Pubitemid 44844926)
23. J. Hays and I. Essa, "Image and video based painterly animation," in Proc. 3rd Int. Symp. Non-Photorealistic Animation and Rendering (NPAR '04), 2004, pp. 113-120.
24. D. Vanderhaeghe, P. Barla, J. Thollot, and F. Sillion, "Dynamic point distribution for stroke-based rendering," in Proc. Eurographics Symp. Rendering, 2007, pp. 139-146.
25. A. Bousseau, F. Neyret, J. Thollot, and D. Salesin, "Video watercolorization using bidirectional texture advection," ACM Trans. Graph., vol. 26, no. 3, pp. 104:1-104:7, 2007.
26. G. R. Greenfield and D. H. House, "Image recoloring induced by palette color associations," J. Winter School Comput. Graph. (WSCG), vol. 11, pp. 189-196, 2003.
27. Y. Chang, S. Saito, and M. Nakajima, "A framework for transfer colors based on the basic color categories," in Proc. Computer Graphics Int. 2003, 2003, pp. 176-181.
28. A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D. H. Salesin, "Image analogies," in Proc. 28th Annu. Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '01), 2001, pp. 327-340. (Pubitemid 33047317)
29. E. Reinhard, M. Ashikhmin, B. Gooch, and P. Shirley, "Color transfer between images," IEEE Comput. Graph. Appl., vol. 21, no. 5, pp. 34-41, Sep./Oct. 2001. (Pubitemid 32830073)
30. H. Huang, Y. Zang, and C.-F Li, "Example-based painting guided by color features," Vis. Comput., vol. 26, no. 6-8, pp. 933-942, 2010.
31. Y.-H. H. C.-M. Wang and Y.-H. Huang, "An effective algorithm for image sequence color transfer," Math. Comput. Model., vol. 44, no. 7-8, pp. 608-627, 2006. (Pubitemid 44038176)
32. C. L. Zitnick, N. Jojic, and S. B. Kang, "Consistent segmentation for optical flowestimation," in Proc. 10th IEEE Int. Conf. Computer Vision (ICCV '05): Part II, 2005, pp. 1308-1315.
33. M. P. Kumar, P. H. S. Torr, and A. Zisserman, "Learning layered motion segmentation of video," Int. J. Comput. Vis., vol. 76, no. 3, pp. 301-319, 2008.
34. J. Xiao and M. Shah, "Motion layer extraction in the presence of occlusion using graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1644-1659, Oct. 2005. (Pubitemid 41555408)
35. S. Baker, S. Roth, D. Scharstein, M. Black, J. Lewis, and R. Szeliski, "A database and evaluation methodology for optical flow," in Proc. 11th IEEE Int. Conf. Computer Vision (ICCV '07), 2007, pp. 1-8.
36. C. Zach, T. Pock, and H. Bischof, "A duality based approach for realtime tv-l1 optical flow," in Proc. 29th DAGM Conf. Pattern Recognition, 2007, pp. 214-223.
37. S.-H. Zhang, T. Chen, Y.-F. Zhang, S.-M. Hu, and R. Martin, "Vectorizing cartoon animations," IEEE Trans. Vis. Comput. Graph., vol. 15, no. 4, pp. 618-629, Jul. 2009.
38. R. Lienhart and J. Maydt, "An extended set of Haar-like features for rapid object detection," in Proc. IEEE Int. Conf. Image Processing 2002, 2002, pp. 900-903.
39. Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," in Proc. 14th Annu. ACM Int. Conf. Multimedia (MULTIMEDIA '06), 2006, pp. 815-824. (Pubitemid 47113641)
40. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 6, pp. 679-698, Nov. 1986.
41. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002. (Pubitemid 34550429)
42. D. Cohen-Or, O. Sorkine, R. Gal, T. Leyvand, and Y.-Q. Xu, "Color harmonization," ACMTrans. Graph., vol. 25, no. 3, pp. 624-630, 2006. (Pubitemid 44481021)
43. N. Sawant and N. Mitra, "Color harmonization for videos," in Proc. 6th Indian Conf. Computer Vision, Graphics&Image Processing (ICVGIP '08), 2008, pp. 576-582.