Painterly animation using video semantics and feature correspondence

NPAR Symposium on Non-Photorealistic Animation and Rendering

Volumn , Issue , 2010, Pages 73-80

  Lin, Liang ^a,b   Zeng, Kun ^a   Lv, Han ^a   Wang, Yizhou ^c   Xu, Yingqing ^d   Zhu, Song Chun ^a,e  

^a Lotus Hill Research Institute   (China)

^b SUN YAT SEN UNIVERSITY   (China)

^c PEKING UNIVERSITY   (China)

^d MICROSOFT RESEARCH ASIA   (China)

^e UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

non photorealistic rendering; painterly animation; video parsing

Indexed keywords

BRUSH STROKE; FEATURE CORRESPONDENCE; IMAGE FEATURES; INPUT VIDEOS; INTERACTIVE SYSTEM; MATERIAL PROPERTY; MULTIPLE LAYERS; NON-PHOTOREALISTIC RENDERING; OBJECT DEFORMATION; OBJECT SURFACE; OIL PAINTINGS; PAINTERLY RENDERING; SEMANTIC OBJECTS; TWO PHASIS; VIDEO CLIPS; VIDEO SEMANTICS;

BRUSHES; SEMANTICS;

ANIMATION;

EID: 77954720713     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1809939.1809948     Document Type: Conference Paper

References (30)

1. AGARWALA, A. 2002. SnakeToonz: A Semi-Automatic Approach to Creating Cel Animation from Video. Int'l Symposium on Non-Photorealistic Animation and Rendering. 139-146.
2. AGARWALA, A., HERTZMANN, A., SALESIN, D. H., And SEITZ, S. M. 2004. Keyframe-based Tracking for Rotoscoping and Animation. ACM Trans. Graphics (Proc. SIGGRAPH). 23, 3, 584-591.
3. BAI, X., WANG, J., SIMONS, D., And SAPIRO, G. 2009. Video SnapCut: Robust Video Object Cutout Using Localized Classifiers. ACM Trans. Graphics (Proc. SIGGRAPH).
4. BOOKSTEIN, L. 1989. Principal Warps: Thin-plate Splines and the Decomposition of Deformations. IEEE Trans. on Pattern Anal. and Mach. Intell. 11, 6, 567-585.
5. BOUSSEAU, A., NEYRET, F., THOLLOT, J., And SALESIN D. 2007. Video Watercolorization using Bidirectional Texture Advection. ACM Trans. Graphics (Proc. SIGGRAPH). 26, 3, 104:1-104:7.
6. BOYKOV, Y., And JOLLY, P. 2001. Fast Approximate Energy Minimization via Graph Cuts. IEEE Trans. on Pattern Anal. and Mach. Intell. 23, 11, 1222-1238.
7. BRESLAV, S., SZERSZEN, K., MARKOSIAN, L., BARLA, P., And THOLLOT, J. 2007. Dynamic 2D Patterns for Shading 3D Scenes. ACM Trans. Graphics (Proc. SIGGRAPH).
8. CHEN, H., And ZHU, S. C. 2006. A Generative Sketch Model for Human Hair Analysis and Synthesis. IEEE Trans. on Pattern Anal. and Mach. Intell. 28, 7, 1025-1040.
9. COLLOMOSSE, P. And HALL, M. 2002. Painterly rendering using image salience. Eurographics. 122-128.
10. COLLOMOSSE, P., ROWNTREE, D., And HALL, M. 2005. Stroke Surfaces: Temporally Coherent Artistic Animations from Video. IEEE Trans. on VCG. 11, 5, 540-549.
11. HAYS, J., And ESSA, I. 2004. Image and Video Based Painterly Animation. Int'l Symposium on Non-Photorealistic Animation and Rendering, 113-120.
12. HERTZMANN, A. 1998. Painterly Rendering with Curved Brush Strokes of Multiple Sizes. Proc. SIGGRAPH. 453-460.
13. HERTZMANN, A., And PERLIN, K. 2000. Painterly Rendering for Video and Interaction. Int'l Symposium on Non-Photorealistic Animation and Rendering, 7-12.
14. JONKER, R., And VOLGENANT, A. 1987. A Shortest Augmenting Path Algorithm for Dense and Sparse Linear Assignment Problems. Computing. 38, 325-340.
15. KALNINS, R. DAVIDSON, P. MARKOSIAN, L. and FINKELSTEIN, A. 2003. Coherent Stylized Silhouettes. ACM Trans. Graphics (Proc. SIGGRAPH). 22, 3, 856-861.
16. KLEIN, W., SLOAN, J., FINKELSTEIN, A., And COHEN, F. 2002. Stylized Video Cubes. ACM SIGGRAPH Symposium on Computer Animation.
17. KOLLIOPOULOS, A., WANG, J. M., And HERTZMANN, A. 2006. Segmentation-Based 3D Artistic Rendering. Proc. Eurographics Symposium on Rendering. 361-370.
18. LITWINOWICZ, P. 1997. Processing Image and Video for An Impressionist Effect. Proc. of SIGGRAPH. 407-414.
19. LOWE, D. 2004. Distinctive Image Features from Scale-Invariant Keypoints. Int'l Journal of Computer Vision. 60, 2, 91-110.
20. MATAS, J., CHUM, O., URBAN, M. And PAJDLA, T. 2002. Robust Wide Baseline Stereo from Maximally Stable Extremal Regions. Proc. British Machine Vision Conference. 384-393.
21. MEIER, B. 1996. Painterly Rendering For Animation. ACM Trans. Graphics (Proc. SIGGRAPH). 477-484.
22. NOCEDAL, J., And WRIGHT, S. J. 1999. Numerical Optimization. Springer.
23. ROWEIS, S. And SAUL, L. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science. 290, 5500, 2323-2326. (Pubitemid 32041578)
24. SANTELLA A. And DECARLO D. 2002. Abstracted painterly renderings using eye-tracking data. Int'l Symposium on Non-Photorealistic Animation and Rendering. 769-776.
25. SHOTTON, J., WINN, J., ROTHER, C., And CRIMINISI, A. 2009. TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context, International Journal of Computer Vision. 81, 1, 2-23.
26. WANG, J., XU Y., SHUM, H.Y., And COHEN, F. 2004. Video Tooning. ACM Trans. Graphics (Proc. SIGGRAPH). 23, 3, 574-583.
27. WANG, J., BHAT, P., COLBURN, R., AGARWALA M. And COHEN, M.F. 2005. Interactive Video Cutout. ACM Trans. Graphics (Proc. SIGGRAPH). 24, 3, 585-594.
28. WINNEMOLLER, H., OLSEN, S. C., And GOOCH, B. 2006. Real-Time Video Abstraction. ACM Trans. Graphics (Proc. SIGGRAPH). 25, 3, 1221-1226.
29. XU, S., Xu, Y., KANG, S. B., SALESIN, D. H., PAN, Y., AND SHUM, H.-Y. 2006. Animating Chinese Painting Through Stroke-based Decomposition. ACM Trans. Graphics. 25, 2, 239-267. (Pubitemid 44023258)
30. ZENG, K., ZHAO, M.T., And ZHU, S.C. 2009. From Image Parsing to Painterly Rendering. ACM Trans. on Graphics. 29. 1, 1-11.