State-of-the-art report on temporal coherence for stylized animations

Computer Graphics Forum

Volumn 30, Issue 8, 2011, Pages 2367-2386

  B́enard, Pierre ^a,b   Bousseau, Adrien ^c   Thollot, Jöelle ^a,b  

^a UNIV GRENOBLE ALPES   (France)

^b INRIA RHÔNE ALPES   (France)

^c INRIA   (France)

Author keywords

Non photorealistic rendering; Stylization; Temporal coherence

Indexed keywords

COMPUTER GRAPHICS; RENDERING (COMPUTER GRAPHICS);

COMPREHENSIVE ANALYSIS; COMPUTER GENERATED; CONTROL AND AUTOMATION; NON-PHOTOREALISTIC RENDERING; NON-PHOTOREALISTIC RENDERING ALGORITHMS; PERCEPTUAL EVALUATION; STYLIZATION; TEMPORAL COHERENCE;

ECONOMIC AND SOCIAL EFFECTS;

EID: 84874058487     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/j.1467-8659.2011.02075.x     Document Type: Article

References (89)

1. AGARWALA A., HERTZMANN A., SALESIN D-H.,-SEITZ S-M.: Keyframe-based tracking for rotoscoping-and animation-ACMTransactions on Graphics 23 (2004),-584-591.
2. AYDIN T-O., ?CAD́IK M., MYSZKOWSKI K., SEIDEL-H.P.: Video quality assessment for computer graphics-applications-ACM Transactions on Graphics 29, 6-(2010), 161:1-161:12.
3. BEAUCHEMIN S-S., BARRON J-L.: The computation-of optical flow-ACM Computing Surveys 27, 3 (1995),-433-466.
4. B́ENARD P., BOUSSEAU A., THOLLOT J.: Dynamic-solid textures for real-time coherent stylization-In Proceedings-of the 2009 ACM SIGGRAPH Symposium on Interactive-3D Graphics and Games (Boston, USA, 2009),-ACM press, pp-121-127.
5. B́ENARD P., COLE F., GOLOVINSKIY A., FINKELSTEIN-A.: Self-similar texture for coherent line stylization-In-Proceedings of the Eighth International Symposium on-Non-Photorealistic Animation and Rendering (Annecy,-France, 2010), ACM press, p-91.
6. BEZERRA H., EISEMANN E., D́ECORET X., THOLLOT-J.: 3D dynamic grouping for guided stylization-In Proceedings-of the Sixth International Symposium on Nonphotorealistic-Animation and Rendering (Annecy, France,-2008), ACM Press, pp-89-95.
7. BUCHHOLZ B., FARAJ N., PARIS S., EISEMANN E.,-BOUBEKEUR T.: Spatio-temporal analysis for parameterizing-animated lines-In Proceedings of the 10th International-Symposium on Non-Photorealistic Animation and-Rendering (Vancouver, Canada, 2011), ACM press, pp.-85-92.
8. BOUSSEAU A., KAPLAN M., THOLLOT J., SILLION F.-X.: Interactive watercolor rendering with temporal coherence-and abstraction-In Proceedings of the Third-International Symposium on Non-photorealistic Animation-and Rendering (Annecy, France, 2006), ACM Press,-p-141.
9. B́ENARD P., LAGAE A., VANGORP P., LEFEBVRE S.,-DRETTAKIS G., THOLLOT J.: A Dynamic Noise Primitive-for Coherent Stylization-Computer Graphics Forum 29,-4 (2010), 1497-1506.
10. BOUSSEAU A., NEYRET F., THOLLOT J., SALESIN D.:-Video watercolorization using bidirectional texture advection.-ACM Transactions on Graphics 26, 3 (2007),-104:1-104:7.
11. BOURDEV L.: Rendering Nonphotorealistic Strokes-with Temporal and Arc-Length Coherence-Master's thesis,-Brown University, 1998.
12. BRESLAV S., SZERSZEN K., MARKOSIAN L., BARLA-P., THOLLOT J.: Dynamic 2D patterns for shading 3D-scenes-ACM Transactions on Graphics 26, 3 (2007),-20:1-20:5.
13. B́ENARD P., THOLLOT J., SILLION F.: Quality assessment-of fractalized NPR textures: A perceptual objective-metric-In Proceedings of the Sixth Symposium on Applied-Perception in Graphics and Visualization (Chania,-Greece, 2009), ACM press, pp-117-120.
14. CURTIS C-J., ANDERSON S-E., SEIMS J-E.,-FLEISCHER K-W., SALESIN D-H.: Computer-generated watercolor.-In Proceedings of SIGGRAPH 97 (Los Angeles,-USA, 1997), ACM press, pp-421-430.
15. COLE F., DECARLO D., FINKELSTEIN A., KIN K.,-MORLEY K., SANTELLA A.: Directing Gaze in 3D Models-with Stylized Focus-In Proceedings of the 17th Eurographics-Symposium on Rendering (Nicosia, Cyprus,-2006), Eurographics Association, pp-377-387.
16. COCONU L., DEUSSEN O., HEGE H.-C.: Real-time-pen-and-ink illustration of landscapes-In Proceedings of\-The Third International Symposium on Non-photorealistic-Animation and Rendering (Annecy, France, 2006), ACM-Press, p-27.
17. COLE F., FINKELSTEIN A.: Two fast methods for highquality-line visibility-IEEE Transactions on Visualization-and Computer Graphics 16, 5 (2010), 707-717.
18. CHI M.-T., LEE T.-Y.: Stylized and abstract painterly-rendering system using a multiscale segmented sphere-hierarchy-IEEE Transactions on Visualization and Computer-Graphics 12, 1 (2006), 61-72.
19. COLLOMOSSE J-P.,ROWNTREE D.,HALL P-M.: Stroke-surfaces: Temporally coherent artistic animations from-video-IEEE Transactions on Visualization and Computer-Graphics 11, 5 (2005), 540-549.
20. CORNISH D., ROWAN A., LUEBKE D.: Viewdependent-particles for interactive non-photorealistic rendering.-In Proceedings of Graphics Interface (Ottawa,-Canada, 2001), A K Peters Ltd., pp-151-158.
21. COPELAND A-C., RAVICHANDRAN G., TRIVEDI M-M.:-Texture synthesis using gray-level co-occurrence models:-Algorithms, experimental analysis, and psychophysical-support-Optical Engineering 40, 11 (2001), 2655-2673.
22. COLE F., SANIK K., DECARLO D., FINKELSTEIN A.,-FUNKHOUSER T., RUSINKIEWICZ S., SINGH M.: How well do-line drawings depict shape? ACMTransactions on Graphics-28, 3 (2009) 28:1-28:9.
23. CUNZI M., THOLLOT J., PARIS S., DEBUNNE G.,-GASCUEL J., DURAND F.: Dynamic canvas for nonphotorealistic-walkthroughs-In Proceedings of Graphics-Interface (Halifax, Canada, 2003), A K Peters Ltd.
24. DANIELS E.: Deep canvas in Disney's Tarzan-In-Proceedings of SIGGRAPH 99 (LosAngeles, USA, 1999),-ACM Press.
25. DECARLO D., FINKELSTEIN A., RUSINKIEWICZ S.: Interactive-rendering of suggestive contours with temporal-coherence-In Proceedings of the Third International Symposium-on Non-Photorealistic Animation and Rendering-(Annecy, France, 2004), ACM press, pp-15-24.
26. DURAND F.: An invitation to discuss computer-depiction-In Proceedings of the Second International-Symposium on Non-photorealistic Animation and Rendering-(Annecy, France, 2002), ACM press, pp-111-124.
27. FREUDENBERG B., MASUCH M., STROTHOTTE T.:-Walk-through illustrations: Frame-coherent pen-and-ink-style in a game engine-Computer Graphics Forum 20, 3-(2001), 184-191.
28. FUNG J., VERYOVKA O., ARTS E.: Pen-and-ink textures-for real-time rendering-In Proceedings of Graphics-Interface (Halifax, Canada, 2003), A K Peters Ltd., pp.-131-138.
29. GRABLI S., TURQUIN E., DURAND F., SILLION F.-X.: Programmable rendering of line drawing from 3D-scenes-ACM Transactions on Graphics 29, 2 (2010),-1-20.
30. GOODWIN T., VOLLICK I., HERTZMANN A.: Isophote-distance: A shading approach to artistic stroke thickness.-In Proceedings of the Fifth International Symposium on-Non-photorealistic Animation and Rendering (San Diego,-USA, 2007), ACM Press.
31. HAYS J., ESSA I.: Image and video based painterly-animation-In Proceedings of the Third International Symposium-on Non-photorealistic Animation and Rendering-(Annecy, France,( 2004), ACM Press, p-113.
32. HERTZMANN A.: Paint by relaxation-In Proceedings-of Computer Graphics International (Hong-Kong, 2001),-IEEE Computer Society, pp-47-54.
33. HERTZMANN A., PERLIN K.: Painterly rendering for-video and interaction-In Proceedings of the First International-Symposium on Non-Photorealistic Animation-and Rendering (Annecy, France, 2000), ACM Press, pp. 7-12.
34. HAN C., RISSER E., RAMAMOORTHI R.,-GRINSPUN E.: Multiscale texture synthesis-ACM-Transactions on Graphics 27, 3 (2008), 51:1-51:8.
35. HERTZMANN A., ZORIN D.: Illustrating smooth surfaces.-In Proceedings of SIGGRAPH 2000 (New Orleans,-USA, 2000), ACM Press, pp-517-526.
36. ISENBERG T., HALPER N., STROTHOTTE T.: Stylizing-silhouettes at interactive rates: From silhouette edges-to silhouette strokes-Computer Graphics Forum 21, 3-(2002), 249-258.
37. JOHNSTON S.: Nonphotorealistic rendering with-Renderman.Morgan Kaufmann Publishers Inc., San Francisco,-USA, 1999, chap-16, pp-441-480.
38. KAGAYA M., BRENDEL W., DENG Q., KESTERSON T.,-TODOROVIC S., NEILL P-J., ZHANG E.: Video painting with-space-time-varying style parameters-IEEE Transactions-on Visualization and Computer Graphics 17, 1 (2010),-74-87.
39. KAPLAN M., COHEN E.: A generative model for dynamic-canvas motion-In Proceedings of the First Eurographics-Workshop on Computational Aesthetics in-Graphics, Visualization and Imaging (Girona, 2005 L.-NEUMANN, M-S-CASASAYAS, B-GOOCH, W-PURGATHOFER,-(Eds.), Eurographics Association, pp-49-56.
40. KOPF J., COHEN-OR D., DEUSSEN O., LISCHINSKI-D.: Recursive Wang tiles for real-time blue noise.-ACM Transactions on Graphics 25, 3 (2006),-509-518.
41. KALNINS R-D., DAVIDSON P-L., MARKOSIAN L.,-FINKELSTEIN A.: Coherent stylized silhouettes-ACMTransactions-on Graphics 22, 3(2003), 856-861.
42. KAPLAN M., GOOCH B., COHEN E.: Interactive-artistic rendering-In Proceedings of the First International-Symposium on Non-photorealistic Animation-and Rendering (Annecy, France, 2000), ACM Press, pp. 67-74.
43. KARSCH K., HART J-C.: Snaxels on a plane.-In Proceedings of the 10th International Symposium-on Non-Photorealistic Animation and Rendering- (Vancouver, Canada, 2011), ACM press, pp-35-42.
44. KYPRIANIDIS J-E., KANG H.: Image and video-abstraction by coherence-enhancing filtering-Computer-Graphics Forum 30, 2 (2011), 593-602.
45. KLEIN A-W., LI W., KAZHDAN M-M., CORREA-W-T., FINKELSTEIN A., FUNKHOUSER T-A.: Nonphotorealistic-virtual environments-In Proceedings of-SIGGRAPH 2000 (NewOrleans, USA, 2000),ACMPress, pp. 527-534.
46. KALNINS R-D., MARKOSIAN L., MEIER B-J.,-KOWALSKI M-A., LEE J-C., DAVIDSON P-L., WEBB M.,-HUGHES J-F., FINKELSTEIN A.: WYSIWYG NPR: Drawing-strokes directly on 3D models-In Proceedings of SIGGRAPH-2002 (San Antonio, USA, 2002), vol-21, ACM-Press, p-755.
47. KASS M., PESARE D.: Coherent noise for nonphotorealistic-rendering-ACM Transactions on Graphics-30 (2011), 30:1-30:6.
48. KOLLIOPOULOS A., WANG J-M., HERTZMANN A.:-Segmentation-based 3D artistic rendering-In Proceedings-of the 17th Eurographics Symposium on Rendering-(Nicosia, Cyprus, 2006), Eurographics Association, pp.-361-370.
49. KASS M.,WITKIN A., TERZOPOULOS D.: Snakes: Active-contour models-International Journal of Computer-Vision 1, 4 (1988), 321-331.
50. LAGAE A.,DUTŔE P.:Aprocedural object distribution-function-ACM Transactions on Graphics 24, 4 (2005),-1442-1461.
51. LITWINOWICZ P.: Processing images and video for an-impressionist effect-In Proceedings of SIGGRAPH 97-(Los Angeles, USA, 1997), ACM Press, pp-407-414.
52. LAGAE A., LEFEBVRE S., COOK R., DEROSE T.,-DRETTAKIS G., EBERT D., LEWIS J., PERLIN K., ZWICKER-M.: A survey of procedural noise functions-Computer- Graphics Forum 29 (2010), 2579-2600.
53. LAGAE A., LEFEBVRE S., DRETTAKIS G., DUTŔE P.:-Procedural noise using sparse Gabor convolution-ACM-Transactions on Graphics 28, 3 (2009), 54:1-54:10.
54. LEE Y., MARKOSIAN L., LEE S., HUGHES J-F.: Line-drawings via abstracted shading-ACM Transactions on-Graphics 26, (2007), 18.
55. LU J., SANDER P-V., FINKELSTEIN A.: Interactive-painterly stylization of images, videos and 3D animations.-In Proceedings of the 2010 ACM SIGGRAPH-Symposium on Interactive 3D Graphics and Games-(Washington, USA, 2010), ACM press, pp-127-134.
56. LIN L., ZENG K., LV H., WANG Y., XU Y., ZHU S.-C.: Painterly animation using video semantics and feature-correspondence-In Proceedings of the Eighth International-Symposium on Non-Photorealistic Animation and-Rendering (Annecy, France, 2010), vol-1, ACM Press, p.-73.
57. MEIER B-J.: Painterly rendering for animation.-In Proceedings of SIGGRAPH 96 (New Orleans, USA,-1996), ACM press, pp-477-484.
58. MCGUIRE M., EKANAYAKE C., ST-AMOUR J.-F., HAĹEN H., THIBAULT A., MARTEL B.: Stylized rendering-in games-In ACM SIGGRAPH 2010 Courses-(Los Angeles, USA, 2010).
59. MARKOSIAN L., KOWALSKI M-A., GOLDSTEIN D.,-TRYCHIN S-J., HUGHES J-F., BOURDEV L-D.: Realtime-nonphotorealistic rendering-In Proceedings of SIGGRAPH-97 (Los Angeles, USA, 1997), ACM Press, pp. 415-420.
60. MASUCH M., SCHUMANN L., SCHLECHTWEG S.: Animating-frame-to-frame consistent line drawings for illustrative-purposes-In Proceedings of SimVis (Magdeburg,-Germany, 1998), SCS Publishing House e.V., pp. 101-112.
61. NIENHAUS M., D̈OLLNER J.: Blueprint Rendering and-Sketchy Drawings-Addison-Wesley Professional, 2005,-ch-15, pp-235-252.
62. NEYRET F.: Advected textures-In Proceedings of-Eurographics/SIGGRAPH Symposium on Computer Animation-(San Diego, USA, 2003), Eurographics Association, pp. 147-153.
63. NORTHRUP J-D.,MARKOSIAN L.: Artistic silhouettes.-In Proceedings of the First International Symposium on-Non-photorealistic Animation and Rendering (Annecy,-France, 2000), ACM Press, pp-31-37.
64. NEHAB D., SHILANE P.: Stratified point sampling of-3D models-In Proceedings of Eurographics Symposium-on Point-Based Graphics (Zurich, Switzerland, 2004), pp. 49-56.
65. O'DONOVAN P., HERTZMANN A.: AniPaint: Interactive-painterly animation from video-IEEE Transactions on-Visualization and Computer Graphics 99, (2011).
66. PASTOR O., FREUDENBERG B., STROTHOTTE T.: Realtime-animated stippling-IEEE Computer Graphics and-Applications 23, 4 (2003), 62-68.
67. PRAUN E., HOPPE H., WEBB M., FINKELSTEIN-A.: Real-time hatching-In Proceedings of SIGGRAPH-2001 (Los Angeles, USA, 2001), ACM Press,-p-581.
68. RUSINKIEWICZ S., COLE F., DECARLO D.,-FINKELSTEIN A.: Line drawings from 3D models-In ACM-SIGGRAPH 2008 Courses (2008).
69. ŚYKORA D., BEN-CHEN M., ?CAD́IK M., WHITED-B., SIMMONS M.: Textoons: Practical texture mapping for-hand-drawn cartoon animations-In Proceedings of the-10th International Symposium on Non-Photorealistic Animation-and Rendering (Vancouver, Canada, 2011), ACM-press, pp-75-84.
70. SANTELLA A., DECARLO D.: Visual interest and NPR:-An evaluation and manifesto-In Proceedings of the Third-International Symposium on Non-photorealistic Animation-and Rendering (Annecy, France, 2004), ACM press,-p-150.
71. ŚYKORA D., DINGLIANA J., COLLINS S.: As-rigidas-possible image registration for hand-drawn cartoon-animations-In Proceedings of the Eighth International-Symposium on Non-Photorealistic Animation and-Rendering (Los Angeles, USA, 2009), ACM press, pp. 25-33.
72. SHEPARD R.: Circularity in judgments of relative-pitch-Psychological Review 36 (1929), 172-180.
73. SCHWARZ M., STAMMINGER M.: On predicting visual-popping in dynamic scenes-In Proceedings of the-Sixth Symposium on Applied Perception in Graphics-and Visualization (Chania, Greece, 2009), ACM Press,-p-93.
74. SCHMID J., SENN M-S., GROSS M., SUMNER R.-W.: OverCoat: An implicit canvas for 3D painting-ACM-Transactions on Graphics 30 (2011), 28:1-28:10.
75. SAITO T., TAKAHASHI T.: Comprehensible rendering-of 3-D shapes-Computer Graphics (Proceedings of SIGGRAPH-90) 24, 4 (1990), 197-206.
76. SAND P., TELLER S.: Particle video: Long-range motion-estimation using point trajectories-In Proceedings of-IEEE Conference on Computer Vision and Pattern Recognition-(New York, USA, 2006), IEEE Computer Society, pp. 2195-2202.
77. SNAVELY N., ZITNICK C-L., KANG S-B., COHEN-M-F.: Stylizing 2.5-D video-In Proceedings of the-Fourth International Symposium on Non-photorealistic- Animation and Rendering (Annecy, France, 2006), ACM-Press.
78. UMENHOFFER T., SŹECSI L., SZIRMAY-KALOS L.:-Hatching for motion picture production-Computer Graphics-Forum 30 (2011), 533-542.
79. VANDERHAEGHE D., BARLA P., THOLLOT J., SILLION-F.: Dynamic point distribution for stroke-based rendering.-In Proceedings of the 18th Eurographics Symposium on-Rendering 2007 (Grenoble, France, 2007), Eurographics-Association, pp-139-146.
80. VERYOVKA O.: Animation with threshold textures.-In Proceedings of Graphics Interface (Calgary, Canada,-2002), A K Peters Ltd., pp-9-16.
81. VERGNE R., VANDERHAEGHE D., CHEN J., BARLA-P., GRANIER X., SCHLICK C.: Implicit brushes for-stylized line-based rendering-Computer Graphics Forum-30 (2011), 513-522.
82. WILLATS J., DURAND F.: Defining pictorial style:-Lessons from linguistics and computer graphics-Axiomathes-15 (2005), 319-351.
83. WILLIAMS L.: Pyramidal parametrics-In Computer-Graphics (Proceedings of SIGGRAPH) 83 (Detroit, USA,-1983), ACM press, pp-1-11.
84. WINKLER S.: Perceptual video quality metrics: A-review-In Digital Video Image Quality and Perceptual-Coding-CRC Press, Boca Raton, USA, 2005.
85. WINNEM̈OLLER H., OLSEN S-C., GOOCH B.: Realtime-video abstraction-ACM Transactions on Graphics-25, 3 (2006), 1221-1226.
86. WINKENBACH G., SALESIN D-H.: Computergenerated-pen-and-ink illustration-In Proceedings of-SIGGRAPH 94 (Orlando, USA, 1994), ACM press, pp. 91-100.
87. WANG J.,XU Y., SHUM H.-Y., COHEN M-F.:Video-tooning-ACM Transactions on Graphics 23, 3 (2004),-574-583.
88. YANTIS S., JONIDES J.: Abrupt visual onsets-and selective attention: Evidence from visual-search-Journal of Experimental Psychology: Human-Perception and Performance 10, 5 (1984), 601-621.
89. ZENG K., ZHAO M., XIONG C., ZHU S.-C.: From-image parsing to painterly rendering-ACM Transactions-on Graphics 29 (2009), 2:1-2:11..