Interactive animation of 4D performance capture

IEEE Transactions on Visualization and Computer Graphics

Volumn 19, Issue 5, 2013, Pages 762-773

  Casas, Dan ^a   Tejera, Margara ^a   Guillemaut, Jean Yves ^a   Hilton, Adrian ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

3D video; 4D modeling; 4D performance capture; Character animation; multiview reconstruction; real time animation; video based animation

Indexed keywords

3-D VIDEOS; CHARACTER ANIMATION; MULTI-VIEW RECONSTRUCTION; PERFORMANCE CAPTURE; REAL-TIME ANIMATIONS;

BLENDING;

ANIMATION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER INTERFACE; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; LOCOMOTION; MATHEMATICAL COMPUTING; METHODOLOGY; PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; THREE DIMENSIONAL IMAGING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER GRAPHICS; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; LOCOMOTION; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUBTRACTION TECHNIQUE; USER-COMPUTER INTERFACE;

EID: 84875612327     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2012.314     Document Type: Article

References (43)

1. O. Arikan and D. Forsyth, "Synthesizing Constrained Motions from Examples," Proc. ACM SIGGRAPH '02, 2002.
2. L. Kovar, M. Gleicher, and F. Pighin, "Motion Graphs," Proc. ACM SIGGRAPH '02, pp. 473-482, 2002.
3. J. Lee, J. Chai, P. Reitsma, J. Hodgins, and N. Pollard, "Interactive Control of Avatars Animated with Human Motion Data," Proc. ACM SIGGRAPH '02, pp. 491-500, 2002.
4. R. Heck and M. Gleicher, "Parametric Motion Graphs," Proc. ACM Symp. Interactive 3D Graphics, 2007.
5. C. Rose, M. Cohen, and B. Bodenheimer, "Verbs and Adverbs: Multidimensional Motion Interpolation," IEEE Computer Graphics and Applications, vol. 18, no. 5, pp. 32-40, Sept. 1998. (Pubitemid 128555418)
6. E. de Aguiar, C. Stoll, C. Theobalt, N. Ahmed, H.-P. Seidel, and S. Thrun, "Performance Capture from Sparse Multi-View Video," Proc. ACM SIGGRAPH '08, vol. 27, no. 3, 2008.
7. D. Vlasic, I. Baran, W. Matusik, and J. Popovic, "Articulated Mesh Animation from Multi-View Silhouettes," Proc. ACM SIGGRAPH '08, 2008.
8. J. Starck and A. Hilton, "Surface Capture for Performance-Based Animation," IEEE Computer Graphics and Applications, vol. 27, no. 3, pp. 21-31, May/June 2007. (Pubitemid 46767722)
9. F. Xu, Y. Liu, C. Stoll, J. Tompkin, G. Bharaj, Q. Dai, H.-P. Seidel, J. Kautz, and C. Theobalt, "Video-Based Characters-Creating New Human Performances from a Multi-View Video Database," Proc. ACM SIGGRAPH '11, 2011.
10. C. Zitnick, S. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-Quality Video View Interpolation Using a Layered Representation, " Proc. ACM SIGGRAPH '04, 2004.
11. I. Baran, D. Vlasic, E. Grinspun, and J. Popovic, "Semantic Deformation Transfer," Proc. ACM SIGGRAPH '09, 2009.
12. C. Stoll, J. Gall, E. de Aguiar, S. Thrun, and C. Theobalt, "Video-Based Reconstruction of Animatable Human Characters," Proc. ACM SIGGRAPH ASIA '10, 2010.
13. D. Casas, M. Tejera, J.-Y. Guillemaut, and A. Hilton, "4d Parametric Motion Graphs for Interactive Animation," Proc. ACM SIGGRAPH Symp. Interactive 3D Graphics and Games (I3D '12), pp. 103-110, 2012.
14. T. Kanade and P. Rander, "Virtualized Reality: Constructing Virtual Worlds from Real Scenes," IEEE MultiMedia, vol. 4, no. 1, pp. 34-47, Jan.-Mar. 1997. (Pubitemid 127583991)
15. J. Carranza, C. Theobalt, M. Magnor, and H.-P. Seidel, "Free-Viewpoint Video of Human Actors," Proc. ACM SIGGRAPH '03, pp. 565-577, 2003.
16. C. Cagniart, E. Boyer, and S. Ilic, "Free-Form Mesh Tracking: A Patch-Based Approach," Proc. IEEE Conf. Computer Vision and Pattern Recognition '10, pp. 1339-1346, 2010.
17. S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade, "Three-Dimensional Scene Flow," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 475-480, Mar. 2005. (Pubitemid 40377340)
18. M. Wand, B. Adams, M. Ovsianikov, A. Berner, M. Bokeloh, P. Jenke, L. Guibas, H.-P. Seidel, and A. Schilling, "Efficient Reconstruction of Non-Rigid Shape and Motion from Real-Time 3D Scanner Data," ACM Trans. Graphics, vol. 28, no. 2, article 15, 2009.
19. P. Huang, C. Budd, and A. Hilton, "Global Temporal Registration of Multiple Non-Rigid Surface Sequences," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition '11, 2011.
20. T. Tung and T. Matsuyama, "Dynamic Surface Matching by Geodesic Mapping for Animation Transfer," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition '10, 2010.
21. C. Budd, P. Huang, M. Klaudiny, and A. Hilton, "Global Non-Rigid Alignment of Surface Sequences," Int'l J. Computer Vision, pp. 1-15, http://dx.doi.org/10.1007/s11263-012-0553-4, 2012.
22. P. Huang, A. Hilton, and J. Starck, "Human Motion Synthesis from 3d Video," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition '09, 2009.
23. J. Starck, G. Miller, and A. Hilton, "Video-Based Character Animation," Proc. ACM Symp. Computer Animation, 2005.
24. C. Bregler, M. Covell, and M. Slaney, "Video Rewrite: Driving Visual Speech with Audio," Proc. ACM SIGGRAPH '97, pp. 1-8, 1997.
25. A. Schodl, D. Szeliski, R. Salesin, and I. Essa, "Video Textures," Proc. ACM SIGGRAPH '00, 2000.
26. M. Flagg, A. Nakazawa, Q. Zhang, S.-B. Kang, Y. Ryu, I. Essa, and J. Rehg, "Human Video Textures," Proc. ACM Symp. Interactive 3D Graphics, 2009.
27. S. Kircher and M. Garland, "Free-Form Motion Processing," ACM Trans. Graphics, vol. 27, no. 2, pp. 1-13, 2008.
28. W. Xu, K. Zhou, Y. Yu, Q. Peng, and B. Guo, "Gradient Domain Editing of Deforming Mesh Sequences," Proc. ACM SIGGRAPH '07, vol. 26, no. 3, 2007.
29. M. Gleicher, "Motion Editing with Spacetime Constraints," Proc. ACM Symp. Interactive 3D Graphics, 1997.
30. J. Lee and S. Shin, "A Hierarchical Approach to Interactive Motion Editing for Human-Like Figures," Proc. ACM SIGGRAPH '99, pp. 39-48, 1999.
31. Z. Popovic and A. Witkin, "Physically Based Motion Transformation," Proc. ACM SIGGRAPH '99, 1999.
32. J. Min, Y.-L. Chen, and J. Chai, "Interactive Generation of Human Animation with Deformable Motion Models," ACM Trans. Graphics, vol. 29, no. 1, pp. 9:1-9:12, Dec. 2009.
33. A. Brundelin and L. Williams, "Motion Signal Processing," Proc. ACM SIGGRAPH '95, pp. 97-104, 1995.
34. D. Wiley and J. Hahn, "Interpolation Synthesis for Articulated Figure Motion," Proc. IEEE Virtual Reality Int'l Symp., pp. 157-160, 1997.
35. L. Kovar and M. Gleicher, "Automated Extraction and Parameterization of Motions in Large Date Sets," Proc. ACM SIGGRAPH '04, vol. 23, no. 3, pp. 559-568, 2004.
36. T. Mukai and S. Kuriyama, "Geostatistical Motion Interpolation," Proc. ACM SIGGRAPH '05, 2005.
37. L. Zhao and A. Safonova, "Achieving Good Connectivity in Motion Graphs," Proc. ACM SIGGRAPH/Eurographics Symp. Computer Animation (SCA'08), pp. 127-136, 2008.
38. O. Sorkine, "Differential Representations for Mesh Processing," Computer Graphics Forum, vol. 25, no. 4, pp. 789-806, 2006.
39. R. Sumner and J. Popovic, "Deformation Transfer for Triangle Meshes," Proc. ACM SIGGRAPH '04, vol. 23, no. 3, pp. 399-405, 2004.
40. A. Witkin and Z. Popovic, "Motion Warping," Proc. ACM SIGGRAPH '95, 1995.
41. C. Budd and A. Hilton, "Temporal Alignment of 3d Video Sequences Using Shape and Appearance," Proc. European Conf. Visual Media Production (CVMP '10), pp. 114-122, 2010.
42. M. Tejera and A. Hilton, "Space-Time Editing of 3d Video Sequences," Proc. Conf. Visual Media Production, pp. 148-157, http://dx.doi.org/10.1109/CVMP.2011.23, 2011.
43. A. Ahmed, F. Mokhtarian, and A. Hilton, "Parametric Motion Blending through Wavelet Analysis," Proc. Eurographics '01 Short Paper, pp. 347-353, Sept. 2001.