Fast generation of realistic virtual humans

Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

Volumn Part F131944, Issue , 2017, Pages

  Achenbach, Jascha ^a   Waltemate, Thomas ^a   Latoschik, Marc Erich ^b   Botsch, Mario ^a  

^a BIELEFELD UNIVERSITY   (Germany)

^b UNIVERSITY OF WÜRZBURG   (Germany)

Author keywords

3D scanning; Avatars; Virtual characters; Virtual humans

Indexed keywords

MUSCULOSKELETAL SYSTEM; PIPELINES; THREE DIMENSIONAL COMPUTER GRAPHICS;

3D-SCANNING; AVATARS; CHARACTER MODELING; COMPUTATION TIME; MANUAL INTERVENTION; MULTI-VIEW STEREO RECONSTRUCTION; VIRTUAL CHARACTER; VIRTUAL HUMANS;

VIRTUAL REALITY;

EID: 85038575411     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3139131.3139154     Document Type: Conference Paper

References (61)

1. Jascha Achenbach, Eduard Zell, and Mario Botsch. 2015. Accurate Face Reconstruction through Anisotropic Fitting and Eye Correction. In Proc. of Vision, Modeling & Visualization. 1-8.
2. Oleg Alexander, Mike Rogers, William Lambeth, Matt Chiang, and Paul Debevec. 2009. The Digital Emily Project: Photoreal Facial Modeling and Animation. In SIGGRAPH 2009 Courses. ACM, 1-15.
3. Brett Allen, Brian Curless, and Zoran Popovic. 2003. The Space of Human Body Shapes: Reconstruction and Parameterization from Range Scans. ACM Transactions on Graphics 22, 3 (2003), 587-594.
4. Brett Allen, Brian Curless, Zoran Popovic, and Aaron Hertzmann. 2006. Learning a Correlated Model of Identity and Pose-Dependent Body Shape Variation for Real-Time Synthesis. In Proc. of Eurographics Symposium on Computer Animation. 147-156.
5. Dragomir Anguelov, Praveen Srinivasan, Daphne Koller, Sebastian Thrun, Jim Rodgers, and James Davis. 2005. SCAPE: Shape Completion and Animation of People. ACM Transactions on Graphics 24, 3 (2005), 408-416.
6. Akshay Asthana, Stefanos Zafeiriou, Shiyang Cheng, and Maja Pantic. 2013. Robust discriminative response map fitting with constrained local models. In Proc. of IEEE Conference on Computer Vision and Pattern Recognition. 3444-3451.
7. Autodesk. 2014. Character Generator. https://charactergenerator.autodesk.com/.(2014).
8. Domna Banakou and Mel Slater. 2014. Body ownership causes illusory self-attribution of speaking and influences subsequent real speaking. Proceedings of the National Academy of Sciences 111, 49 (2014), 17678-17683.
9. Ilya Baran and Jovan Popovic. 2007. Automatic Rigging and Animation of 3D Characters. ACM Transactions on Graphics 26, 3, Article 72 (2007), 8 pages.
10. Thabo Beeler, Bernd Bickel, Paul Beardsley, Bob Sumner, and Markus Gross. 2010. High-quality Single-shot Capture of Facial Geometry. ACM Transactions on Graphics 29, 4 (2010), 1-9.
11. Volker Blanz and Thomas Vetter. 1999. A morphable model for the synthesis of 3D faces. In Proc. of SIGGRAPH. 187-194.
12. Federica Bogo, Michael J Black, Matthew Loper, and Javier Romero. 2015. Detailed full-body reconstructions of moving people from monocular RGB-D sequences. In Proc. of IEEE International Conference on Computer Vision. 2300-2308.
13. Federica Bogo, Javier Romero, Matthew Loper, and Michael J. Black. 2014. FAUST: Dataset and Evaluation for 3D Mesh Registration. In Proc. of IEEE Conference on Computer Vision and Pattern Recognition. 3794-3801.
14. Sofien Bouaziz, Andrea Tagliasacchi, and Mark Pauly. 2014. Dynamic 2D/3D Registration. In Eurographics Tutorials.
15. Sofien Bouaziz, Yangang Wang, and Mark Pauly. 2013. Online Modeling for Realtime Facial Animation. ACM Transactions on Graphics 32, 4, Article 40 (2013), 10 pages.
16. Samuel R Buss. 2004. Introduction to inverse kinematics with jacobian transpose, pseudoinverse and damped least squares methods. IEEE Journal of Robotics and Automation 17 (2004), 1-19.
17. Chen Cao, Qiming Hou, and Kun Zhou. 2014a. Displaced Dynamic Expression Regression for Real-time Facial Tracking and Animation. ACM Transactions on Graphics 33, 4 (2014), 1-10.
18. Chen Cao, Yanlin Weng, Shun Zhou, Yiying Tong, and Kun Zhou. 2014b. FaceWare-house: A 3D facial expression database for visual computing. IEEE Transactions on Visualization and Computer Graphics 20, 3 (2014), 413-425.
19. P. Ekman and W. Friesen. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press.
20. Andrew Feng, Dan Casas, and Ari Shapiro. 2015. Avatar Reshaping and Automatic Rigging Using a Deformable Model. In Proc. of ACM Motion in Games. 57-64.
21. Andrew Feng, Evan Suma Rosenberg, and Ari Shapiro. 2017. Just-in-time, viable, 3-D avatars from scans.computer Animation and Virtual Worlds 28 (2017), 3-4.
22. Andrew Feng, Ari Shapiro, Wang Ruizhe, Mark Bolas, Gerard Medioni, and Evan Suma. 2014. Rapid Avatar Capture and Simulation Using Commodity Depth Sensors. In SIGGRAPH 2014 Talks. ACM.
23. Pablo Garrido, Michael Zollhöfer, Dan Casas, Levi Valgaerts, Kiran Varanasi, Patrick Pérez, and Christian Theobalt. 2016. Reconstruction of Personalized 3D Face Rigs from Monocular Video. ACM Transactions on Graphics 35, 3, Article 28 (2016), 15 pages.
24. Abhijeet Ghosh, Graham Fyffe, Borom Tunwattanapong, Jay Busch, Xueming Yu, and Paul Debevec. 2011. Multiview Face Capture Using Polarized Spherical Gradient Illumination. ACM Transactions on Graphics 30, 6, Article 129 (2011), 10 pages.
25. Mar González-Franco, Daniel Perez-Marcos, Bernhard Spanlang, and Mel Slater. 2010. The contribution of real-time mirror reflections of motor actions on virtual body ownership in an immersive virtual environment. In Proc. of IEEE Virtual Reality Conference. 111-114.
26. P. Guan, A. Weiss, A. Balan, and M. J. Black. 2009. Estimating human shape and pose from a single image. In Proc. of International Conference on Computer Vision. 1381-1388.
27. Nils Hasler, Carsten Stoll, Martin Sunkel, Bodo Rosenhahn, and H-P Seidel. 2009. A statistical model of human pose and body shape.computer Graphics Forum 28, 2 (2009), 337-346.
28. David A. Hirshberg, Matthew Loper, Eric Rachlin, and Michael J. Black. 2012. Coregis-tration: Simultaneous Alignment and Modeling of Articulated 3D Shape. In Proc. of European Conference on Computer Vision. 242-255.
29. Berthold K. P. Horn. 1987. Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America A 4, 4 (1987), 629-642.
30. Pei-Lun Hsieh, Chongyang Ma, Jihun Yu, and Hao Li. 2015. Unconstrained Realtime Facial Performance Capture. In Proc. of Computer Vision and Pattern Recognition. 1675-1683.
31. Alexandru Eugen Ichim, Sofien Bouaziz, and Mark Pauly. 2015. Dynamic 3D Avatar Creation from Hand-held Video Input. ACM Transactions on Graphics 34, 4, Article 45 (2015), 14 pages.
32. Tao Ju, Scott Schaefer, and Joe Warren. 2005. Mean Value Coordinates for Closed Triangular Meshes. ACM Transactions on Graphics 24, 3 (2005), 561-566.
33. Marc Latoschik, Daniel Roth, Dominik Gall, Jascha Achenbach, Thomas Waltemate, and Mario Botsch. 2017. The Effect of Avatar Realism in Immersive Social Virtual Realities. In Proc. of ACM Symposium on Virtual Reality Software and Technology. to appear.
34. Marc Erich Latoschik, Jean-Luc Lugrin, and Daniel Roth. 2016. FakeMi: a fake mirror system for avatar embodiment studies. In Proc. of ACM Virtual Reality Software and Technology. 73-76.
35. J. P. Lewis, Ken Anjyo, Taehyun Rhee, Mengjie Zhang, Fred Pighin, and Zhigang Deng. 2014. Practice and Theory of Blendshape Facial Models. In Eurographics 2014 - State of the Art Reports.
36. Hao Li, Etienne Vouga, Anton Gudym, Linjie Luo, Jonathan T. Barron, and Gleb Gusev. 2013. 3D Self-portraits. ACM Transactions on Graphics 32, 6, Article 187 (2013), 9 pages.
37. Hao Li, Thibaut Weise, and Mark Pauly. 2010. Example-based Facial Rigging. ACM Transactions on Graphics 29, 4, Article 32 (2010), 6 pages.
38. Shu Liang, Ira Kemelmacher-Shlizerman, and Linda G. Shapiro. 2014. 3D Face Hallucination from a Single Depth Frame. In Proc. of International Conference on 3D Vision. 31-38.
39. Matthew Loper, Naureen Mahmood, and Michael J. Black. 2014. MoSh: Motion and Shape Capture from Sparse Markers. ACM Transactions on Graphics 33, 6, Article 220 (2014), 13 pages.
40. Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2015. SMPL: A Skinned Multi-person Linear Model. ACM Transactions on Graphics 34, 6, Article 248 (2015), 16 pages.
41. Jean-Luc Lugrin, Johanna Latt, and Marc Erich Latoschik. 2015. Anthropomorphism and illusion of virtual body ownership. In Proc. of the 25th International Conference on Artificial Reality and Telexistence and 20th Eurographics Symposium on Virtual Environments. 1-8.
42. C. Malleson, M. Kosek, M. Klaudiny, I. Huerta, J. C. Bazin, A. Sorkine-Hornung, M. Mine, and K. Mitchell. 2017. Rapid one-shot acquisition of dynamic VR avatars. In Proc. of IEEE Virtual Reality Conference. 131-140.
43. Tabitha C Peck, Sofia Seinfeld, Salvatore M Aglioti, and Mel Slater. 2013. Putting yourself in the skin of a black avatar reduces implicit racial bias. Consciousness and cognition 22, 3 (2013), 779-787.
44. Patrick Pérez, Michel Gangnet, and Andrew Blake. 2003. Poisson Image Editing. ACM Transactions on Graphics 22, 3 (2003), 313-318.
45. Leonid Pishchulin, Stefanie Wuhrer, Thomas Helten, Christian Theobalt, and Bernt Schiele. 2017. Building Statistical Shape Spaces for 3D Human Modeling. Pattern Recognition (2017), 276-286.
46. Gerard Pons-Moll, Sergi Pujades, Sonny Hu, and Michael Black. 2017. ClothCap: Seamless 4D Clothing Capture and Retargeting. ACM Transactions on Graphics 36, 4, Article 73 (2017), 15 pages.
47. Daniel Roth, Kristoffer Waldow, Felix Stetter, Gary Bente, Marc Erich Latoschik, and Arnulph Fuhrmann. 2016. SIAMC: a socially immersive avatar mediated communication platform. In Proc. of ACM Virtual Reality Software and Technology. 357-358.
48. Fuhao Shi, Hsiang-Tao Wu, Xin Tong, and Jinxiang Chai. 2014. Automatic Acquisition of High-fidelity Facial Performances Using Monocular Videos. ACM Transactions on Graphics 33, 6, Article 222 (2014), 13 pages.
49. Leonid Sigal, Alexandru O. Balan, and Michael J. Black. 2007.combined discriminative and generative articulated pose and non-rigid shape estimation. In Proc. of International Conference on Neural Information Processing Systems. 1337-1344.
50. Mel Slater, Bernhard Spanlang, Maria V Sanchez-Vives, and Olaf Blanke. 2010. First person experience of body transfer in virtual reality. PloS one 5, 5 (2010).
51. Matthias Straka, Stefan Hauswiesner, Matthias Ruther, and Horst Bischof. 2012. Rapid Skin: Estimating the 3D Human Pose and Shape in Real-Time. In Proc. of International Conference on 3D Imaging, Modeling, Processing, Visualization Transmission. 41-48.
52. Jürgen Sturm, Erik Bylow, Fredrik Kahl, and Daniel Cremers. 2013. CopyMe3D: Scanning and Printing Persons in 3D. In Proc. of German Conference on Pattern Recognition. 405-414.
53. Robert W. Sumner and Jovan Popovic. 2004. Deformation Transfer for Triangle Meshes. ACM Transactions on Graphics 23, 3 (2004), 399-405.
54. Justus Thies, Michael Zollhöfer, Matthias Nießner, Levi Valgaerts, Marc Stamminger, and Christian Theobalt. 2015. Real-time Expression Transfer for Facial Reenactment. ACM Transactions on Graphics 34, 6, Article 183 (2015), 14 pages.
55. J. Thies, M. Zollhöfer, M. Stamminger, C. Theobalt, and M. Nießner. 2016. Face2Face: Real-time Face Capture and Reenactment of RGB Videos. In Proc. of IEEE Computer Vision and Pattern Recognition. 2387-2395.
56. Jing Tong, Jin Zhou, Ligang Liu, Zhigeng Pan, and Hao Yan. 2012. Scanning 3D Full Human Bodies Using Kinects. IEEE Transactions on Visualization and Computer Graphics 18, 4 (2012), 643-650.
57. Aggeliki Tsoli, Naureen Mahmood, and Michael J. Black. 2014. Breathing Life into Shape: Capturing, Modeling and Animating 3D Human Breathing. ACM Transactions on Graphics 33, 4, Article 52 (2014), 11 pages.
58. Thibaut Weise, Sofien Bouaziz, Hao Li, and Mark Pauly. 2011. Realtime Performance-based Facial Animation. ACM Transactions on Graphics 30, 4, Article 77 (2011), 10 pages.
59. Alexander Weiss, David Hirshberg, and Michael J. Black. 2011. Home 3D Body Scans from Noisy Image and Range Data. In Proc. of IEEE International Conference on Computer Vision. 1951-1958.
60. Chenglei Wu, Derek Bradley, Markus Gross, and Thabo Beeler. 2016. An Anatomically-Constrained Local Deformation Model for Monocular Face Capture. ACM Transactions on Graphics 35, 4, Article 115 (2016), 12 pages.
61. Stefanie Wuhrer, Leonid Pishchulin, Alan Brunton, Chang Shu, and Jochen Lang. 2014. Estimation of Human Body Shape and Posture Under Clothing.computer Vision and Image Understanding 127 (2014), 31-42.