Rapid avatar capture and simulation using commodity depth sensors

Computer Animation and Virtual Worlds

Volumn 25, Issue 3-4, 2014, Pages 201-211

  Shapiro, Ari ^a   Feng, Andrew ^a   Wang, Ruizhe ^b   Li, Hao ^b   Bolas, Mark ^a   Medioni, Gerard ^b   Suma, Evan ^a  

^a Institute for Creative Technologies University of Southern California ^*  (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Animation; Avatar; Image capture

Indexed keywords

ANIMATION; HARDWARE;

3-D MODELING; 3D MODELS; AVATAR; CROWD SIMULATION; DEPTH SENSORS; IMAGE CAPTURES; MODEL ACQUISITION; SIMULATED ENVIRONMENT;

COMPUTER SIMULATION;

EID: 84905594639     PISSN: 15464261     EISSN: 1546427X     Source Type: Journal    
DOI: 10.1002/cav.1579     Document Type: Conference Paper

References (27)

1. Tong J, Zhou J, Liu L, Pan Z, Yan H. Scanning 3D full human bodies using kinects. IEEE Transactions on Visualization and Computer Graphics 2012; 18(4): 643-650.
2. Sumner RW, Schmid J, Pauly M. Embedded deformation for shape manipulation. In ACM Transactions on Graphics (TOG), Vol. 26. ACM: New York, NY, USA, 2007; 80.
3. Zeng M, Zheng J, Cheng X, Liu X. Templateless quasi-rigid shape modeling with implicit loop-closure. In 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE: Portland, Oregon, USA, 2013; 145-152.
4. Wang R, Choi J, Medioni G. Accurate full body scanning from a single fixed 3d camera. In 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT). IEEE: Zurich, Switzerland, 2012; 432-439.
5. Cui Y, Chang W, Nöll T, Stricker D. KinectAvatar: fully automatic body capture using a single kinect. In Computer VISION-ACCV 2012 Workshops. Springer: Daejeon, Korea, 2013; 133-147.
6. Li H, Vouga E, Gudym A, Luo L, Barron JT, Gusev G. 3D self-portraits. ACMTransactions on Graphics (Proceedings SIGGRAPH Asia 2013) 2013; 32(6): 187.
7. Chen Y, Medioni G. Object modelling by registration of multiple range images. Image and Vision Computing 1992; 10(3): 145-155.
8. Kazhdan M, Bolitho M, Hoppe H. Poisson surface reconstruction. In Proceedings of the Fourth Eurographics Symposium on Geometry Processing, Sardinia, Italy, 2006.
9. Newcombe RA, Davison AJ, Izadi S, Kohli P, Hilliges O, Shotton J, Molyneaux D, Hodges S, Kim D, Fitzgibbon A. KinectFusion: real-time dense surface mapping and tracking. In 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE: Basel, Switzerland, 2011; 127-136.
10. Vlasic D, Peers P, Baran I, Debevec P, Popovic J, Rusinkiewicz S, Matusik W. Dynamic shape capture using multi-view photometric stereo. In In ACM Transactions on Graphics, Yokohama, Japan, 2009.
11. Wu C, Stoll C, Valgaerts L, Theobalt C. On-set performance capture of multiple actors with a stereo camera. In ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2013), volume 32, Hong Kong, November 2013.
12. Anguelov D, Srinivasan P, Koller D, Thrun S, Rodgers J, Davis J. Scape: shape completion and animation of people. In ACM SIGGRAPH 2005 Papers. SIGGRAPH '05. ACM: New York, NY, USA, 2005; 408-416.
13. Weiss A, Hirshberg D, Black MJ. Home 3D body scans from noisy image and range data. In 2011 IEEE International Conference on Computer Vision (ICCV). IEEE: Barcelona, Spain, 2011; 1951-1958.
14. Jain A, Thormählen T, Seidel HP, Theobalt C. MovieReshape: tracking and reshaping of humans in videos. ACM Transactions on Graphics (Proceedings SIGGRAPH Asia 2010) 2010; 29(5): 148.
15. Baran I, Popović J. Automatic rigging and animation of 3D characters. ACM Transactions on Graphics 2007; 26(3):11.
16. Bharaj G, Thormählen T, Seidel HP, Theobalt C. Automatically rigging multi-component characters. Computer Graphics Forum (Proceedings Eurographics 2012) 2011; 30(2): 755-764.
17. Mixamo auto-rigger, 2013. Availvable from: http:// www.mixamo.com/c/auto- rigger [10 March 2014].
18. xxarray demo at ces, 2014. Availvable from: http:// gizmodo.com/nikon- just-put-me-in-a-video-game-andit-was-totally-in-1497441443 [10 March 2014].
19. Wang R, Choi J, Medioni G. 3D modeling from wide baseline range scans using contour coherence. In 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE: Columbus, Ohio, USA, 2014.
20. Chuang M, Luo L, Brown BJ, Rusinkiewicz S, Kazhdan M. Estimating the Laplace-Beltrami operator by restricting 3D functions. In Computer Graphics Forum, Vol. 5. Wiley Online Library: New York, NY, USA, 2009; 1475-1484
21. Fischler MA, Bolles RC. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 1981; 24(6): 381-395.
22. Rusinkiewicz S, Levoy M. Efficient variants of the ICP algorithm. In 2001 Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling. IEEE: Quebec City, Quebec, Canada, 2001; 145-152.
23. Dionne O, de Lasa M. Geodesic voxel binding for production character meshes. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation. SCA '13. ACM: New York, NY, USA, 2013; 173-180.
24. Feng A, Huang Y, Xu Y, Shapiro A. Fast, automatic character animation pipelines. Computer Animation and Virtual Worlds 2013; 25(1): 3-16.
25. Buss SR. Introduction to inverse kinematics with jacobian transpose, pseudoinverse and damped least squares methods. Technical report, IEEE Journal of Robotics and Automation 2004.
26. McDonnell R, Larkin M, Hernández B, Rudomin I, O'Sullivan C. Eye-catching crowds: saliency based selective variation. ACM Transactions on Graphics 2009; 28(3): 55:1-55:10.
27. McDonnell R, Larkin M, Dobbyn S, Collins S, O'Sullivan C. Clone attack! perception of crowd variety. ACM Transactions on Graphics 2008; 27(3): 26:1-26:8.