Body talk: Crowdshaping realistic 3D avatars with words

ACM Transactions on Graphics

Volumn 35, Issue 4, 2016, Pages

  Streuber, Stephan ^a   Quiros Ramirez, M Alejandra ^a   Hill, Matthew Q ^b   Hahn, Carina A ^b   Zuffi, Silvia ^c   O'Toole, Alice ^b   Black, Michael J ^a  

^a MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^b UNIVERSITY OF TEXAS AT DALLAS   (United States)

^c Istituto Per Le Tecnologie Della Costruzione Consiglio Nazionale Delle Ricerche (ITC CNR)   (Italy)

Author keywords

3D shape; Anthropometry; Avatars; Body shape; Crowdsourcing; Human body modeling; Perception

Indexed keywords

ANTHROPOMETRY; COMPUTATIONAL LINGUISTICS; CROWDSOURCING; INTERACTIVE COMPUTER GRAPHICS; LINGUISTICS; SCANNING; SEARCH ENGINES; SENSORY PERCEPTION; VIRTUAL REALITY;

3-D SHAPE; AVATARS; BODY SHAPES; DATABASE SEARCHES; HIGH RESOLUTION SCANS; HUMAN BODY MODELING; LINEAR FUNCTIONS; LINGUISTIC DESCRIPTIONS;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84980047583     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2897824.2925981     Document Type: Conference Paper

References (49)

1. ALLEN, B., CURLESS, B., AND POPOVIC, Z. 2003. The space of human body shapes: Reconstruction and parameterization from range scans. ACM transactions on graphics (TOG) 22, 3, 587-594.
2. ALLEN, B., CURLESS, B., AND POPOVIC, Z. 2004. Exploring the space of human body shapes: Data-driven synthesis under anthropometric control. In SAE International Proc. Digital Human Modeling for Design and Engineering Conference.
3. ALLEN, B., CURLESS, B., POPOVIC, Z., AND HERTZMANN, A. 2006. Learning a correlated model of identity and posedependent body shape variation for real-time synthesis. In Proceedings of the 2006 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, Airela-Ville, Switzerland, Switzerland, SCA '06, 147-156.
4. ANGUELOV, D., SRINIVASAN, P., KOLLER, D., THRUN, S., RODGERS, J., AND DAVIS, J. 2005. SCAPE: Shape Completion and Animation of PEople. ACM Trans. Graph. (Proc. SIGGRAPH 24, 3, 408-416.
5. BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3D faces. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH '99, 187-194.
6. BOGO, F., BLACK, M. J., LOPER, M., AND ROMERO, J. 2015. Detailed full-body reconstructions of moving people from monocular RGB-D sequences. In Int. Conf. Comp. Vis. (ICCV), 2300-2308.
7. CARTER, J., AND HEATH, B. 1990. Somatotyping: Development and applications. Cambridge University Press, Cambridge.
8. CHAUDHURI, S., KALOGERAKIS, E., GIGUERE, S., AND FUNKHOUSER, T. 2013. Attribit: content creation with semantic attributes. In Proceedings of the 26th annual ACM symposium on User interface software and technology, ACM, 193-202.
9. GORBER, S. C., TREMBLAY, M., MOHER, D., AND GORBER, B. 2007. A comparison of direct vs. self-report measures for assessing height, weight and body mass index: A systematic review. Obesity Reviews 8, 4, 307-326.
10. GORDON, C., CHURCHILL, T., CLAUSER, C., BRADTMILLER, B., AND MCCONVILLE, J. 1989. Anthropometric survey of US Army personnel: Methods and summary statistics 1988. Tech. rep., DTIC Document.
11. GREENACRE, M. 2007. Correspondence analysis in practice (2nd ed.). Chapman and Hall/CRC.
12. GUY, S. J., KIM, S., LIN, M. C., AND MANOCHA, D. 2011. Simulating heterogeneous crowd behaviors using personality trait theory. In Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, SCA '11, 43-52.
13. HAMMETT, D. 1929. The Maltese Falcon. Alfred A. Knopf.
14. HASLER, N., STOLL, C., SUNKEL, M., ROSENHAHN, B., AND SEIDEL, H. 2009. A statistical model of human pose and body shape. Computer Graphics Forum 28, 2, 337-346.
15. HILL, M. Q., STREUBER, S., HAHN, C. A., BLACK, M. J., AND O'TOOLE, A. J. 2015. Exploring the relationship between body shapes and descriptions by linking similarity spaces. J Vis. 15, 12, 931.
16. HIRSHBERG, D., LOPER, M., RACHLIN, E., AND BLACK, M. 2012. Coregistration: Simultaneous alignment and modeling of articulated 3D shape. In European Conf. on Computer Vision (ECCV), Springer-Verlag, A. F. et al. (Eds.), Ed., LNCS 7577, Part IV, 242-255.
17. JAIN, A., THORMÄ HLEN, T., SEIDEL, H.-P., AND THEOBALT, C. 2010. Moviereshape: Tracking and reshaping of humans in videos. ACM Trans. Graph. 29, 6 (Dec.), 148:1-148:10.
18. KLARE, B., KLUM, S., KLONTZ, J., TABORSKY, E., AKGUL, T., AND JAIN, A. 2014. Suspect identification based on descriptive facial attributes. In Biometrics (IJCB), 2014 IEEE International Joint Conference on, 1-8.
19. KLEINDESSNER, M., AND VON LUXBURG, U. 2015. Dimensionality estimation without distances. In AISTATS.
20. LI, H., VOUGA, E., GUDYM, A., LUO, L., BARRON, J. T., AND GUSEV, G. 2013. 3D self-portraits. ACM Trans. Graph. (Proceedings SIGGRAPH Asia 2013) 32, 6 (November).
21. LITTLE, A. C., ROBERTS, S. C., JONES, B. C., AND DEBRUINE, L. M. 2012. The perception of attractiveness and trustworthiness in male faces affects hypothetical voting decisions differently in wartime and peacetime scenarios. Q J Exp Psychol 65, 10 (May), 2018-2032.
22. LIU, T., HERTZMANN, A., LI, W., AND FUNKHOUSER, T. 2015. Style compatibility for 3D furniture models. ACM Trans. Graph. (TOG) 34, 4, 85.
23. LOPER, M., MAHMOOD, N., ROMERO, J., PONS-MOLL, G., AND BLACK, M. J. 2015. SMPL: A skinned multi-person linear model. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 34, 6 (Oct.), 248:1-248:16.
24. LUN, Z., KALOGERAKIS, E., AND SHEFFER, A. 2015. Elements of style: Learning perceptual shape style similarity. ACM Trans. Graph. 34, 4.
25. MATUSIK, W., PFISTER, H., BRAND, M., AND MCMILLAN, L. 2003. A data-driven reflectance model. ACM Trans. Graph. 22, 3 (July), 759-769.
26. O'DONOVAN, P., LIBEKS, J., AGARWALA, A., AND HERTZMANN, A. 2014. Exploratory font selection using crowdsourced attributes. ACM Trans. Graph. 33, 4 (July), 92:1-92:9.
27. O'TOOLE, A., PRICE, T., VETTER, T., BARTLETT, J., AND BLANZ, V. 1999. 3D shape and 2D surface textures of human faces: The role of averages in attractiveness and age. Image and Vision Computing 18, 1, 9-19.
28. PARIKH, D., AND GRAUMAN, K. 2011. Relative attributes. In Int. Conf. Comp. Vis. (ICCV), 503-510.
29. PONS-MOLL, G., FLEET, D., AND ROSENHAHN, B. 2014. Posebits for monocular human pose estimation. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, 2345-2352.
30. REID, D., AND NIXON, M. 2013. Human identification using facial comparative descriptions. In Biometrics (ICB), 2013 International Conference on, 1-7.
31. REID, D. A., NIXON, M. S., AND STEVENAGE, S. V. 2014. Soft biometrics; human identification using comparative descriptions. IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI) 36 (June), 1216-1228.
32. ROBINETTE, K., BLACKWELL, S., DAANEN, H., BOEHMER, M., FLEMING, S., BRILL, T., HOEFERLIN, D., AND BURNSIDES, D. 2002. Civilian American and European Surface Anthropometry Resource (CAESAR) final report. Tech. Rep. AFRL-HEWP-TR-2002-0169, US Air Force Research Laboratory.
33. SEKUNOVA, A., BLACK, M., PARKINSON, L., AND BARTON, J. J. S. 2013. Viewpoint and pose in body-form adaptation. Perception 42, 2, 176-186.
34. SEO, H.-W., AND MAGNENAT-THALMANN, N. 2003. An automatic modeling of human bodies from sizing parameters. In In Proceedings of the 2003 Symposium on Interactive 3D Graphics, ACM Press, 1926.
35. SEO, H.-W., CORDIER, F., AND MANGNENAT-THALMANN, N. 2003. Synthesizing body models with parameterized shape modifications. In In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, 120125.
36. SHAPIRO, A., FENG, A., WANG, R., LI, H., BOLAS, M., MEDIONI, G., AND SUMA, E. 2014. Rapid avatar capture and simulation using commodity depth sensors. Computer Animation and Virtual Worlds.
37. SHELDON, W. H. 1940. The Varieties of Human Physique (An Introduction to Constitutional Psychology). Harper and Brothers.
38. SIGAL, L., MAHLER, M., DIAZ, S., MCINTOSH, K., CARTER, E., RICHARDS, T., AND HODGINS, J. 2015. A perceptual control space for garment simulation. ACM Trans. Graph. 34, 4 (July), 117:1-117:10.
39. 2015. SMPL model. http://smpl.is.tue.mpg.de/. Accessed: 2015-12-10.
40. 2016. Somatotypes. http://users.rider.edu/-suler/somato.html. Accessed: 2016-01-14.
41. SPENCER, E. A., APPLEBY, P. N., DAVEY, G. K., AND KEY, T. J. 2002. Validity of self-reported height and weight in 4808 epicoxford participants. Public Health Nutrition 5 (8), 561-565.
42. SUMNER, R. W. 2005. Mesh modification using deformation gradients. PhD thesis, Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science.
43. TALTON, J. O., GIBSON, D., YANG, L., HANRAHAN, P., AND KOLTUN, V. 2009. Exploratory modeling with collaborative design spaces. ACM Trans. Graph. 28, 5, 167.
44. TREYNOR, J. L. 1987. Market efficiency and the bean jar experiment. Financial Analysts Journal 43, 3 (May/June), 50-53.
45. TSOLI, A., LOPER, M., AND BLACK, M. J. 2014. Model-based anthropometry: Predicting measurements from 3D human scans in multiple poses. In Proceedings Winter Conference on Applications of Computer Vision, IEEE, 83-90.
46. WEISS, A., HIRSHBERG, D., AND BLACK, M. 2011. Home 3D body scans from noisy image and range data. In Int. Conf. Comp. Vis. (ICCV), IEEE, Barcelona, 1951-1958.
47. XIA, S., WANG, C., CHAI, J., AND HODGINS, J. 2015. Realtime style transfer for unlabeled heterogeneous human motion. ACM Trans. Graph. (TOG) 34, 4, 119.
48. YUMER, M. E., CHAUDHURI, S., HODGINS, J. K., AND KARA, L. B. 2015. Semantic shape editing using deformation handles. ACM Trans. Graph. (Proceedings of SIGGRAPH 2015) 34.
49. ZHOU, S., FU, H., LIU, L., COHEN-OR, D., AND HAN, X. 2010. Parametric reshaping of human bodies in images. ACM Trans. Graph. 29, 4 (July), 126:1-126:10.