Gesture controllers

ACM Transactions on Graphics

Volumn 29, Issue 4, 2010, Pages

  Levine, Sergey ^a   Krähenbühl, Philipp ^a   Thrun, Sebastian ^a   Koltun, Vladlen ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Data driven animation; Gesture synthesis; Human animation; Nonverbal behavior generation; Optimal control

Indexed keywords

DATA-DRIVEN ANIMATION; GESTURE SYNTHESIS; HUMAN ANIMATION; NONVERBAL BEHAVIOR; OPTIMAL CONTROLS;

ANIMATION; CONTROL; GESTURE RECOGNITION; LINGUISTICS; OPTIMIZATION; SPEECH RECOGNITION;

CONTROLLERS;

EID: 77956388261     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1778765.1778861     Document Type: Article

References (40)

1. ALBRECHT, I., HABER, J., AND PETER SEIDEL, H. 2002. Automatic generation of non-verbal facial expressions from speech. In Computer Graphics International, 283-293.
2. BAILENSON, J. N., BEALL, A. C., LOOMIS, J., BLASCOVICH, J., AND TURK, M. 2004. Transformed social interaction: Decoupling representation from behavior and form in collaborative virtual environments. Presence: Teleoperators and Virtual Environments 13, 4, 428-441.
3. BERTSEKAS, D. 2007. Dynamic Programming and Optimal Control, third ed. Athena Scientific.
4. BIRDWHISTELL, R. 1952. Introduction to Kinesics. Department of State Foreign Service Institute, Washington, DC.
5. BRAND, M. 1999. Voice puppetry. In SIGGRAPH'99: ACM SIGGRAPH 1999 papers, ACM, New York, NY, USA, 21-28.
6. BREGLER, C., COVELL, M., AND SLANEY, M. 1997. Video rewrite: driving visual speech with audio. In SIGGRAPH'97: ACM SIGGRAPH 1997 Papers, ACM, New York, NY, USA, 353-360.
7. CASSELL, J., PELACHAUD, C., BADLER, N., STEEDMAN, M., ACHORN, B., BECKET, T., DOUVILLE, B., PREVOST, S., AND STONE, M. 1994. Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. In SIGGRAPH'94: ACM SIGGRAPH 1994 Papers, ACM, New York, NY, USA, 413-420.
8. CASSELL, J., VILHJÁLMSSON, H. H., AND BICKMORE, T. 2001. Beat: the behavior expression animation toolkit. In SIGGRAPH'01: ACM SIGGRAPH 2001 papers, ACM, New York, NY, USA, 477-486.
9. CHUANG, E., AND BREGLER, C. 2005. Mood swings: expressive speech animation. ACM Transactions on Graphics 24, 2, 331-347.
10. DE MEIJER, M. 1989. The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal Behavior 13, 4, 247-268.
11. DENG, Z., AND NEUMANN, U. 2007. Data-Driven 3D Facial Animation. Springer-Verlag Press.
12. DOBROGAEV, S. M. 1931. Ucenie o reflekse v problemakh jazykovedenija. [Observations on reflex in aspects of language study.]. Jazykovedenie i Materializm 2, 105-173.
13. EFRON, D. 1972. Gesture, Race and Culture. The Hague: Mouton.
14. ENGLEBIENNE, G., COOTES, T., AND RATTRAY, M. 2007. A probabilistic model for generating realistic lip movements from speech. In Neural Information Processing Systems (NIPS) 19, MIT Press.
15. FEYEREISEN, P., AND DE LANNOY, J.-D. 1991. Gestures and Speech: Psychological Investigations. Cambridge University Press.
16. HARTMANN, B., MANCINI, M., AND PELACHAUD, C. 2002. Formational parameters and adaptive prototype instantiation for mpeg-4 compliant gesture synthesis. In Proceedings on Computer Animation, IEEE Computer Society, Washington, DC, USA, 111.
17. HARTMANN, B., MANCINI, M., AND PELACHAUD, C. 2005. Implementing expressive gesture synthesis for embodied conversational agents. In Gesture Workshop, Springer, 188-199.
18. KENDON, A. 2004. Gesture - Visible Action as Utterance. Cambridge University Press, New York, NY, USA.
19. KIPP, M., NEFF, M., AND ALBRECHT, I. 2007. An annotation scheme for conversational gestures: How to economically capture timing and form. Language Resources and Evaluation 41, 3-4, 325-339.
20. KOPP, S., AND WACHSMUTH, I. 2004. Synthesizing multimodal utterances for conversational agents: Research articles. Computer Animation and Virtual Worlds 15, 1, 39-52.
21. LAFFERTY, J. D., MCCALLUM, A., AND PEREIRA, F. C. N. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. of the 18th International Conference on Machine Learning, Morgan Kaufmann Inc., 282-289.
22. LEVINE, S., THEOBALT, C., AND KOLTUN, V. 2009. Real-time prosody-driven synthesis of body language. In SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers, ACM, New York, NY, USA.
23. LI, Y., AND SHUM, H.-Y. 2006. Learning dynamic audio-visual mapping with input-output hidden Markov models. IEEE Transactions on Multimedia 8, 3, 542-549.
24. LOEHR, D. 2007. Aspects of rhythm in gesture and speech. Gesture 7, 2, 179-214.
25. MCCANN, J., AND POLLARD, N. 2007. Responsive characters from motion fragments. In SIGGRAPH'07: ACM SIGGRAPH 2007 papers, ACM, New York, NY, USA.
26. MCNEILL, D. 1992. Hand and Mind: What Gestures Reveal About Thought. University Of Chicago Press.
27. MORENCY, L.-P., QUATTONI, A., AND DARRELL, T. 2007. Latent-dynamic discriminative models for continuous gesture recognition. In Proc. of IEEE Computer Vision and Pattern Recognition, 1-8.
28. NEFF, M., KIPP, M., ALBRECHT, I., AND SEIDEL, H.-P. 2008. Gesture modeling and animation based on a probabilistic recreation of speaker style. ACM Transactions on Graphics 27, 1, 1-24.
29. NEWLOVE, J. 1993. Laban for Actors and Dancers. Routledge Nick Hern Books, New York, NY, USA.
30. PERLIN, K., AND GOLDBERG, A. 1996. Improv: a system for scripting interactive actors in virtual worlds. In SIGGRAPH'96: ACM SIGGRAPH 1996 Papers, ACM, 205-216.
31. RABINER, L. 1989. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77, 2, 257-286.
32. SARGIN, M. E., YEMEZ, Y., ERZIN, E., AND TEKALP, A. M. 2008. Analysis of head gesture and prosody patterns for prosody-driven head-gesture animation. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 8, 1330-1345.
33. SHRÖ DER, M. 2009. Expressive speech synthesis: Past, present, and possible futures. Affective Information Processing, 111-126.
34. STONE, M., DECARLO, D., OH, I., RODRIGUEZ, C., STERE, A., LEES, A., AND BREGLER, C. 2004. Speaking with hands: creating animated conversational characters from recordings of human performance. In SIGGRAPH'04: ACM SIGGRAPH 2004 Papers, ACM, New York, NY, USA, 506-513.
35. THE CMU SPHINX GROUP, 2007. Open source speech recognition engines.
36. TREUILLE, A., LEE, Y., AND POPOVIĆ, Z. 2007. Near-optimal character animation with continuous control. In SIGGRAPH'07: ACM SIGGRAPH 2007 Papers, ACM, New York, NY, USA.
37. VALBONESI, L., ANSARI, R., MCNEILL, D., QUEK, F., S. DUNCAN, K. E. M., AND BRYLL, R. 2002. Multimodal signal analysis of prosody and hand motion: Temporal correlation of speech and gestures. In EUSIPCO'02, vol. 1, 75-78.
38. WANG, S. B., QUATTONI, A., MORENCY, L.-P., DEMIRDJIAN, D., AND DARRELL, T. 2006. Hidden conditional random fields for gesture recognition. In Computer Vision and Pattern Recognition, 1521-1527.
39. XUE, J., BORGSTROM, J., JIANG, J., BERNSTEIN, L., AND ALWAN, A. 2006. Acoustically-driven talking face synthesis using dynamic Bayesian networks. IEEE International Conference on Multimedia and Expo, 1165-1168.
40. ZHAO, L., AND BADLER, N. I. 2005. Acquiring and validating motion qualities from live limb gestures. Graphical Models 67, 1, 1-16.