Toward body language generation in dyadic interaction settings from interlocutor multimodal cues

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2013, Pages 3761-3765

  Yang, Zhaojun ^a   Metallinou, Angeliki ^a   Narayanan, Shrikanth ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

body language generation; communication goals; dyadic interactions; motion capture; speech

Indexed keywords

AUTOMATICALLY GENERATED; BODY LANGUAGE; COMMUNICATION GOALS; DYADIC INTERACTION; GAUSSIAN MIXTURE MODEL; LEVEL OF PREDICTABILITIES; MOTION CAPTURE; STATISTICAL METHODOLOGIES;

SIGNAL PROCESSING; SPEECH;

SPEECH COMMUNICATION;

EID: 84890526099     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2013.6638361     Document Type: Conference Paper

References (21)

1. A. Metallinou, C.-C. Lee, C. Busso, S. Carnicke, and S. Narayanan, "The USC CreativeIT database: A multimodal database of theatrical improvisation," in Proc. of Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality (MMC), 2010.
2. C. Busso, Z. Deng, M. Grimm, U. Neumann, and S. Narayanan, "Rigid head motion in expressive speech animation: Analysis and synthesis," IEEE Transactions on Audio, Speech, and Language Processing, vol. 15, no. 3, pp. 1075-1086, 2007.
3. S. Mariooryad and C. Busso, "Generating human-like behaviors using joint, speech-driven models for conversational agents," IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 8, pp. 2329-2340, 2012.
4. C. Busso, Z. Deng, U. Neumann, and S. Narayanan, "Natural head motion synthesis driven by acoustic prosodic features," Journal of Computer Animation and Virtual Worlds, vol. 16, no. 3-4, pp. 283-290, 2005.
5. M.E. Sargin, E. Erzin, Y. Yemez, A.M. Tekalp, A.T. Erdem, C. Erdem, and M. Ozkan, "Prosody-driven head-gesture animation," in Proc. of ICASSP, 2007.
6. S. Levine, C. Theobalt, and V. Koltun, "Real-time prosodydriven synthesis of body language," ACM Transactions on Graphics (TOG), vol. 28, no. 5, pp. 172, 2009.
7. S. Levine, P. Krahenbuhl, S. Thrun, and V. Koltun, "Gesture controllers," ACM Transactions on Graphics (TOG), vol. 29, no. 4, pp. 124, 2010.
8. T. L. Chartrand and J. A. Bargh, "The chameleon effect: The perception-behavior link and social interaction," Journal of Personality and Social Psychology, vol. 76, pp. 893-910, 1999.
9. P. Ekman, "Body position, facial expression and verbal behavior during interviews," Journal of Abnormal and Social Psychology, vol. 63, 1964.
10. L.P. Morency, I. de Kok, and J. Gratch, "A probabilistic multimodal approach for predicting listener backchannels," Journal of Autonomous Agents and Multi-Agent Systems, vol. 20, no. 1, pp. 70-84, 2010.
11. A. Metallinou, A. Katsamanis, and S. Narayanan, "A hierarchical framework for modeling multimodality and emotional evolution in affective dialogs," in Proc. of ICASSP, 2012.
12. C.C. Lee, C. Busso, S. Lee, and S. Narayanan, "Influence of interlocutor emotion states in dyadic spoken interactions," in Proc. of InterSpeech, 2009.
13. S. Basu, T. Choudhury, B. Clarkson, and A. Pentland, "Learning human interactions with the influence model," MIT Media Lab: Cambridge, MA., 2001.
14. C.C. Lee, A. Katsamanis, M.P. Black, B. Baucom, P.G. Georgiou, and S.S. Narayanan, "An analysis of PCA-based vocal entrainment measures in married couples affective spoken interactions," in Proc. of InterSpeech, 2011.
15. T. Toda, A. W. Black, and K. Tokuda, "Statistical mapping between articulatory movements and acoustic spectrum using a gaussian mixture model," Speech Communication, vol. 50, pp. 215-227, 2008.
16. T. Toda, A.W. Black, and K. Tokuda, "Voice conversion based on maximum likelihood estimation of spectral parameter trajectory," IEEE Transactions on Audio, Speech and Language Processing, vol. 15, pp. 2222-2235, 2007.
17. A. Metallinou, A. Katsamanis, and S. Narayanan, "Tracking continuous emotional trends of participants during affective dyadic interactions using body language and speech information," Image and Vision Computing, Special Issue on Continuous Affect Analysis, in press, 2012.
18. S. M. Carnicke, Stanislavsky in Focus: An Acting Master for the Twenty-First Century, Routledge, UK, 2008.
19. J.A. Harrigan, R. Rosenthal, and K.R. Scherer, The new handbook of Methods in Nonverbal Behavior Research, Oxford Univ. Press, 2005.
20. F.R. Bach and M.I. Jordan, "A probabilistic interpretation of canonical correlation analysis," Technical Report 688, Department of Statistics, University of California, Berkeley, 2005.
21. A. Metallinou, "Emotion Tracking Code (GMM mapping)," http://sail.usc.edu/metallin/data-code. html.